Metric	Score
PerplexityHashed	272.06

Metric	Score
PerplexityHashed	240.31

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	4b5ea8c371c783db7f9d56163be9c013 THE SOUTHERN AEGIS ChronAm 1862.4315068176052 39.535506 -76.34904 Were it not that a political party is ini…	another	tor:0.0977 free:0.1092 in:0.1178 a:0.1882 due:0.1140 an:0.1537 tho:0.1355 to:0.2011 the:0.1885 no:0.1178 :0.01	146790.40
2	34070ba2fa628b8c627d61dabf3c5dc1 RICHMOND ENQUIRER ChronAm 1841.83698626966 37.538509 -77.43428 pate the speedy maturing of a train o{ measu…	mi	for:0.0123 from:0.0150 that:0.0125 to:0.0160 :0.0438 in:0.3359 on:0.0272 of:0.0453 is:0.1166 In:0.2335	20061.52
3	b92a23883605606abbe38437fa519b9f RICHMOND ENQUIRER ChronAm 1832.5122950503442 37.538509 -77.43428 try 1 lour hi general, and making some val…	th»ir	for:0.0010 that:0.0011 in:0.0016 to:0.0026 and:0.0033 of:0.0042 a:0.0018 the:0.0600 your:0.4871 :0.0313	19433.10
4	c6f786a24bff44dfb315c040f8a43a81 RAFTSMAN'S JOURNAL ChronAm 1864.5314207334043 41.02728 -78.439188 his practical wisdom, unselfish patriotis…	to	lu:0.0884 :0.0917 under:0.1348 among:0.1466 at:0.0949 in:0.3147 through:0.2162 In:0.1596 into:0.2611 Into:0.1125	18095.88
5	71f1a87da52f361dbbd41a4844eaaa60 THE WICHITA CITY EAGLE ChronAm 1880.5177595312184 37.692236 -97.337545 quick wc arc to recognize congenial …	and	with:0.0110 :0.0380 in:0.0113 home:0.0797 off:0.0595 on:0.1001 a:0.0283 to:0.1029 by:0.1021 across:0.0873	16712.76
6	183c9c2a9d2e44ce11ff288cbc6b89c0 RAFTSMAN'S JOURNAL ChronAm 1860.4494535202894 41.02728 -78.439188 diating all previous party attachments, n…	has	would:0.1264 had:0.1268 in:0.1605 as:0.1490 Is:0.1446 and:0.2046 the:0.1607 of:0.1676 are:0.1551 yet:0.1026 :0.1	16362.50
7	1a4d8480064e27a48ebc052fe9d47b11 THE EMPIRE COUNTY ARGUS ChronAm 1854.6890410641806 38.799901 -120.890216 On the amount of postage on letter…	pf	at:0.0117 from:0.0135 and:0.0134 for:0.0150 on:0.0184 in:0.0217 by:0.0150 of:0.4539 to:0.0194 :0.0414	15419.36
8	120145f56f521b1db5cd7decd709cf04 BRADFORD OPINION ChronAm 1876.4221311159179 43.994599 -72.127742 Whereas a joint resolution of the Senate\n…	iu	against:0.0995 within:0.1014 and:0.1020 on:0.1154 at:0.1094 in:0.2906 In:0.1356 with:0.3873 by:0.1664 :0.1223	13646.91
9	02da6da0c8299f0345c57d40c428d6bc ARIZONA REPUBLICAN ChronAm 1913.5164383244546 33.448587 -112.077346 found on the tracks was shown to\nthe p…	upon	and:0.1140 through:0.1197 in:0.1360 on:0.1552 :0.1209 from:0.1372 into:0.1970 of:0.3263 to:0.1744 Into:0.1228	13581.34
10	1beccdbe73177fad2a42bf94e2b07998 THE DAILY PIONEER ChronAm 1903.7301369545917 47.478654 -94.890802 The First National bank of Bagley In re-\…	2	twelve:0.0692 eight:0.0693 5:0.0718 ten:0.0919 8:0.0700 six:0.1079 10:0.1061 7:0.1236 6:0.1106 12:0.1033	13420.71
11	14992ad409c7c301f01b45a4b385e766 THE BEAVER HERALD ChronAm 1905.5109588724 36.816137 -100.519871 Ia bis testimony before the senate\ncommitt…	ol	in:0.0085 with:0.0086 and:0.0123 on:0.0140 from:0.0120 along:0.0164 to:0.0146 of:0.4697 by:0.0193 :0.0491	13024.20
12	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	that:0.0010 in:0.0015 to:0.0025 and:0.0032 the:0.0060 a:0.0018 of:0.0189 or:0.4438 :0.0500	10827.78
13	21b500de4a66d9e9c39ee9e692e95725 RAFTSMAN'S JOURNAL ChronAm 1855.678082160071 41.02728 -78.439188 for a candidate for the office of District…	experience	head:0.0051 wife,:0.0054 life:0.0054 the:0.0059 :0.0657 voice:0.1422 right:0.0887 record:0.1059 wife:0.0091 ability:0.1848	9635.26
14	ed4d23e4321bcb1c9cef05d990bd32d1 THE GREENE COUNTY REPUBLICAN ChronAm 1867.195890379249 39.896464 -80.17923 plex Ellii lie Skirt wilt be exp…	us	by:0.1226 for:0.1318 their:0.1890 her:0.1434 all:0.1344 and:0.2012 as:0.1929 the:0.2028 to:0.1467 :0.1761	9541.63
15	18d0629f0a95483eb4dadbaf50f124f8 EVENING CAPITAL ChronAm 1884.7964480558085 38.97864 -76.492786 use he bones, so that all in ail the crea-\n…	out,	with:0.0875 Into:0.0974 up:0.1018 over:0.1122 down:0.1015 on:0.1153 through:0.1344 to:0.2760 into:0.1850 :0.1489	9352.85
16	2bda09bb6369d873623b8fc08e8396dd BRADFORD OPINION ChronAm 1878.6452054477422 43.994599 -72.127742 Each city has a certain number of\nlicense…	bnt	at:0.0067 on:0.0080 in:0.0117 of:0.0109 but:0.0155 and:0.2790 that:0.0152 for:0.0122 to:0.0111 :0.0474	9023.73
17	7569c23ae5ea2567963700bc346204b9 RICHMOND ENQUIRER ChronAm 1823.9493150367834 37.538509 -77.43428 uk iiml exeetiliug a system of internal im…	Was	be:0.0515 waa:0.0522 being:0.0864 are:0.1049 la:0.0543 were:0.1025 Is:0.0950 was:0.1592 is:0.1906 :0.1180	8804.66
18	278556545a8b5dc360c5d7025441b1f0 RAFTSMAN'S JOURNAL ChronAm 1861.8671232559614 41.02728 -78.439188 We have lately had some very heavy frosts…	towards	that:0.0958 while:0.0960 from:0.1016 by:0.1140 for:0.0974 in:0.1227 on:0.1087 of:0.1571 to:0.1514 :0.1383	8759.16
19	204ad0a91da83d39954f91163d12087c WATERBURY EVENING DEMOCRAT ChronAm 1903.4397259956875 41.558153 -73.051497 "Which is exactly what the gentl…	with	for:0.0664 concerning:0.0666 that:0.0749 of:0.0858 at:0.0675 in:0.1276 on:0.0977 to:0.1089 by:0.1859 :0.1201	8538.16
20	d22f08ecaffd11417f98813c2a416beb CHERAW GAZETTE ChronAm 1837.4506848997971 34.697656 -79.883397 probably but few instances where person\nnew…	his	In:0.0374 being:0.0396 at:0.0378 be:0.0397 per:0.0456 in:0.1235 the:0.0600 of:0.1385 or:0.0504 :0.0811	8252.61
21	cddcf3574c33d003e15f573aefbf639d RICHMOND ENQUIRER ChronAm 1822.0315068176053 37.538509 -77.43428 I doubt had arisen of the expediency of th…	with	of:0.0047 at:0.0336 in:0.0056 to:0.0432 :0.0403 and:0.0102 the:0.0060 from:0.0542 is:0.0492 upon:0.0753	8189.46
22	b37a31cc68bef7c87ef4de47858456fa RICHMOND ENQUIRER ChronAm 1822.1931506532217 37.538509 -77.43428 cope with jhc desperate adventurers who\nc…	penetrating	at:0.0738 from:0.0914 and:0.0881 to:0.0970 why:0.1055 in:0.1464 on:0.0917 of:0.2202 for:0.1296 :0.1493	8182.40
23	1a4879c5d7414cc48db6ef67bbae42e7 RICHMOND ENQUIRER ChronAm 1842.187671201167 37.538509 -77.43428 At a meeting of the Democratic and State Ri…	lliem	men:0.0745 up:0.0755 one:0.0791 her:0.0895 me:0.0856 them:0.1499 you:0.0820 him:0.1330 us:0.1318 :0.1300	8120.32
24	17e76454a4fad963ed9c5872c509ce32 THE CHARLOTTE DEMOCRAT ChronAm 1879.9465753107559 35.227087 -80.843127 Saunders shows that tea, although be…	into	with:0.0263 to:0.0302 In:0.0343 for:0.0316 :0.0587 in:0.0739 and:0.0349 of:0.0743 by:0.0383 throughout:0.0589	8048.95
25	8ca6fe3b4bc34f5ecda2d145e9dd54f8 RICHMOND ENQUIRER ChronAm 1834.1986301052766 37.538509 -77.43428 1. It must he prompt and ifTicicicut. It m…	ol	with:0.0854 at:0.0915 that:0.0936 for:0.0979 from:0.0961 in:0.1197 on:0.1110 of:0.1602 to:0.1564 :0.1485	8000.99
26	c0b91499501764085f6ae170c18e10e9 LINCOLN TELEGRAPH ChronAm 1839.850684899797 43.910755 -69.820862 and very shabily dresed with tobacco juice…	into	that:0.0729 which:0.0763 and:0.0889 to:0.1196 on:0.0845 in:0.1346 from:0.1025 of:0.1742 for:0.1257 :0.1455	7915.41
27	3ce6eddca426e860eb236fe892759f2c CLARKSVILLE CHRONICLE ChronAm 1868.236338766191 36.527761 -87.35887 o clock that night Urant got musical, a…	wa	for:0.0146 of:0.0166 from:0.0147 with:0.1576 In:0.0907 and:0.0902 at:0.0997 to:0.1978 throughout:0.1670 :0.1267	7884.88
28	c70e7b003bdb1ab83bc3ff37571dacca RICHMOND ENQUIRER ChronAm 1837.1082191463724 37.538509 -77.43428 lie submitted the petitions, the whole num…	liy	of:0.0042 the:0.0061 and:0.0042 to:0.0518 bv:0.0419 in:0.0414 that:0.0445 on:0.0583 by:0.1381 :0.0586	7847.75
29	058515133df2bc58456250a0b1ab2bfa THE JASPER WEEKLY COURIER ChronAm 1909.0397259956874 38.391448 -86.930874 currimco thtiv Is associated some…	age	of:0.0809 for:0.0819 at:0.0978 over:0.0886 with:0.0885 in:0.1242 and:0.1138 to:0.1085 by:0.1870 :0.1467	7803.20
30	001ef5d0be696bbaef13cbc4bae74927 PULLMAN HERALD ChronAm 1895.683561612126 46.730427 -117.173895 for several years how some :rra;n\nbuyers on…	willbe	ot:0.0332 shows:0.0341 is,:0.0385 is:0.0945 was,:0.0389 being:0.0607 Is:0.0452 of:0.1156 was:0.0960 :0.0848	7746.42
31	1b3e1c6d78857ba46898d7f983753875 RICHMOND ENQUIRER ChronAm 1847.17397257103 37.538509 -77.43428 The Speech or Ma. Corwin, which will l>e\nfo…	nearly	In:0.0204 almost:0.0355 and:0.0261 for:0.0360 during:0.0488 in:0.0437 on:0.0285 with:0.0383 by:0.1041 :0.0582	7734.54
32	0d27534ab9a52dc213a293c922b4e0b8 RICHMOND ENQUIRER ChronAm 1846.6561643518519 37.538509 -77.43428 company him. A latei paper stales, thai Pa…	giving	to:0.0868 on:0.1033 against:0.1064 for:0.1077 between:0.1220 and:0.1166 in:0.1108 of:0.1568 with:0.1309 :0.1599	7692.49
33	c34b6faeda33f59294e163b2ded5554f RICHMOND ENQUIRER ChronAm 1818.2260273655504 37.538509 -77.43428 \\ p' intof Ihe engine, tvillt a descripti…	info	it:0.0941 to:0.0961 on:0.1359 up:0.1096 into:0.1059 in:0.1523 his:0.1740 the:0.2086 a:0.1616 :0.1911	7658.30
34	1879f42e9e0de79a444c78db0bd0aa4a ARIZONA REPUBLICAN ChronAm 1913.1575342148656 33.448587 -112.077346 point 22o feet west of the west line 01…	lino	part:0.0712 boundary:0.0849 corner:0.0712 end:0.1038 bank:0.1114 half:0.1398 line:0.2840 side:0.2880 coast:0.1381 :0.2002	7634.48
35	40ee3bc59e545285f8ed1d75d0654160 THE CHARLOTTE DEMOCRAT ChronAm 1880.443989039415 35.227087 -80.843127 father, recently deceased at the adva…	weight	hair:0.0814 death:0.0825 back:0.0844 body:0.0853 brother:0.0998 head:0.0852 wife:0.0922 face:0.1173 name:0.1479 :0.1360	7619.76
36	1dda91e1333a001237d158d2ad3d70cc GREAT FALLS DAILY TRIBUNE ChronAm 1919.732876680619 47.504885 -111.291891 McKaye spent a large part of his …	timber	his:0.0330 our:0.0370 and:0.0406 or:0.0375 its:0.0392 the:0.1104 in:0.0977 of:0.1276 their:0.0462 :0.0885	7610.00
37	580b1072289616bdfc2beccd4de3a547 THE CHARLOTTE DEMOCRAT ChronAm 1874.2452054477424 35.227087 -80.843127 serves to pay bank circulation. This…	until	lor:0.0641 all:0.0729 on:0.0741 to:0.0976 at:0.0734 and:0.1102 ;:0.0766 for:0.2588 with:0.2402 :0.1668	7579.93
38	2ebf72a6c97bd3f7c574059d2a49822d THE NEW NORTH-WEST ChronAm 1886.4616438039066 46.395761 -112.730038 Ssksthrough her lawful representatives …	by	with:0.0879 at:0.0897 and:0.1004 for:0.0946 from:0.1054 in:0.1347 on:0.1155 of:0.1729 to:0.1234 :0.1605	7560.37
39	662c10d6642720828655a4dae5061bd3 CLARKSVILLE CHRONICLE ChronAm 1868.5040983290326 36.527761 -87.35887 I do complain that the rotate Gov\nern…	from	that:0.0854 for:0.0872 on:0.1084 with:0.0971 by:0.0896 in:0.1359 and:0.1155 to:0.1377 of:0.1045 :0.1524	7483.13
40	280e443c19d67cd7601e2f3474af4d59 THE JASPER WEEKLY COURIER ChronAm 1914.6561643518519 38.391448 -86.930874 selves confronted by a habit whic…	thorn,	with:0.0821 on:0.0821 by:0.0961 for:0.0856 from:0.0837 in:0.1346 and:0.1134 of:0.1485 to:0.1144 :0.1500	7444.48