Metric	Score
PerplexityHashed	420.77

Metric	Score
PerplexityHashed	380.26

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	12cc6fc1a3a0862a781cb8c6e9261e57 THE HOPE PIONEER ChronAm 1886.5383561326737 47.32221 -97.72232 lc for 30 miles; 350 to 400 miles, increase\…	Horses	of:0.23447851922682877 in:0.20326480431664504 the:0.14452564715524896 and:0.023017553445802884 their:0.019534184823441023 In:0.0176217471484…	12499.33
2	1dda91e1333a001237d158d2ad3d70cc GREAT FALLS DAILY TRIBUNE ChronAm 1919.732876680619 47.504885 -111.291891 McKaye spent a large part of his …	timber	of:0.23447851922682877 in:0.20326480431664504 the:0.14452564715524896 and:0.023017553445802884 their:0.019534184823441023 In:0.0176217471484…	12499.33
3	2e8bf86833a9e4ec01d644ba6214b809 RICHMOND ENQUIRER ChronAm 1853.57397257103 37.538509 -77.43428 Kkli.ow t'itixkns:--As Chairman of the meeti…	your	of:0.23447851922682877 in:0.20326480431664504 the:0.14452564715524896 and:0.023017553445802884 their:0.019534184823441023 In:0.0176217471484…	12499.33
4	183fe28ba37dad2bfcef7d8c3dce175e WATERBURY EVENING DEMOCRAT ChronAm 1907.1767122970573 41.558153 -73.051497 failed Inside the railing' and a…	uncorroborat-	of:0.5608842263019858 for:0.06346009741476208 and:0.02791307605844886 the:0.013441363806669165 in:0.013254027725739978 to:0.0118958411390033…	11409.84
5	0c2699c086df2f3d8935808c21a5297f WATERBURY EVENING DEMOCRAT ChronAm 1899.8808218860984 41.558153 -73.051497 Moody, , the evangelist, who has…	Since	that:0.3473143356898185 in:0.06646745864004082 the:0.06490051745499599 it:0.06256832592376649 there:0.01832956781575687 they:0.0178922819036…	10835.99
6	3f964be1f3008e7ef99b84e3dd28d735 RICHMOND ENQUIRER ChronAm 1838.201369831304 37.538509 -77.43428 night, several were killed ; the exact numb…	at	that:0.3473143356898185 in:0.06646745864004082 the:0.06490051745499599 it:0.06256832592376649 there:0.01832956781575687 they:0.0178922819036…	10835.99
7	03217a2bfc936fe7bf78811851087cf0 RICHMOND ENQUIRER ChronAm 1843.23698626966 37.538509 -77.43428 Fellow-citizens! It appears to me, that a ma…	upon	of:0.16809242437604727 the:0.11855101860834288 they:0.09817885175059529 it:0.09756151336096658 he:0.08609665755357615 I:0.03510009701031837 …	10795.76
8	36a56b85961a382a94857ff3e371aa96 RICHMOND ENQUIRER ChronAm 1853.6890410641806 37.538509 -77.43428 Fearoti to beg l.im not i» Hiibpn-na me be…	was	of:0.16809242437604727 the:0.11855101860834288 they:0.09817885175059529 it:0.09756151336096658 he:0.08609665755357615 I:0.03510009701031837 …	10795.76
9	308c6abc4d7051a5c169e8780a36cada RICHMOND ENQUIRER ChronAm 1851.305479420345 37.538509 -77.43428 Mr. EDMONDS. I understand tiie gentleman. n…	If	of:0.39612573427200576 to:0.09699116631541187 the:0.051701717411775254 and:0.032958163311062286 that:0.021613380565893906 is:0.0159185686740…	10672.16
10	1aaf707d2657a6682fe6d478abc632b6 THE WEEKLY INTELLIGENCER ChronAm 1894.7438355847285 39.185182 -93.882851 liut it is said the one undeniable…	Wages	of:0.39612573427200576 to:0.09699116631541187 the:0.051701717411775254 and:0.032958163311062286 that:0.021613380565893906 is:0.0159185686740…	10672.16
11	b79dfaae00181ea39ea9b1fe93f95e6f RICHMOND ENQUIRER ChronAm 1835.0534246258244 37.538509 -77.43428 Mr. King, of Alabama, said that he had lis…	ably	of:0.1529370992895512 to:0.11481545659331138 for:0.11294403049731416 why:0.1049384855311038 that:0.10039854444636978 and:0.03070525038988043…	10425.95
12	1cf4c38be0a23980fb61d19503a2bdeb RICHMOND ENQUIRER ChronAm 1826.8013698313039 37.538509 -77.43428 The gentleman from Maryland lias also told…	if	that:0.17582523337503608 of:0.17173515542296217 to:0.11514772399191608 for:0.058415936868443846 and:0.05485516312193244 the:0.02723510730439…	9749.99
13	bf37e06eb3b4a1084dab71360979fd33 RICHMOND ENQUIRER ChronAm 1847.6150684614408 37.538509 -77.43428 The Leesbaig Chronicle in our own State, p…	We	of:0.5164750957854406 in:0.05407772304324029 and:0.02687465790914067 vote:0.013191023535851122 to:0.012862616310892173 for:0.012260536398467…	9522.31
14	09c263b31f30f4e06ba01bb768276e08 WATERBURY EVENING DEMOCRAT ChronAm 1897.9986301052766 41.558153 -73.051497 Avery and Newton Smith; treasure…	but	of:0.5164750957854406 in:0.05407772304324029 and:0.02687465790914067 vote:0.013191023535851122 to:0.012862616310892173 for:0.012260536398467…	9522.31
15	4ba237aad95cf892049c182baf3a8c45 RAFTSMAN'S JOURNAL ChronAm 1858.6287670915779 41.02728 -78.439188 stone all over the world, and naturalists…	!	to:0.32885830746793315 of:0.15137803373097491 the:0.04113533525298231 a:0.03948992184286302 you:0.030103586253318874 and:0.02195131072136419…	9499.72
16	1aa3574819fc5ae35a94b6cf12e65e6f THE WICHITA CITY EAGLE ChronAm 1880.3647540667375 37.692236 -97.337545 It is therefore pertinent, I thiak, …	af	of:0.639060613160788 and:0.02018636339058811 ot:0.010345511237676405 one:0.00917398121947263 to:0.007912333507560874 is:0.006506497485716346…	9408.29
17	548af3dcb1f3e4242b18b325241ca95d RICHMOND ENQUIRER ChronAm 1846.6479451737696 37.538509 -77.43428 Townships thirty-seven and thirty-eight, o…	three	of:0.639060613160788 and:0.02018636339058811 ot:0.010345511237676405 one:0.00917398121947263 to:0.007912333507560874 is:0.006506497485716346…	9408.29
18	9712e838d7642488a8df35920f447864 RICHMOND ENQUIRER ChronAm 1840.3319671814916 37.538509 -77.43428 Mr. CALIIOl N said he had no doubt that si…	protection	to:0.32261677590641336 by:0.12009458226167759 for:0.0587820459636605 of:0.03580021571393014 at:0.03190077159213474 the:0.02957769849829918 i…	8961.02
19	0b3f1e51f2cf34a3e4c83384b5d193ae THE MEMPHIS APPEAL ChronAm 1887.0671232559614 35.149022 -90.051628 The Coahoma, from O.'ceoU.bronght\n14 ba…	tt)	to:0.37034923533439856 from:0.10054782013238986 and:0.04468157954804839 home:0.04222780187171878 with:0.030929011641177815 the:0.02876055695…	8922.23
20	0a48ed904b556184f8475503e9fc9846 RICHMOND ENQUIRER ChronAm 1816.9877048864096 37.538509 -77.43428 by ir.v. nio Hie Subscriber* to Hie Capita…	(of	in:0.5353900844283629 In:0.12004062718212404 on:0.025645908715800164 as:0.021710150447533803 among:0.019742271313400624 and:0.01199771472100…	8807.98
21	4b9b38e0e8362d1b98eead250229cf61 CLARKSVILLE CHRONICLE ChronAm 1871.4205479134957 36.527761 -87.35887 "O Lord, our Heavenly Father,\nhigh, a…	O	of:0.43954685890834194 and:0.05096366043842872 to:0.04410769457113432 The:0.018861262321612476 in:0.015389142268647934 the:0.015183169045166…	8720.22
22	d0c4de6104ea55e015a0a8044ccc105f RICHMOND ENQUIRER ChronAm 1848.7827868536228 37.538509 -77.43428 In East Florida, Columbia, Alachua, St.\nJ…	at	of:0.3400632449525663 in:0.0778746915939813 was:0.05090871181846614 is:0.04798971400771449 that:0.02752197935851548 from:0.02467248149563887…	8700.12
23	001ef5d0be696bbaef13cbc4bae74927 PULLMAN HERALD ChronAm 1895.683561612126 46.730427 -117.173895 for several years how some :rra;n\nbuyers on…	willbe	of:0.3400632449525663 in:0.0778746915939813 was:0.05090871181846614 is:0.04798971400771449 that:0.02752197935851548 from:0.02467248149563887…	8700.12
24	7569c23ae5ea2567963700bc346204b9 RICHMOND ENQUIRER ChronAm 1823.9493150367834 37.538509 -77.43428 uk iiml exeetiliug a system of internal im…	Was	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
25	03348de16a89f4e17213b1438c794d4d WATERBURY EVENING DEMOCRAT ChronAm 1898.0205479134956 41.558153 -73.051497 around the Bank street bridge th…	es-	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
26	12bcc509d2c0ea96bc82b7358e709823 THE NEW NORTH-WEST ChronAm 1897.2315068176054 46.395761 -112.730038 Both admitted that on the Saturday nigh…	he	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
27	22485e992043c48f0260b910aa4c1918 RAFTSMAN'S JOURNAL ChronAm 1857.6315068176052 41.02728 -78.439188 The gnides were all at fault here, precis…	be,	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
28	0e166fd132c0e15712de989cac0a8452 RICHMOND ENQUIRER ChronAm 1846.042465721715 37.538509 -77.43428 The Oregon resolutions of Mr. Hannegan.of\n…	upon.	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
29	1b37c119b449ebc432f9a7fb6f8a1066 EVENING CAPITAL ChronAm 1903.554794488838 38.97864 -76.492786 Letters from\nWomen\nCured by the urn of Kodo…	Kodol	is:0.19173399763627658 was:0.12155162187454692 are:0.08970725856410391 were:0.049071425747011295 will:0.03517905864055148 Is:0.0252233015680…	8452.08
30	2940830ef61b974238fa74a5f9d25f47 THE JASPER WEEKLY COURIER ChronAm 1897.4999999682902 38.391448 -86.930874 which authorities dmagree. The mo…	from	by:0.1853795241786417 that:0.10697036551189554 in:0.0830600441237851 to:0.07423528710273687 on:0.05414107685886351 the:0.03577604197722259 a…	8371.81
31	0cc53884d0eac6a71f80816d7b427487 ARIZONA REPUBLICAN ChronAm 1894.278082160071 33.448587 -112.077346 On the outer line of sidewalk place a ce…	less	to:0.1740022085502445 in:0.11664751087372952 for:0.09893403646361526 by:0.06192955175444527 as:0.05532643724787596 the:0.030739413607373853 …	8289.07
32	594c01f381725e1bee2fedd2da93b686 RICHMOND ENQUIRER ChronAm 1824.2336065257539 37.538509 -77.43428 many who now might he disposed t<> defraud…	One	of:0.3744371904547501 to:0.07541647906348492 and:0.0334871679423683 in:0.03185502026114363 is:0.028084196307969385 was:0.02054254840162089 b…	8138.78
33	760fa504bf650527fc0c9acd2e18d75f THE ELKO INDEPENDENT ChronAm 1870.2999999682902 40.832421 -115.763123 Urea Cam .An Farteta inlimgR uji:\n"T…	money	in:0.10978058097183975 on:0.07954161854845873 up:0.06740694678866484 the:0.06545260726658968 a:0.046033579106333836 into:0.04347517100470818…	8097.02
34	c34b6faeda33f59294e163b2ded5554f RICHMOND ENQUIRER ChronAm 1818.2260273655504 37.538509 -77.43428 \\ p' intof Ihe engine, tvillt a descripti…	info	in:0.10978058097183975 on:0.07954161854845873 up:0.06740694678866484 the:0.06545260726658968 a:0.046033579106333836 into:0.04347517100470818…	8097.02
35	2d7993d002b8a11eaf34ea27b6c4e6dc THE NEW NORTH-WEST ChronAm 1884.4494535202894 46.395761 -112.730038 asm, expand into an Irresistible politi…	as	to:0.37407726377952755 and:0.056286909448818895 in:0.03893946850393701 the:0.03389517716535433 for:0.0327263779527559 it:0.02817421259842519…	8030.80
36	dcb43fd69f2b25c32eba1c9ed4ea8789 RICHMOND ENQUIRER ChronAm 1833.0205479134956 37.538509 -77.43428 Mr. Smith of Frederick, moved that he be d…	He	to:0.2739107080792442 of:0.17131662927738633 and:0.0396537015387532 is:0.016335429239470442 in:0.015450725141394672 was:0.015419128566463396…	7987.73
37	81b78f72b2a8df3fcf12f94e115cac30 RICHMOND ENQUIRER ChronAm 1843.8013698313039 37.538509 -77.43428 Permit me, however, to make this passing r…	excited	to:0.2739107080792442 of:0.17131662927738633 and:0.0396537015387532 is:0.016335429239470442 in:0.015450725141394672 was:0.015419128566463396…	7987.73
38	8bbe885732882f8e8f3abfb11d1466ab RICHMOND ENQUIRER ChronAm 1845.5356164066463 37.538509 -77.43428 This cause coming on this day to be funlic…	^tmll	of:0.16097129532845542 is:0.09885824555761036 that:0.07365120205837421 to:0.06890729275548765 and:0.057127924740693094 the:0.047197877301600…	7948.29
39	1459d56b60401fd57821ca893623ab08 EVENING CAPITAL ChronAm 1888.8510928645517 38.97864 -76.492786 Mr. Blaine arrived here in the afternoon\nan…	groups	to:0.3400181135981369 that:0.1414154483115539 from:0.025294345969724415 of:0.025100271703972055 and:0.024582740328632422 the:0.0233536033122…	7915.60
40	6b2a5d61b0d13efa8efdc8873c609a5f THE CHARLOTTE DEMOCRAT ChronAm 1880.9030054328578 35.227087 -80.843127 many Southern newspaper. Here and\nt…	They	that:0.44343382908113993 the:0.036645537391792944 is:0.034415550209829504 of:0.032290916752998194 and:0.01998208986672754 it:0.0188056399360…	7852.32