Metric	Score
PerplexityHashed	279.95

Metric	Score
PerplexityHashed	248.34

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	74dde4fd631e05ca47ffe12f4d9f9314 RICHMOND ENQUIRER ChronAm 1824.3784152689234 37.538509 -77.43428 sheriff of | riiice H illiain rountv, to w…	proceedings	may:0.08333333333333334 decision:0.04166666666666667 authorised:0.08333333333333334 officers:0.04166666666666667 resolved:0.0416666666666666…	9223372036854745000.00
2	382360385b2c74e65fd716ae132d0bd0 RICHMOND ENQUIRER ChronAm 1859.5657533929477 37.538509 -77.43428 was the admission ol California into the I…	lil:i<*nlly	don:0.14285714285714288 doesn:0.28571428571428575 attempting:0.14285714285714288 refusing:0.14285714285714288 is:0.14285714285714288 till:0.…	4611686018427364400.00
3	751cd9ab1972740465c8db7e45478fea RICHMOND ENQUIRER ChronAm 1843.0890410641807 37.538509 -77.43428 Infmore; and only then, with no effort to …	lo	to:0.4736842105263159 will:0.10526315789473686 thev:0.05263157894736843 safety:0.05263157894736843 officially:0.05263157894736843 would:0.05…	4611686018427364400.00
4	7f1698c0c1392bbd398375a643d33250 CLARKSVILLE CHRONICLE ChronAm 1871.89999996829 36.527761 -87.35887 every pastor should he sure that there\n…	be-	:0.0024813895781637713 to:0.0024813895781637713 irish:0.0024813895781637713 better:0.0024813895781637713 tled:0.0024813895781637713 t:0.0049…	412672.00
5	13fca0b366be377d63181299a332553c EVENING CAPITAL ChronAm 1892.047814176027 38.97864 -76.492786 people, with the accent on “the,” go\nelsewhe…	Is	:0.004359673024523165 done:0.0005449591280653957 wero:0.0005449591280653957 pas:0.0005449591280653957 t:0.002724795640326978 arc:0.000544959…	234880.00
6	b21141fd61daa85f8575fa2bea1438a9 RICHMOND ENQUIRER ChronAm 1820.028688492967 37.538509 -77.43428 same in August last,To Ur. James W. vvnifre…	ol	:0.005555555555555557 of:0.2666666666666667 pieces:0.08333333333333334 are:0.005555555555555557 for:0.011111111111111113 which:0.02222222222…	184320.00
7	208071e7f99faa05148eebdfc3e89f17 THE NEVADA JOURNAL ChronAm 1853.3246575025369 39.261561 -121.016059 bion River is Salmon Creek and Bay, whi…	the"	:0.006711409395973154 tbe:0.013422818791946308 their:0.006711409395973154 that:0.013422818791946308 eastern:0.04194630872483221 it:0.0067114…	152576.00
8	0b40414fe3c438ebe8b156fac932cdb0 THE CHARLOTTE DEMOCRAT ChronAm 1880.424863356355 35.227087 -80.843127 "From one of these boots, compiled af…	I	:0.006877579092159555 to:0.01650618982118293 never:0.0055020632737276445 t:0.0013755158184319111 daily:0.0013755158184319111 wi:0.0013755158…	148889.60
9	1516c2a5f652e839e967bb07f47f4d3c LOS ANGELES HERALD ChronAm 1909.4506848997971 34.054935 -118.244476 Those who have investigated the two cas…	Continued	:0.009036144578313266 to:0.002409638554216871 t:0.0006024096385542178 regard:0.0006024096385542178 issued:0.0006024096385542178 arc:0.000602…	113322.67
10	1d64871a5d220be218a8a4a5acf650cf RICHMOND ENQUIRER ChronAm 1860.1407103508905 37.538509 -77.43428 uorals and resources of Virginia at the fu…	would	:0.009208103130755069 to:0.0018416206261510136 age:0.0018416206261510136 daily:0.0018416206261510136 t:0.12523020257826892 his:0.02946593001…	111206.40
11	12b3433997a5ce538606386123863112 RAFTSMAN'S JOURNAL ChronAm 1856.0423496951528 41.02728 -78.439188 inquiry Lord P. replies in the affirmativ…	that	:0.010480248761948637 to:0.00864716495834773 able:0.0003455027064378671 everything:0.004323582479173865 his:0.010950516334600178 is:0.000691…	97707.60
12	12793461a6aee1b27e6a95ef6e2e4d01 RICHMOND ENQUIRER ChronAm 1821.0041095573313 37.538509 -77.43428 premises, to the highest bidder, at public…	la	:0.01092896174863388 to:0.07103825136612021 better:0.00273224043715847 int:0.00273224043715847 every:0.00273224043715847 for:0.0466432474629…	93696.00
13	26e8a7c218feadee59e2146efa24cc6c THE NEVADA JOURNAL ChronAm 1859.919178050482 39.261561 -121.016059 The “College ctf California,” by the\nwi…	To	:0.010992671552298479 to:0.21312214621146897 indeed:0.0009993337774816798 perhaps:0.0003331112591605599 never:0.00016655562958027995 t:0.001…	93152.97
14	7569c23ae5ea2567963700bc346204b9 RICHMOND ENQUIRER ChronAm 1823.9493150367834 37.538509 -77.43428 uk iiml exeetiliug a system of internal im…	Was	:0.012945914844649027 wero:0.0005753739930955123 never:0.001438434982738781 t:0.0008630609896432684 came:0.0011507479861910246 arc:0.0051783…	79098.31
15	331d66506ed82f60d39f2e7992f0a212 THE HOPE PIONEER ChronAm 1885.8863013381533 47.32221 -97.72232 From the Spectator.\nThere are men, and wome…	perfectly	:0.013008130081300816 to:0.047154471544715464 apart:0.004878048780487807 better:0.009756097560975613 what:0.001626016260162602 is:0.00162601…	78720.00
16	25d918be92467bf6eb05332d18c49fac THE JASPER WEEKLY COURIER ChronAm 1913.3520547628107 38.391448 -86.930874 South Bend. After lying hid-\nden…	The	:0.01312036508841986 to:0.0017113519680547644 100:0.0022818026240730193 bonds:0.0017113519680547644 his:0.0005704506560182548 like:0.0005704…	78046.61
17	6f687e31f97a5f6ef7614452466276be RICHMOND ENQUIRER ChronAm 1819.9383561326738 37.538509 -77.43428 on In tli sides ; and such wn« in- in*e.i …	;	:0.013254786450662743 age:0.001472754050073638 region:0.001472754050073638 held:0.001472754050073638 grace:0.001472754050073638 saying:0.002…	77255.11
18	14b8cb9a6a47bd51d7434da5e1f0ac2d ARIZONA REPUBLICAN ChronAm 1907.9712328450025 33.448587 -112.077346 Washington, Dec. 20. Telegrams on\nwhic…	forthwith	:0.013450316888628303 to:0.0047463494988413315 considerable:0.0012424267805790543 perhaps:0.0005165145042856743 never:0.0005304743557528547 …	76132.04
19	14cdd3a3d3e56e0fd3955fae45a21cde THE STAR OF THE NORTH ChronAm 1858.0726027080163 41.004121 -76.453816 slightest fears of their ever being r…	these,	:0.014086126254772525 considerable:0.00013311631340420771 several:0.0003569937495840116 many:0.000847103812572231 t:0.0006716323085394117 hi…	72695.64
20	0611842f0e85d28b5ab96234e03fe851 THE WICHITA CITY EAGLE ChronAm 1878.582191749112 37.692236 -97.337545 he wont at onco to the house of the\n…	But	:0.014332411365350763 to:0.0022630123208448576 perhaps:0.0005028916268544128 mat:0.0005028916268544128 never:0.0005028916268544128 ful:0.001…	71446.46
21	0e98db544a9bf04827b9885c519c8723 RAFTSMAN'S JOURNAL ChronAm 1867.0616438039067 41.02728 -78.439188 not as white as flour. Didn't hear them s…	his	:0.014354066985645945 buyers:0.009569377990430632 an:0.02870813397129189 few:0.004784688995215316 drawn:0.004784688995215316 second:0.004784…	71338.67
22	2d0669daf6a72e0791c4e1d629eaf90f RICHMOND ENQUIRER ChronAm 1819.346575310756 37.538509 -77.43428 Having at the close of the former No.\ngive…	Cato,	:0.014492753623188403 to:0.0036231884057971006 considerable:0.0018115942028985503 ns:0.0018115942028985503 t:0.0036231884057971006 what:0.00…	70656.00
23	a2b6ad19ff2e76e72bfff8694b2868bc RICHMOND ENQUIRER ChronAm 1834.8616438039066 37.538509 -77.43428 culated to involve these United Sla eg in …	ol	:0.014529198100027944 to:0.11455713886560494 what:0.0005588153115395363 came:0.0008382229673093044 wish:0.0008382229673093044 arc:0.00083822…	70478.77
24	7c0422947dfad60791d292264650f99d THE CHARLOTTE DEMOCRAT ChronAm 1871.850684899797 35.227087 -80.843127 Other amendments ought to be made,\nb…	soever	:0.014722975590856262 to:0.0007748934521503297 alone:0.0011623401782254947 never:0.02463054187192119 many:0.0011623401782254947 laws:0.00116…	69551.16
25	062c417e92c78f230f7411a3f818ef89 THE BEAVER HERALD ChronAm 1896.6926229191965 36.816137 -100.519871 Wlren Mayn had finished her speech\nthe …	us,	:0.015721120984278882 to:0.0009873167767904614 ac:0.00045568466621098214 second:0.0006075795549479763 his:0.041543252069567875 earth:0.00106…	65135.30
26	6ab99e883b9c8e4a9ac804040426ef10 RICHMOND ENQUIRER ChronAm 1818.9465753107559 37.538509 -77.43428 Lt. Col. Edward Niclioll—Sir: Espe-\nciall…	so,	:0.015957446808510623 judge:0.002659574468085104 ttie:0.002659574468085104 many:0.002659574468085104 mine:0.002659574468085104 his:0.0026595…	64170.67
27	023d612d349ea8158b1016f2a4c749f5 WATERBURY EVENING DEMOCRAT ChronAm 1889.4315068176052 41.558153 -73.051497 Days might oome and go, suns wou…	returning	:0.01627780792186654 several:0.0002712967986977756 t:0.0005425935973955512 many:0.0002712967986977756 agricultural:0.0005425935973955512 his…	62907.73
28	10d99f52a4b6de0e6bf1d6401166484f THE STAR OF THE NORTH ChronAm 1850.332876680619 41.004121 -76.453816 Dr. 8. A. Pearson, Dear Sir?About a ye…	At	:0.016631927513944798 to:0.021675802438706405 t:0.0009859132289194079 between:0.0009716246313988369 is:0.009787689301591225 beyond:0.0005715…	61568.33
29	eef78f93554700da11681eac1defad42 RICHMOND ENQUIRER ChronAm 1846.732876680619 37.538509 -77.43428 fry No, Sir-ee.' The \\\\~iiiei of Wheeling…	They	:0.017683773665911014 to:0.2529654553319652 indeed:0.0008521516829995742 t:0.0004260758414997871 depends:0.0008521516829995742 what:0.001704…	57906.19
30	aef88ddde6ce23782fa998d4ee6a1f58 RICHMOND ENQUIRER ChronAm 1836.6707649956993 37.538509 -77.43428 If we have taken the people s money oy Mii…	mates	:0.017857142857142853 to:0.035714285714285705 e:0.017857142857142853 of:0.2678571428571428 you:0.017857142857142853 should:0.017857142857142…	57344.00
31	04ce38b5c98ba8fd87d85459089bba02 COURIER DEMOCRAT ChronAm 1913.2342465436327 48.76059 -98.367824 record m the office of the Register of Deed…	Per	:0.017930249944918646 ttie:0.0007540845478120027 l:0.0007540845478120027 t:0.0016058866531644361 par:0.0028347310324228704 u:0.0003770422739…	57110.19
32	18d0629f0a95483eb4dadbaf50f124f8 EVENING CAPITAL ChronAm 1884.7964480558085 38.97864 -76.492786 use he bones, so that all in ail the crea-\n…	out,	:0.017937219730941718 to:0.10014947683109127 is:0.0014947683109118098 like:0.0014947683109118098 beyond:0.0029895366218236196 for:0.00597907…	57088.00
33	09ddb58239108818ae2395cbb53b2eb3 RICHMOND ENQUIRER ChronAm 1829.1356164066465 37.538509 -77.43428 e have heard muih, Mr. Chairman, about\nco…	•	:0.017977528089887656 hold:0.0011235955056179785 never:0.0033707865168539353 got:0.002247191011235957 re:0.002247191011235957 lay:0.00112359…	56960.00
34	7788912e2fc259d7b896fa87f9ea75c0 RICHMOND ENQUIRER ChronAm 1815.9958903792492 37.538509 -77.43428 Commissaries, who usurped the title and\np…	Sire—	arrange:0.0078125 go:0.0078125 can:0.0234375 must:0.0078125 did:0.0078125 bear:0.015625 write:0.0078125 waited:0.0078125 are:0.0234375 would…	56802.04
35	03cffef766778af380add3b0458bb974 RICHMOND ENQUIRER ChronAm 1849.491780790208 37.538509 -77.43428 Mr. DORMAN witliirew his oiouon.\nMr. HARPE…	The	:0.01815670021709097 to:0.015591079534241162 3:0.0007894217485691727 picturesque:0.027540951253207015 t:0.02833037300177619 is:0.00631537398…	56397.91
36	294cc0b7123a649351c3f9293a2db386 THE JASPER WEEKLY COURIER ChronAm 1880.769125651437 38.391448 -86.930874 llion. This wa for the ordinary ex…	Ity	to:0.027777777777777776 mules:0.013888888888888888 soul:0.041666666666666664 of:0.04878048780487805 body:0.027777777777777776 post:0.0138888…	55156.01
37	607b99895f3593172d93044ff219c248 RICHMOND ENQUIRER ChronAm 1817.1904109271943 37.538509 -77.43428 The power to regulate commerce a-\nmongthe…	“common	:0.018606653975160908 to:0.0016755106644488153 able:0.0027543940649290685 his:0.01928075845450348 for:0.01949368903281028 be:0.0001971189016…	55034.08
38	1232dbbf1ea311e0e4d440e430614990 THE DAYTONA DAILY NEWS ChronAm 1915.1191780504819 29.210815 -81.022833 been accustomed. Perhaps It was this…	His	:0.019061099315876393 to:0.02995989620193443 several:0.0011323425336164194 many:0.0008492569002123147 what:0.0008020759613116304 came:0.0008…	53721.98
39	702bc90a25d65e03daad5302d043c457 ROCKY MOUNTAIN HUSBANDMAN ChronAm 1878.4287670915778 46.548394 -110.902887 Beginning at a slate stone 24x12…	W	:0.019323671497584547 to:0.0024154589371980684 15:0.03721595992127394 17:0.01860797996063697 2:0.0558239398819109 1:0.03721595992127394 8:0.…	52992.00
40	79289d06a56cfc085cf7d55d34da9e17 THE NEW NORTH-WEST ChronAm 1872.5696720995245 46.395761 -112.730038 journeying or in camp, all the way up i…	Their	:0.020239930299577786 to:0.02345687286374909 many:0.0013403927350713765 what:0.0018095301923463582 came:0.0008712552777963948 is:0.004825413…	50593.06