Metric	Score
PerplexityHashed	142.89

Metric	Score
PerplexityHashed	126.73

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9833984375 Mrs:0.007221221923828125 Miss:0.005039215087890625 Mr:0.00067138671875 M:0.0004911422729492188 Ms:0.0003197193145751953 Rev…	349515.96
2	25a2c22ec0d42967dbd94992792887b5 THE DICKINSON PRESS ChronAm 1914.8315068176053 46.879176 -102.789624 Mr. Norton made his remarks very\ninte…	ture.	t:0.935546875 tur:0.030548095703125 tion:0.0167388916015625 tor:0.00861358642578125 tions:0.003269195556640625 ure:0.0005593299865722656 t:0…	300458.68
3	5c203724a1d3de91e777939d2a4cf1d0 DEMOCRAT AND SENTINEL ChronAm 1864.9139343946063 40.485194 -78.724957 heart does not throb with emotion at …	wife!	wife:0.98779296875 wife:0.00189208984375 husband:0.0010862350463867188 w:0.0010700225830078125 Wife:0.0010204315185546875 spouse:0.000922203…	262840.73
4	2f20c5e34082c919371200e6a1159565 ARIZONA REPUBLICAN ChronAm 1912.56420761865 33.448587 -112.077346 Accompanying this showing will be\na requ…	sides,	sides:0.98681640625 the:0.003940582275390625 side:0.002208709716796875 parties:0.0014600753784179688 the:0.0004506111145019531 teams:0.00030…	233089.18
5	20259630a6e0730d928e8c1b21c1f692 COURIER DEMOCRAT ChronAm 1894.8342465436326 48.76059 -98.367824 Omaha, Oct. 28. —The fact was made\npublic …	ever,	ever:0.94873046875 ev:0.042022705078125 ver:0.0016040802001953125 much:0.0009503364562988281 ever:0.00048160552978515625 so:0.00039625167846…	210291.50
6	3174a7e1b8e3b6911429a955d261aaeb RAFTSMAN'S JOURNAL ChronAm 1863.4589040778792 41.02728 -78.439188 that a nation may conduct a great war and…	uals	u:0.93798828125 ual:0.025787353515625 u:0.007106781005859375 ul:0.006420135498046875 U:0.00562286376953125 U:0.0036869049072265625 ur:0.0023…	196235.61
7	1b515315af748c90c2045b91dd516e0d ELK CITY MINING NEWS ChronAm 1911.6452054477422 45.78769 -115.200118 Oats—Condition 65.7 per cent of a\nnor…	average.	average:0.982421875 average:0.004657745361328125 averages:0.0020999908447265625 avg:0.0014715194702148438 averaging:0.0005183219909667969 me…	190090.62
8	1879f42e9e0de79a444c78db0bd0aa4a ARIZONA REPUBLICAN ChronAm 1913.1575342148656 33.448587 -112.077346 point 22o feet west of the west line 01…	lino	line:0.9560546875 line:0.03350830078125 -:0.0007457733154296875 lines:0.0006504058837890625 of:0.0005025863647460938 end:0.0004119873046875 …	161337.90
9	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.93115234375 a:0.0193328857421875 ::0.0100250244140625 o:0.009796142578125 1:0.003204345703125 pm:0.0031795501708984375 .:0.0019893646240…	159632.94
10	21b8d2085543aac91ea1eedcd89bfe67 ARIZONA REPUBLICAN ChronAm 1919.2260273655504 33.448587 -112.077346 used for training aviators in the han-\…	ligence	lig:0.54443359375 lect:0.404541015625 l:0.028839111328125 lent:0.00609588623046875 lect:0.0038127899169921875 leg:0.0010585784912109375 lig:…	130352.80
11	0c8c1948dd06dabb9d447e60570cb071 LA JUNTA TRIBUNE ChronAm 1898.7876712011669 37.985009 -103.543832 "It will be borne In mind that the\ntroop…	follows:	follows:0.96484375 follow:0.01293182373046875 fol:0.004909515380859375 follow:0.0019073486328125 following:0.0017499923706054688 -:0.0016765…	117018.29
12	0349558a29ec5f70c68da27ec5735439 THE CHARLOTTE DEMOCRAT ChronAm 1872.443989039415 35.227087 -80.843127 Sec. 8. That there shall be appointed…	law.	law:0.92919921875 the:0.0251617431640625 law:0.0118865966796875 this:0.00661468505859375 statute:0.0029125213623046875 said:0.00228500366210…	116890.89
13	3864e02c4c3867d4cf58f4b7326eb561 THE JASPER WEEKLY COURIER ChronAm 1917.2808218860985 38.391448 -86.930874 know what women will accept, for …	another,	another:0.779296875 the:0.10064697265625 other:0.0777587890625 another:0.025238037109375 the:0.0028438568115234375 other:0.00100612640380859…	110900.16
14	16b9eb2107c6352464ca43134f296b01 THE JASPER WEEKLY COURIER ChronAm 1917.2999999682902 38.391448 -86.930874 know what women will accept, for …	another,	another:0.7607421875 the:0.1104736328125 other:0.0802001953125 another:0.0283660888671875 the:0.0038394927978515625 other:0.0013217926025390…	100337.59
15	8166145a1546f64b2a5f831d625b983a THE CHARLOTTE DEMOCRAT ChronAm 1872.1188524273932 35.227087 -80.843127 tion as will induce him to use it on…	Phosphate	Ph:0.8642578125 Ph:0.10650634765625 P:0.00237274169921875 PH:0.002101898193359375 phosph:0.0019969940185546875 ph:0.0016689300537109375 ph:0…	100250.93
16	195bd71e8bbb80411504a1701c174636 THE DICKINSON PRESS ChronAm 1884.6243169082675 46.879176 -102.789624 servation ot Devil's lake. He found\nt…	1884.	18:0.74169921875 18:0.220947265625 1886:0.011444091796875 1888:0.0049591064453125 1889:0.0023326873779296875 184:0.00140380859375 ':0.000938…	95151.67
17	01b7b83daa06473b8e8c4f4855a089c5 IDAHO SPRINGS SIFTINGS ChronAm 1902.7767122970574 39.745496 -105.511267 May 10. 1872. The Monarch M.. M . T…	29°	29:0.8515625 29:0.079833984375 30:0.0208282470703125 28:0.0163421630859375 27:0.0037059783935546875 59:0.0021190643310546875 30:0.0017032623…	94964.34
18	23d4e4e9727e67d2cd7eb4af3bb01d3a THE TIMES-HERALD ChronAm 1918.9712328450025 43.586261 -119.054103 RegliiliiK at the intersection of\nthe Ea…	31,	32:0.367431640625 31:0.2061767578125 33:0.06689453125 30:0.0509033203125 34:0.0260009765625 28:0.02294921875 29:0.0182952880859375 35:0.0147…	94274.46
19	722be35b48622205b21132839ce2809c MOUNTAIN HOME REPUBLICAN ChronAm 1924.1434425913276 43.13295 -115.691197 CHRIS S. HOLST , HATTIE HOLST,\nan…	Counties,	Count:0.77685546875 County:0.078125 Count:0.048126220703125 counties:0.045562744140625 county:0.0263671875 ,:0.007556915283203125 Co:0.00259…	91601.92
20	c7570094e5a80c9758757c2f35366f3e RICHMOND ENQUIRER ChronAm 1845.1191780504819 37.538509 -77.43428 Mr. DANIEL of Princc George withdrew the\n…	section,	section:0.95654296875 Section:0.0055999755859375 section:0.0037021636962890625 part:0.003116607666015625 and:0.0019664764404296875 clause:0.…	91214.59
21	04699986bfed41fe944706b8107f4b0e IDAHO SPRINGS SIFTINGS ChronAm 1902.6808218860983 39.745496 -105.511267 21’ W. and 1396 ft. S. 45“ 21' E. f…	S.	S:0.8740234375 N:0.073486328125 W:0.0238494873046875 E:0.006519317626953125 S:0.0044097900390625 SW:0.0013723373413085938 Y:0.00064325332641…	91111.65
22	346cc79f203bf50276c0a4e7a7105ee6 RAFTSMAN'S JOURNAL ChronAm 1857.2671232559615 41.02728 -78.439188 There can bo little doubt but that the po…	power,	power:0.958984375 hands:0.0076751708984375 way:0.00362396240234375 Power:0.0034046173095703125 Power:0.0031986236572265625 powers:0.00295829…	87764.71
23	4911b35775a00fd595f91b9defd5a4e4 THE NEW NORTH-WEST ChronAm 1877.4342465436328 46.395761 -112.730038 N ti4ce is hereby given that William T.…	chains:	chains:0.966796875 chains:0.0151519775390625 Chains:0.002323150634765625 chain:0.0021152496337890625 -:0.0006227493286132812 ch:0.0005264282…	87284.14
24	1a4d8480064e27a48ebc052fe9d47b11 THE EMPIRE COUNTY ARGUS ChronAm 1854.6890410641806 38.799901 -120.890216 On the amount of postage on letter…	pf	of:0.9619140625 -:0.005207061767578125 o:0.00438690185546875 of:0.004199981689453125 and:0.00196075439453125 the:0.0016202926635742188 ot:0.…	87160.62
25	039eead30217414e210935aa97c52752 ARIZONA REPUBLICAN ChronAm 1896.4822404055353 33.448587 -112.077346 Section 1. The fiscal year for the City…	oi	of:0.947265625 of:0.01085662841796875 o:0.0099639892578125 in:0.004352569580078125 ot:0.0034027099609375 ol:0.0030155181884765625 ,:0.001117…	86948.68
26	40b75a7e7971fbe6e63b03a54bbb731a RICHMOND ENQUIRER ChronAm 1832.113387946519 37.538509 -77.43428 Calhoun—the partiality which he feels for h…	B.	B:0.9404296875 B:0.03192138671875 H:0.003993988037109375 Hay:0.0026302337646484375 A:0.0015897750854492188 V:0.0014638900756835938 C:0.00081…	85475.86
27	3123a2757dc1d6e1cfe6797de1af378e MOUNTAIN HOME REPUBLICAN ChronAm 1923.0726027080163 43.13295 -115.691197 89. I. D . Stokes, Hill City.\n90.…	121.	121:0.97705078125 121:0.00283050537109375 1:0.0018281936645507812 122:0.0010013580322265625 111:0.0007801055908203125 131:0.0005297660827636…	85311.87
28	0b76db448180c7a9f2807c06e014abf7 ARIZONA REPUBLICAN ChronAm 1894.6397259956875 33.448587 -112.077346 Mr. President, I have no private grief,…	trary	-:0.98388671875 ^:0.0006070137023925781 em:0.00047087669372558594 ':0.0004475116729736328 pl:0.00041556358337402344 .:0.0003681182861328125 …	84204.72
29	1470da06ebdadd7a24090926988ef4cc WATERBURY EVENING DEMOCRAT ChronAm 1893.2972602422628 41.558153 -73.051497 James Frayer of 16 Baldwin Hill\…	wioh,	walk:0.93017578125 wood:0.0268096923828125 well:0.00756072998046875 fleet:0.004047393798828125 cross:0.0026531219482421875 bury:0.0020027160…	78128.19
30	4197d22c241f4173bdeb0bcb10c30b92 THE NEW NORTH-WEST ChronAm 1877.3575342148656 46.395761 -112.730038 N Mticein hereby given that William T. …	chains;	chains:0.95947265625 chain:0.01198577880859375 chains:0.007801055908203125 Chains:0.0031642913818359375 chain:0.00217437744140625 -:0.001205…	77767.27
31	6539e58de66ce4d7b381c39386366011 RICHMOND ENQUIRER ChronAm 1842.0726027080163 37.538509 -77.43428 Your Committee beg leave to remark here, t…	liand.^none	hand:0.9033203125 hand:0.037872314453125 side:0.035308837890625 hands:0.0025177001953125 part:0.0023555755615234375 side:0.00165081024169921…	77360.54
32	b5d588d22fa8a8297ea75cccc114bcd7 RICHMOND ENQUIRER ChronAm 1847.2041095573313 37.538509 -77.43428 And, fourthly, let Senators look to the pr…	some	,:0.91552734375 .:0.0298919677734375 ;:0.0061187744140625 ,:0.00415802001953125 of:0.0037555694580078125 ,,:0.00365447998046875 to:0.0022964…	77265.73
33	3ff22426092d3a6869b2bd48364ba5f2 RAFTSMAN'S JOURNAL ChronAm 1858.9356164066464 41.02728 -78.439188 aware that the earliest and the best frui…	tages.	t:0.634765625 t:0.33447265625 te:0.006175994873046875 T:0.0016946792602539062 T:0.0013780593872070312 :0.0011644363403320312 s:0.00081300735…	75467.46
34	40553856789ca1345ed985301240eca1 DEMOCRAT AND SENTINEL ChronAm 1859.664383529934 40.485194 -78.724957 now likely to present the name of Hon.…	year.	ann:0.7392578125 year:0.12451171875 month:0.0947265625 week:0.008880615234375 day:0.003971099853515625 cent:0.003818511962890625 quarter:0.0…	75099.91
35	2d3c2ade86d27881ee102cdce29baff6 CENTRE DEMOCRAT ChronAm 1861.1794520230847 40.913486 -77.773747 iron uot otherwise provided for, thirty per…	valorem	val:0.978515625 val:0.0033416748046875 v:0.0012292861938476562 -:0.0010385513305664062 vo:0.00035762786865234375 .:0.00033593177795410156 ,:…	75013.36
36	101ad72ae40de0e9bbc242c33f3f9dae MOUNTAIN HOME REPUBLICAN ChronAm 1923.5876712011668 43.13295 -115.691197 Estate of H. C. Bates, 43.79 acree…	District.	Dis:0.56396484375 District:0.342041015625 Dist:0.022918701171875 Dis:0.01412200927734375 district:0.01152801513671875 District:0.01152801513…	74912.25
37	0d050dd13bef6f72f7e1f135251bc848 ARIZONA REPUBLICAN ChronAm 1898.7082191463724 33.448587 -112.077346 and public ways or places are correctly…	plat,	plat:0.9580078125 pl:0.01244354248046875 pl:0.00910186767578125 Plat:0.0018138885498046875 plan:0.00103759765625 map:0.000911712646484375 bo…	72642.00
38	809b4e7a717018840c284dd1c7c27821 RICHMOND ENQUIRER ChronAm 1849.3575342148656 37.538509 -77.43428 the Empire City, reads a rough lecturc to …	York,	Y:0.61181640625 Y:0.223388671875 York:0.07659912109375 y:0.0102081298828125 y:0.007381439208984375 H:0.0038280487060546875 E:0.0035552978515…	71451.26
39	f494078f8e7bea4751d4d826337c2210 RICHMOND ENQUIRER ChronAm 1847.9027396943177 37.538509 -77.43428 COL. GARLAND..Gen. Worth, in his de¬\nspat…	Fe.	Fe:0.54052734375 Anna:0.30078125 Ana:0.052276611328125 Clara:0.0219573974609375 F:0.0104522705078125 Rosa:0.009979248046875 Maria:0.00908660…	69925.19
40	0c6efe832f549afeeed54dc5dad18a79 WATERBURY EVENING DEMOCRAT ChronAm 1890.1191780504819 41.558153 -73.051497 The second trait considered was …	blood.	blood:0.95947265625 blood:0.0097808837890625 human:0.00293731689453125 their:0.0025920867919921875 the:0.0023784637451171875 tears:0.0017261…	68073.47