Metric	Score
PerplexityHashed	185.64

Metric	Score
PerplexityHashed	165.54

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1b515315af748c90c2045b91dd516e0d ELK CITY MINING NEWS ChronAm 1911.6452054477422 45.78769 -115.200118 Oats—Condition 65.7 per cent of a\nnor…	average.	average:0.9979351758956909 mean:0.00023489404702559114 averages:0.00023291674733627588 avg:0.00020167110778857023 Average:0.0001264454185729…	1146380.42
2	2d3c2ade86d27881ee102cdce29baff6 CENTRE DEMOCRAT ChronAm 1861.1794520230847 40.913486 -77.773747 iron uot otherwise provided for, thirty per…	valorem	val:0.9927935600280762 -:0.0007677454850636423 val:0.0004934279131703079 valuation:0.00044535688357427716 value:0.00028212874894961715 ve:0.…	244905.38
3	16b9eb2107c6352464ca43134f296b01 THE JASPER WEEKLY COURIER ChronAm 1917.2999999682902 38.391448 -86.930874 know what women will accept, for …	another,	another:0.9281730651855469 the:0.045974697917699814 other:0.01586832106113434 another:0.0024488698691129684 a:0.0005180636653676629 Another:…	228173.53
4	6539e58de66ce4d7b381c39386366011 RICHMOND ENQUIRER ChronAm 1842.0726027080163 37.538509 -77.43428 Your Committee beg leave to remark here, t…	liand.^none	hand:0.9761378169059753 side:0.00943552516400814 hand:0.0054571558721363544 ,:0.0009474580874666572 hands:0.000442823045887053 Hand:0.000432…	183021.58
5	25a2c22ec0d42967dbd94992792887b5 THE DICKINSON PRESS ChronAm 1914.8315068176053 46.879176 -102.789624 Mr. Norton made his remarks very\ninte…	ture.	t:0.8695968985557556 tur:0.09769101440906525 ti:0.00627936189994216 tr:0.004377209581434727 tion:0.003148609073832631 tor:0.0016870753606781…	173018.47
6	3123a2757dc1d6e1cfe6797de1af378e MOUNTAIN HOME REPUBLICAN ChronAm 1923.0726027080163 43.13295 -115.691197 89. I. D . Stokes, Hill City.\n90.…	121.	121:0.9775100350379944 122:0.008027713745832443 121:0.0019301968859508634 111:0.0013606769498437643 120:0.0005809137364849448 131:0.00056561…	169103.51
7	3864e02c4c3867d4cf58f4b7326eb561 THE JASPER WEEKLY COURIER ChronAm 1917.2808218860985 38.391448 -86.930874 know what women will accept, for …	another,	another:0.9140819907188416 the:0.05402815714478493 other:0.017834002152085304 another:0.00238417717628181 a:0.0007586758583784103 Another:0.…	140024.37
8	1879f42e9e0de79a444c78db0bd0aa4a ARIZONA REPUBLICAN ChronAm 1913.1575342148656 33.448587 -112.077346 point 22o feet west of the west line 01…	lino	line:0.9588160514831543 line:0.028271807357668877 lines:0.0015753940679132938 end:0.000615673023276031 -:0.0005901387194171548 side:0.000406…	136456.48
9	0651c4f5c7788f83510b2a8976e58e3e BRADFORD OPINION ChronAm 1877.3986301052764 43.994599 -72.127742 1 have got to say something about\nthe Car…	ments.	ments:0.9486515522003174 -:0.025042878463864326 ment:0.0059044077061116695 m:0.00508214021101594 men:0.0025737551040947437 ements:0.00091177…	131518.52
10	04579b26a80c21cde99ca5034239d7f5 KENTUCKY IRISH AMERICAN ChronAm 1904.6352458700162 38.254238 -85.759407 The most remarkable event affecting…	Bishop	bishop:0.9059303402900696 b:0.03732893615961075 de:0.014537002891302109 pri:0.013295046053826809 di:0.008531108498573303 du:0.00249927537515…	117096.88
11	13724bd14b2f13b06643a9178a2f7ecb ARIZONA REPUBLICAN ChronAm 1908.561475378213 33.448587 -112.077346 a picture of the new Hospital as it\nwil…	gested	gest:0.4030538499355316 gest:0.3802073299884796 g:0.14333631098270416 g:0.04728497192263603 per:0.003663611365482211 G:0.0020436313934624195…	104172.81
12	32758707f2497884e96b0f7a1102ee33 THE REVIEW ChronAm 1918.2753424340435 35.955692 -80.005318 Feed the bread crumbs, rolled oats,\nor johnnyca…	oats,	oats:0.9754440188407898 wheat:0.004179195035248995 barley:0.001969035482034087 o:0.0018056207336485386 rice:0.0011082174023613334 sugar:0.00…	102613.55
13	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.9558426737785339 a:0.015524552203714848 o:0.004022845067083836 ::0.0038530027959495783 pm:0.0022975229658186436 .:0.0012208198895677924 …	100849.23
14	1754f2df153a020788ac8a038506b071 THE HOPE PIONEER ChronAm 1896.7308742853168 47.32221 -97.72232 Section1. PROPOSED CONSTITUTIONAL\nAMENDMENT…	tain	­:0.750757098197937 -:0.2129434496164322 te:0.007416249718517065 t:0.0038516405038535595 t:0.0030643362551927567 at:0.0019224173156544566 f:…	93963.78
15	330f9167c4ce9943c3d497c76488a1a1 CENTRE DEMOCRAT ChronAm 1880.0013660885954 40.913486 -77.773747 forming matters than almost any other\ndesc…	tion,	tion:0.5853343605995178 tion:0.30495747923851013 t:0.049697745591402054 t:0.02578754723072052 tions:0.014051447622478008 T:0.001525106374174…	84180.38
16	311654bd7060b311529a39834f1d5e67 RICHMOND ENQUIRER ChronAm 1830.0753424340437 37.538509 -77.43428 memory of his friend, is conscious of that…	guage	gu:0.8521764874458313 gu:0.1210378035902977 g:0.003447450464591384 t:0.001597944414243102 GU:0.001211735187098384 ga:0.0010482532670721412 g…	78450.58
17	0b10beeb0214b3ac3f65555659106adf ARIZONA REPUBLICAN ChronAm 1910.6205479134958 33.448587 -112.077346 pounds',, against ,488,000,000 In 1909,…	States'	states:0.7581765651702881 States:0.11334475129842758 states:0.08902506530284882 STATES:0.013231788761913776 state:0.0027893218211829662 s:0.…	74816.74
18	19a57074dba6ea653627d6b44b8e9706 THE SILVER BLADE ChronAm 1895.8178081874682 47.811906 -116.897144 You are hereby notified that there is now…	Amanson	am:0.9709750413894653 am:0.003461401676759124 a:0.0024074814282357693 Am:0.0012716432102024555 ,:0.001195320626720786 .:0.001035255263559520…	70933.15
19	0529558dd823abab2a09fa431971d2ef GREAT FALLS DAILY TRIBUNE ChronAm 1920.56420761865 47.504885 -111.291891 H- E. Dodge himself remains at the…	sonal	son:0.933606743812561 spect:0.012826715596020222 s:0.00539775425568223 fect:0.004911393858492374 son:0.004815388470888138 pet:0.003512774128…	61315.29
20	40553856789ca1345ed985301240eca1 DEMOCRAT AND SENTINEL ChronAm 1859.664383529934 40.485194 -78.724957 now likely to present the name of Hon.…	year.	ann:0.7280626893043518 month:0.12086758762598038 year:0.09791750460863113 week:0.014412314631044865 di:0.004771342035382986 quarter:0.002847…	57823.26
21	2f20c5e34082c919371200e6a1159565 ARIZONA REPUBLICAN ChronAm 1912.56420761865 33.448587 -112.077346 Accompanying this showing will be\na requ…	sides,	sides:0.9550581574440002 the:0.010493052192032337 side:0.006521433126181364 the:0.0013404407072812319 parties:0.0012996693840250373 j:0.0010…	54335.72
22	0c6efe832f549afeeed54dc5dad18a79 WATERBURY EVENING DEMOCRAT ChronAm 1890.1191780504819 41.558153 -73.051497 The second trait considered was …	blood.	blood:0.9306939840316772 blood:0.03798634558916092 tears:0.0022464124485850334 human:0.0015209614066407084 water:0.0011881282553076744 the:0…	50629.84
23	346cc79f203bf50276c0a4e7a7105ee6 RAFTSMAN'S JOURNAL ChronAm 1857.2671232559615 41.02728 -78.439188 There can bo little doubt but that the po…	power,	power:0.930712103843689 power:0.03201792389154434 powers:0.0037642307579517365 powers:0.003641639370471239 poss:0.0024310422595590353 Power:…	50234.86
24	113bac36e5d0824d57c92d8250d5e2e7 RICHMOND ENQUIRER ChronAm 1841.0999999682901 37.538509 -77.43428 Secondly. That the minimum price, as now f…	Slates	states:0.9581176042556763 states:0.00667990930378437 state:0.005075820256024599 States:0.0024575325660407543 d:0.001471641706302762 s:0.0005…	49714.30
25	431bc42c9bae960d7ba5324262ea6f4f THE REVIEW ChronAm 1917.1821917491122 35.955692 -80.005318 "I stand here and nave taKen me\nhigh and solemn…	sities	s:0.8595998287200928 s:0.07112017273902893 S:0.022944817319512367 S:0.007306838408112526 t:0.004340138286352158 sit:0.002519219880923629 try…	48961.26
26	3174a7e1b8e3b6911429a955d261aaeb RAFTSMAN'S JOURNAL ChronAm 1863.4589040778792 41.02728 -78.439188 that a nation may conduct a great war and…	uals	u:0.8933724164962769 ual:0.028789224103093147 u:0.014133895747363567 ul:0.013178613968193531 U:0.011362560093402863 ua:0.005249741952866316 …	48718.94
27	16fa9127c684c3405113b44c5cce944b KANSAS WEEKLY HERALD ChronAm 1855.6287670915779 39.311326 -94.922759 For Boonville, Glasgow, Brunswick, Mxa…	ana	and:0.7652765512466431 ,:0.1620936542749405 and:0.025110621005296707 .:0.009400565177202225 ,:0.005256288684904575 ;:0.00193282519467175 -:0…	46569.27
28	1f61d0be115721333a36e20b0f91f639 THE MINERS ChronAm 1852.3811475093605 42.500622 -90.664797 The people of L.wa demanded a new set of\nlaws, …	od,	ods:0.5124688744544983 od:0.38852065801620483 ody:0.026712987571954727 o:0.015715021640062332 ode:0.015602841041982174 os:0.0032717185094952…	46205.17
29	3ff22426092d3a6869b2bd48364ba5f2 RAFTSMAN'S JOURNAL ChronAm 1858.9356164066464 41.02728 -78.439188 aware that the earliest and the best frui…	tages.	t:0.9394581913948059 c:0.016228286549448967 t:0.003807219211012125 te:0.003658068599179387 tal:0.0017743634525686502 d:0.001442002598196268 …	42238.79
30	10e94db219d58d18b8e3a60f5d7f7438 EVENING CAPITAL ChronAm 1892.7964480558085 38.97864 -76.492786 and they say “he slings it powerful\nthick.”…	tions,	tions:0.8556392192840576 t:0.05112118273973465 tion:0.04089066758751869 ts:0.005325481295585632 ations:0.003652906743809581 t:0.003204417647…	40741.00
31	2b31aa78f8a9a9d39e17a4cbad1cef13 ELK CITY MINING NEWS ChronAm 1911.5301369545916 45.78769 -115.200118 To William P. Boyle, your heirs, execu…	2-,	2:0.8486542701721191 1:0.05405557155609131 3:0.034290675073862076 4:0.01018502563238144 2:0.007797193713486195 5:0.004005438182502985 two:0.…	39404.18
32	20259630a6e0730d928e8c1b21c1f692 COURIER DEMOCRAT ChronAm 1894.8342465436326 48.76059 -98.367824 Omaha, Oct. 28. —The fact was made\npublic …	ever,	ever:0.8965324759483337 ev:0.04460228234529495 ver:0.005204466637223959 so:0.004202937241643667 much:0.003703995840623975 eve:0.002796967979…	39171.40
33	0d050dd13bef6f72f7e1f135251bc848 ARIZONA REPUBLICAN ChronAm 1898.7082191463724 33.448587 -112.077346 and public ways or places are correctly…	plat,	plat:0.9175222516059875 pl:0.024499177932739258 pl:0.021518666297197342 Plat:0.002308553084731102 Pl:0.0014225079212337732 p:0.0005900043179…	37447.84
34	2c0d95582280cbfe0d09338e19d935c6 ARIZONA REPUBLICAN ChronAm 1910.5136985984273 33.448587 -112.077346 The voters of this district should\nbe …	grounds.	grounds:0.8828681707382202 grounds:0.03615577146410942 premises:0.01684487611055374 ground:0.016538549214601517 lot:0.0035716809798032045 gr…	37090.41
35	0349558a29ec5f70c68da27ec5735439 THE CHARLOTTE DEMOCRAT ChronAm 1872.443989039415 35.227087 -80.843127 Sec. 8. That there shall be appointed…	law.	law:0.8907524943351746 the:0.026813825592398643 this:0.017484333366155624 statute:0.0067720357328653336 law:0.00477449269965291 act:0.003790…	34308.89
36	04699986bfed41fe944706b8107f4b0e IDAHO SPRINGS SIFTINGS ChronAm 1902.6808218860983 39.745496 -105.511267 21’ W. and 1396 ft. S. 45“ 21' E. f…	S.	s:0.8769201636314392 n:0.0599178746342659 s:0.01709330826997757 w:0.004057477694004774 S:0.001229274203069508 m:0.0012082232860848308 e:0.00…	33548.49
37	0c8c1948dd06dabb9d447e60570cb071 LA JUNTA TRIBUNE ChronAm 1898.7876712011669 37.985009 -103.543832 "It will be borne In mind that the\ntroop…	follows:	follows:0.9210463166236877 follow:0.012753738090395927 fol:0.011561006307601929 following:0.004991006571799517 followed:0.003018688410520553…	32986.13
38	01b7b83daa06473b8e8c4f4855a089c5 IDAHO SPRINGS SIFTINGS ChronAm 1902.7767122970574 39.745496 -105.511267 May 10. 1872. The Monarch M.. M . T…	29°	29:0.8621378540992737 30:0.02868124283850193 29:0.02839021012187004 31:0.008735357783734798 28:0.008012812584638596 from:0.00538173364475369…	31711.98
39	17eeb76ae217f8f128a1ceabfa0c73a0 ARIZONA REPUBLICAN ChronAm 1898.2068492833587 33.448587 -112.077346 Solojnonville, March 15. (Special\ncorr…	Prize	pri:0.6871898770332336 pri:0.22702822089195251 prize:0.03247341513633728 -:0.007532972376793623 p:0.002498365705832839 prizes:0.001388122444…	29330.65
40	060b18f161efafb8b7df1a268a34c8cb GREAT FALLS DAILY TRIBUNE ChronAm 1919.7301369545917 47.504885 -111.291891 thousand dollars, or a billion d…	fund,	fund:0.8722822070121765 funds:0.03970136493444443 fund:0.018145468086004257 -:0.007034074515104294 costs:0.004221167415380478 expenses:0.003…	27943.38