Metric	Score
PerplexityHashed	215.47

Metric	Score
PerplexityHashed	190.53

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1b515315af748c90c2045b91dd516e0d ELK CITY MINING NEWS ChronAm 1911.6452054477422 45.78769 -115.200118 Oats—Condition 65.7 per cent of a\nnor…	average.	average:0.7 Average:0.0002483231946825981 avg:0.00022846952197141945 mean:0.00019725982565432787 averages:0.0001733046374283731 \:0.00012873…	564391.64
2	3123a2757dc1d6e1cfe6797de1af378e MOUNTAIN HOME REPUBLICAN ChronAm 1923.0726027080163 43.13295 -115.691197 89. I. D . Stokes, Hill City.\n90.…	121.	121:0.7 122:0.0009994740830734372 121:0.0005746245151385665 131:0.0005567157058976591 111:0.0004689662018790841 61:0.00046377143007703125 20…	249310.12
3	7b5eb24a47e3ceccdaed226d6c3665a1 RAFTSMAN'S JOURNAL ChronAm 1867.9438355847285 41.02728 -78.439188 we violate our trust by assuming them as\…	peace;	war:0.6200594305992126 peace:0.22492559254169464 \:0.09829121083021164 \:0.027945803478360176 War:0.0036760116927325726 insurrection:0.00279…	106889.54
4	2f20c5e34082c919371200e6a1159565 ARIZONA REPUBLICAN ChronAm 1912.56420761865 33.448587 -112.077346 Accompanying this showing will be\na requ…	sides,	sides:0.7 the:0.011117507703602314 side:0.004655854310840368 \:0.0016037365421652794 ends:0.001143999514169991 \:0.0009731097379699349 parti…	83192.12
5	2c0d95582280cbfe0d09338e19d935c6 ARIZONA REPUBLICAN ChronAm 1910.5136985984273 33.448587 -112.077346 The voters of this district should\nbe …	grounds.	grounds:0.7 \:0.01792522519826889 ground:0.017758475616574287 \:0.014958814717829227 premises:0.002151555148884654 land:0.001055784989148378…	66376.81
6	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.7 a:0.014529292471706867 o:0.004032823257148266 ::0.0020936382934451103 pm:0.002009105170145631 1:0.0012603101786226034 m:0.000966409104…	62910.65
7	3864e02c4c3867d4cf58f4b7326eb561 THE JASPER WEEKLY COURIER ChronAm 1917.2808218860985 38.391448 -86.930874 know what women will accept, for …	another,	another:0.6438567638397217 the:0.29379570484161377 other:0.019179072231054306 \:0.014021862298250198 \:0.0022459833417087793 Another:0.00130…	54957.18
8	32758707f2497884e96b0f7a1102ee33 THE REVIEW ChronAm 1918.2753424340435 35.955692 -80.005318 Feed the bread crumbs, rolled oats,\nor johnnyca…	oats,	oats:0.7 wheat:0.005904177203774452 o:0.0018661279464140534 ,:0.0008429799927398562 in:0.000735596870072186 barley:0.0007341784075833857 or:…	53176.79
9	16b9eb2107c6352464ca43134f296b01 THE JASPER WEEKLY COURIER ChronAm 1917.2999999682902 38.391448 -86.930874 know what women will accept, for …	another,	another:0.6305957436561584 the:0.3034254014492035 other:0.020337389782071114 \:0.014135098084807396 \:0.002123960992321372 a:0.0013717823894…	50223.11
10	0d6cee8ed06a4b20bcef8d2325397570 EVENING CAPITAL ChronAm 1903.7219177765094 38.97864 -76.492786 An awful tragedy occurred about five\no'cloc…	death.	death:0.7 \:0.004991778172552586 and:0.0025837598368525505 \:0.002523883478716016 fatal:0.0018659422639757395 death:0.0014717133017256856 ca…	47545.17
11	0349558a29ec5f70c68da27ec5735439 THE CHARLOTTE DEMOCRAT ChronAm 1872.443989039415 35.227087 -80.843127 Sec. 8. That there shall be appointed…	law.	law:0.7 the:0.013975659385323524 this:0.009229562245309353 statute:0.008050474338233471 \:0.006196009460836649 \:0.0038130301982164383 Law:0…	47034.51
12	0b10beeb0214b3ac3f65555659106adf ARIZONA REPUBLICAN ChronAm 1910.6205479134958 33.448587 -112.077346 pounds',, against ,488,000,000 In 1909,…	States'	states:0.7 States:0.07116595655679703 united:0.00788069050759077 states:0.0077925738878548145 States:0.0037235368508845568 state:0.003082581…	41439.19
13	2d3c2ade86d27881ee102cdce29baff6 CENTRE DEMOCRAT ChronAm 1861.1794520230847 40.913486 -77.773747 iron uot otherwise provided for, thirty per…	valorem	val:0.7 val:0.002935378812253475 \:0.0019633364863693714 -:0.0014888378791511059 \:0.0012051918311044574 valuation:0.0008122261497192085 val…	37314.57
14	9a23949c6410e0a789c008623c370c36 DEMOCRAT AND SENTINEL ChronAm 1866.891780790208 40.485194 -78.724957 The present President of the United\nS…	States.	states:0.7 States:0.09970588237047195 state:0.008504340425133705 states:0.0060040089301764965 n:0.003365208161994815 States:0.00236699497327…	34812.18
15	4dff0c875a17009b366e20a28f769d0e RICHMOND ENQUIRER ChronAm 1844.7745901323112 37.538509 -77.43428 11 I am rightly informed, no application h…	respondence	res:0.7 re:0.0839344710111618 rec:0.057514991611242294 resp:0.025483429431915283 RES:0.0034517417661845684 r:0.0027773166075348854 ret:0.002…	33072.04
16	1879f42e9e0de79a444c78db0bd0aa4a ARIZONA REPUBLICAN ChronAm 1913.1575342148656 33.448587 -112.077346 point 22o feet west of the west line 01…	lino	line:0.7 \:0.0922180712223053 \:0.0075672948732972145 lines:0.0034505787771195173 -:0.002920614555478096 line:0.002092530718073249 |:0.00146…	30226.91
17	ad36f66392a236865e042dc33ef9f01e THE CHARLOTTE DEMOCRAT ChronAm 1872.2909835749342 35.227087 -80.843127 sand dollars coupons now in State Tr…	dollars.	dollars:0.7 pounds:0.0023952771443873644 dollar:0.0018782942788675427 Dollars:0.0017684546764940023 \:0.0014195136027410626 its:0.0013689324…	29225.98
18	359687017ba9ec1754226c0156d102d7 THE MINERS ChronAm 1854.6999999682903 42.500622 -90.664797 Patent Hydro-Electric Voltaic Chains,\nConstruct…	life-time,	whole:0.5597213506698608 entire:0.22071880102157593 life:0.15618979930877686 lifetime:0.010558130219578743 lives:0.0020015710033476353 lif:0…	28232.94
19	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m:0.4873901307582855 m:0.4475879967212677 o:0.00482688145712018 \:0.0043131266720592976 mm:0.003335546236485243 M:0.00214192783460021 \:0.00…	27253.28
20	2b31aa78f8a9a9d39e17a4cbad1cef13 ELK CITY MINING NEWS ChronAm 1911.5301369545916 45.78769 -115.200118 To William P. Boyle, your heirs, execu…	2-,	2:0.7 1:0.03819868341088295 3:0.026814380660653114 \:0.02260643243789673 \:0.0194696094840765 4:0.00998363271355629 2:0.004819654393941164 5…	26608.32
21	0591160f57c5e5c118137721a8527993 PULLMAN HERALD ChronAm 1899.8041095573312 46.730427 -117.173895 for the American to be Idle. His active\nbr…	use?	use:0.7 \:0.03731214627623558 service:0.007013567257672548 use:0.0038486195262521505 work:0.003105236915871501 \:0.0027288401033729315 or:0.…	25949.20
22	518a47af1323a61738e87055dbc6cbcc THE MINNESOTIAN ChronAm 1852.1789617170107 44.950404 -93.101503 Pearson then gave the King 24 hours\nmore 1…	firing,	firing:0.6261746287345886 fire:0.15555356442928314 \:0.03559541329741478 his:0.03514034301042557 the:0.03227969631552696 to:0.02622399292886…	25518.04
23	25bb7cd63622183596528d9c4839302a EVENING CAPITAL ChronAm 1885.532876680619 38.97864 -76.492786 Mr. R . T . Moore, well-known in\nthis city a…	man,	,:0.6318706274032593 .:0.11905355751514435 and:0.1012645959854126 \:0.01977579854428768 to:0.015431223437190056 ;:0.013444241136312485 in:0.…	24871.59
24	0c6efe832f549afeeed54dc5dad18a79 WATERBURY EVENING DEMOCRAT ChronAm 1890.1191780504819 41.558153 -73.051497 The second trait considered was …	blood.	blood:0.7 \:0.01162993349134922 \:0.007084977813065052 tears:0.005101016256958246 the:0.004570986609905958 their:0.0034133915323764086 water…	24554.94
25	024982e1792080d1c825214ee4781798 THE JASPER WEEKLY COURIER ChronAm 1896.06420761865 38.391448 -86.930874 pose that the first bi'l was smd to…	sulo	\:0.7 ':0.004148547537624836 ^:0.0017217625863850117 *:0.0014862011885270476 ir:0.001345891272649169 >:0.0010282840812578797 \:0.00089347048…	24522.26
26	25286d0278f585c625e9871754ae4038 ARIZONA REPUBLICAN ChronAm 1910.4260273655505 33.448587 -112.077346 were to appear before such distin-\ngui…	course,	course:0.7 the:0.02314673736691475 all:0.01797378808259964 course:0.013227208517491817 which:0.004465471021831036 \:0.003869735635817051 tha…	23293.26
27	006045a5c11e0d41157f4489157dc24a THE DAILY ARGUS ChronAm 1877.1493150367833 41.509477 -90.578748 Fourteenth On Orleans street, adjacent to a…	Boyle's	\:0.7 \:0.007165112998336554 /:0.002165601821616292 boy:0.0009459875873290002 n:0.0008989563793875277 b:0.0007837548037059605 ^:0.0007372081…	22995.87
28	b5d588d22fa8a8297ea75cccc114bcd7 RICHMOND ENQUIRER ChronAm 1847.2041095573313 37.538509 -77.43428 And, fourthly, let Senators look to the pr…	some	,:0.7 .:0.02367405779659748 ,:0.003964943811297417 ,,:0.003915882203727961 and:0.003855289425700903 \:0.0033184506464749575 to:0.00315686292…	22669.16
29	320144184877dbbc1885be355c79b9a8 ARIZONA REPUBLICAN ChronAm 1902.828767091578 33.448587 -112.077346 A morning paper yesterday did a\ngross i…	couple	man:0.7 woman:0.026323454454541206 person:0.02366560325026512 man:0.016489079222083092 m:0.004023150075227022 \:0.0036949918139725924 men:0.…	22389.16
30	5e1628996dfb7258eab5cebd4cf2e9d3 RICHMOND ENQUIRER ChronAm 1818.0452054477423 37.538509 -77.43428 said that Mr. Page had the firmness to res…	B	page:0.7 Page:0.01874784752726555 b:0.017997195944190025 pages:0.004452223423868418 p:0.0036713071167469025 page:0.0026556651573628187 j:0.0…	21158.10
31	1489cf82a341ecf843e6bcb3c043baa7 ARIZONA REPUBLICAN ChronAm 1910.1027396943175 33.448587 -112.077346 Sflcond. That the people inhabiting\nsa…	longing	qu:0.4541102647781372 \:0.4498961865901947 -:0.010782480239868164 i:0.006476275157183409 q:0.004353325814008713 que:0.0032936930656433105 \:…	20948.64
32	09746a0eedeb1259e591f1359772da16 EVENING CAPITAL ChronAm 1891.2808218860985 38.97864 -76.492786 A Remarkable Accomplishment.\nThe women of N…	“She	":0.6590893268585205 \:0.19197282195091248 \:0.06667055189609528 "\:0.013366779312491417 "':0.002369740977883339 ':0.002245826181024313 '':0…	19919.15
33	3fdde0a224082c3c861061f0df7cc749 KENTUCKY IRISH AMERICAN ChronAm 1914.3520547628107 38.254238 -85.759407 patched to all the Cardinals with\n…	show	\:0.4464539885520935 the:0.25805577635765076 him:0.09812569618225098 \:0.06408312171697617 each:0.02743084914982319 their:0.0166954286396503…	19410.87
34	039eead30217414e210935aa97c52752 ARIZONA REPUBLICAN ChronAm 1896.4822404055353 33.448587 -112.077346 Section 1. The fiscal year for the City…	oi	of:0.7 ,:0.01668776385486126 in:0.01311197318136692 o:0.012232618406414986 \:0.009460787288844585 j:0.009337805211544037 t:0.008135945536196…	19206.98
35	5a0cf39d40ec945188486f0b332b64e7 RICHMOND ENQUIRER ChronAm 1838.491780790208 37.538509 -77.43428 guage showed inches of steam On the attenti…	an-	answer:0.6566910743713379 reply:0.17497830092906952 \:0.05082553252577782 response:0.03011014126241207 answer:0.007307880558073521 answers:0…	19151.12
36	1fa6f97bc6da5439b57490f665b67d42 EVENING CAPITAL ChronAm 1901.5438355847286 38.97864 -76.492786 Section 4. As soon as may Ik- after the tak-…	fifty-five	fifty:0.7 over:0.04905085638165474 more:0.02807394601404667 five:0.02133847400546074 forty:0.011596283875405788 twenty:0.011234616860747337 …	18623.06
37	077b0d855218b37272f533c63f057798 ARIZONA REPUBLICAN ChronAm 1896.80464477712 33.448587 -112.077346 Oonneotaeu't, 10 to 7 on MeKinley.\nDelaw…	MeKinley.	me:0.6332821846008301 b:0.28841540217399597 m:0.0027383367996662855 my:0.0022993755992501974 j:0.0019862125627696514 us:0.001959630753844976…	18494.42
38	5a995a645e242bf9267daeaadc105b8c CHERAW GAZETTE ChronAm 1836.7581966896882 34.697656 -79.883397 cause,' I replied, 'I will not be false to m…	them,	them:0.6403433084487915 their:0.09711325913667679 him:0.09070443361997604 the:0.05288654565811157 his:0.026431361213326454 a:0.0160192344337…	18339.63
39	4d221887f0b9a1a47698d68ee47a7f54 CENTRE DEMOCRAT ChronAm 1880.5942622634589 40.913486 -77.773747 The London Timet gives an account\nof a met…	Edition's	the:0.48873069882392883 their:0.14918413758277893 its:0.1138669028878212 these:0.08883284032344818 them:0.03402303159236908 those:0.01328863…	18146.65
40	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.7 tha:0.008563235402107239 then:0.006475740112364292 th:0.004202975891530514 \:0.0027427959721535444 that:0.0018190426053479314 >:0.0…	17735.24