Metric	Score
PerplexityHashed	257.14

Metric	Score
PerplexityHashed	234.01

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m.:0.3864821195602417 m:0.3758089542388916 m.,:0.1617237627506256 in.,:0.02840992994606495 M.,:0.0020137676037847996 8:0.002006063936278224 …	53832.76
2	1a4d8480064e27a48ebc052fe9d47b11 THE EMPIRE COUNTY ARGUS ChronAm 1854.6890410641806 38.799901 -120.890216 On the amount of postage on letter…	pf	of:0.6892759203910828 by:0.043757736682891846 in:0.025649558752775192 and:0.022909939289093018 to:0.018111158162355423 ot:0.0172376912087202…	43921.96
3	327c1f738994b34c965467662851edfa COURIER DEMOCRAT ChronAm 1910.5712328450024 48.76059 -98.367824 In the Matter of the Estate of Bertha Overb…	doorof	door:0.973415195941925 of:0.0065749152563512325 half:0.002080821432173252 end:0.0014265947975218296 corner:0.0009559800964780152 line:0.0008…	27713.07
4	53e3f3a7d1eb3c8dbca2bb5e6a6b8ce2 CENTRE DEMOCRAT ChronAm 1882.2041095573313 40.913486 -77.773747 The crying need of American agri-\nculture …	consumed,	of:0.7135666608810425 and:0.028808146715164185 in:0.02305285818874836 ot:0.017547225579619408 to:0.01277375128120184 which:0.012702364474534…	24732.05
5	85c0c57c14b3d084464e969e74af4f07 RICHMOND ENQUIRER ChronAm 1835.3219177765093 37.538509 -77.43428 It is with much pleasure 1 announce to you…	fy	that:0.7948524355888367 of:0.036695778369903564 to:0.021565906703472137 the:0.01304207555949688 by:0.007117194589227438 in:0.006960304919630…	24126.39
6	51b1cccd8a1b841baed9585ab27cfd83 EVENING CAPITAL ChronAm 1922.6205479134958 38.97864 -76.492786 Section 11. The purpose of this Article\nis …	inrlirat	be:0.7452830076217651 have:0.04445911943912506 bo:0.020602457225322723 fail:0.008462492376565933 do:0.007908242754638195 to:0.00482886238023…	24080.97
7	6793477d83284410112f8c51430d0a33 RICHMOND ENQUIRER ChronAm 1847.4150684614408 37.538509 -77.43428 that the s;ild amended nnd xup|ilenierital…	('nderwood.a	.:0.843495786190033 .,:0.05907975509762764 ..:0.0021930462680757046 ,:0.0011852890020236373 of:0.0010664158035069704 P:0.000989320920780301 …	21255.42
8	ee2913852a953eddc783ca50182f8f23 RICHMOND ENQUIRER ChronAm 1829.4178081874684 37.538509 -77.43428 That on or about the 6ihof July, 1827, the…	obliter-	not:0.6527837514877319 the:0.03913140296936035 it:0.029609402641654015 he:0.012172000482678413 so:0.010356071405112743 a:0.00712459767237305…	19118.95
9	1b3e1c6d78857ba46898d7f983753875 RICHMOND ENQUIRER ChronAm 1847.17397257103 37.538509 -77.43428 The Speech or Ma. Corwin, which will l>e\nfo…	nearly	by:0.6236236095428467 in:0.084944948554039 for:0.02592312917113304 to:0.025917667895555496 from:0.021240752190351486 as:0.019788872450590134…	19040.32
10	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	of:0.3105683922767639 to:0.16255301237106323 in:0.05577429011464119 for:0.04990988224744797 and:0.04697553440928459 at:0.03483060374855995 o…	18724.11
11	c70e7b003bdb1ab83bc3ff37571dacca RICHMOND ENQUIRER ChronAm 1837.1082191463724 37.538509 -77.43428 lie submitted the petitions, the whole num…	liy	by:0.44436514377593994 in:0.0789879709482193 to:0.05782615393400192 at:0.05157727748155594 for:0.03498150035738945 and:0.03484027087688446 a…	18182.12
12	12ef1351ba9c0382b7f45bec46f4873c WATERBURY EVENING DEMOCRAT ChronAm 1889.8123287354135 41.558153 -73.051497 follows: Edward P. Hyland 132, J…	Britain,	York:0.28632956743240356 York,:0.20303864777088165 York.:0.1422451287508011 Jersey:0.04903433471918106 Orleans:0.03692234680056572 Jersey,:0…	17383.22
13	1432a249d40696a9826bf798d7a9f9f6 THE WICHITA CITY EAGLE ChronAm 1877.6041095573314 37.692236 -97.337545 Morton aud to be regular and legal i…	sJ	the:0.5004452466964722 said:0.18546995520591736 this:0.07411055266857147 tho:0.016150571405887604 tbe:0.00902316439896822 foreclosure:0.0081…	16380.34
14	0ba3ca99842e04d54ea7df3d3133e753 CLARKSVILLE CHRONICLE ChronAm 1861.6424657217149 36.527761 -87.35887 supposed that imprisonment for debt hu…	Mates,	States:0.58058762550354 States,:0.25004100799560547 States;:0.021447813138365746 States.:0.02128520794212818 Slates:0.008630302734673023 Kin…	15807.67
15	1e88b4d3b7e430ad3c54d5e1611bd34c THE NEW NORTH-WEST ChronAm 1894.4561643518518 46.395761 -112.730038 white, for that wr.uld be too bridelike…	sighing	from:0.3984545171260834 and:0.06039014458656311 in:0.04656030982732773 with:0.04018828645348549 to:0.03212480619549751 by:0.0314827635884285…	14048.25
16	e4826c020d9f4b55389aef1d013602da THE WYANDOT PIONEER ChronAm 1866.6999999682903 40.827279 -83.281309 Andrew Johnson is responsible for all\n…	up-	of:0.24705161154270172 and:0.131260946393013 to:0.05669591203331947 with:0.04605803266167641 in:0.04467632248997688 for:0.0418756902217865 w…	13928.43
17	054d3ae2d462f8f99310816383fbf6f7 RICHMOND ENQUIRER ChronAm 1835.7246575025367 37.538509 -77.43428 aged about 23 years, of light complexion, …	chicily	of:0.6680676341056824 in:0.05566086247563362 on:0.028527235612273216 ot:0.019607961177825928 ol:0.013792443089187145 In:0.013630690984427929…	13691.39
18	4a352d5df0eead57d4320c7f0578eecc RICHMOND ENQUIRER ChronAm 1859.228767091578 37.538509 -77.43428 PROTECTION OF 8LA VERY IN MEXICO.\nThe Terr…	(	of:0.4220210611820221 to:0.04916396737098694 and:0.040513962507247925 in:0.0373518243432045 is:0.020428994670510292 which:0.0159458052366971…	12796.51
19	607b99895f3593172d93044ff219c248 RICHMOND ENQUIRER ChronAm 1817.1904109271943 37.538509 -77.43428 The power to regulate commerce a-\nmongthe…	“common	of:0.6124948859214783 and:0.040558408945798874 to:0.016443083062767982 is:0.01380129810422659 in:0.013746927492320538 ot:0.01211083121597766…	12705.55
20	06c02c5d2944dc58a2c897feaee5a7b6 WATERBURY EVENING DEMOCRAT ChronAm 1899.5136985984273 41.558153 -73.051497 in a barber shop off his regular…	mer	to:0.13071638345718384 of:0.10655698925256729 and:0.08600952476263046 in:0.08440025895833969 for:0.055765774101018906 on:0.04363081604242325…	12528.31
21	13e2f77afa87a30faa4e2cdda33a3940 THE WYANDOT PIONEER ChronAm 1868.6352458700162 40.827279 -83.281309 some variety of seed that has been\nwel…	land	and:0.2841454744338989 but:0.07560383528470993 the:0.02934044785797596 to:0.029078667983412743 with:0.028970593586564064 in:0.02619464881718…	12165.16
22	0569a2fac1a66a10cc2187167fcf28de RICHMOND ENQUIRER ChronAm 1848.717213083131 37.538509 -77.43428 "There is no difficulty in understanding tb…	Columbia.this	Columbia:0.6115735769271851 Columbia,:0.20840808749198914 Columbia.:0.007809510920196772 trust:0.0036401457618921995 January,:0.003044076263…	12123.12
23	3d495c5ac9550777c444b6a20fea0b68 RICHMOND ENQUIRER ChronAm 1844.892076471109 37.538509 -77.43428 "Wccopv tli'1 foregoing article from the Ri…	tiiat	the:0.1313549131155014 that:0.09911587834358215 how:0.0617617592215538 him:0.05921248719096184 a:0.05244636908173561 what:0.0419685617089271…	11969.23
24	0b21c70249bdf62344cb26f5b547ffb2 EVENING CAPITAL ChronAm 1903.6369862696602 38.97864 -76.492786 A gentleman of dignified mien and\nsoldierly…	scenes	the:0.44568952918052673 his:0.09677295386791229 her:0.040669601410627365 a:0.03252705559134483 tho:0.027457676827907562 this:0.0257371924817…	11745.95
25	14cb52f1e290ab5ea1f0da656cf44c5d RICHMOND ENQUIRER ChronAm 1854.7547944888381 37.538509 -77.43428 work our weariness; vet infancy lungctli a…	hi::'.	the:0.132779061794281 that:0.10689537972211838 how:0.059207625687122345 him:0.054892029613256454 a:0.04793289303779602 it:0.0376665927469730…	11651.71
26	b53012959a216e7733663e4217db85ca EVENING CAPITAL ChronAm 1923.278082160071 38.97864 -76.492786 To Mary Jane Jews and Sewell frossweli:\nThe …	ot:	by:0.08862786740064621 on:0.08106382936239243 the:0.07029815018177032 through:0.06162833422422409 at:0.052143294364213943 in:0.0496705882251…	11010.05
27	0407abf6802a6cc0f9577b5dd245e32a EVENING CAPITAL ChronAm 1901.7931506532218 38.97864 -76.492786 ly, began the exodueof many northern\nlumber…	Stumpage	The:0.19454538822174072 He:0.06326761096715927 It:0.044641777873039246 There:0.04363640025258064 We:0.02744317054748535 But:0.02551566436886…	10964.06
28	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.6332826018333435 In:0.09407556802034378 on:0.08207983523607254 and:0.013420759700238705 of:0.01071453932672739 situate:0.00901907123625…	10851.66
29	0425cfab945c6d8e538d21d11b1ebe26 ARIZONA REPUBLICAN ChronAm 1906.0534246258244 33.448587 -112.077346 has already cost both sides of the con-…	thore	is:0.14304962754249573 has:0.08415695279836655 of:0.0782361850142479 was:0.07232315093278885 will:0.046629831194877625 should:0.034308850765…	10803.99
30	8e2c2dfa9322582ffc4b98543622f62e DEMOCRATIC MESSENGER ChronAm 1882.0945205162354 38.177063 -75.392696 It lias c>>me to light that there is e…	Deets	that:0.33193957805633545 the:0.11582310497760773 a:0.056654609739780426 it:0.01976955495774746 him:0.019322941079735756 how:0.01607187464833…	10486.23
31	c34b6faeda33f59294e163b2ded5554f RICHMOND ENQUIRER ChronAm 1818.2260273655504 37.538509 -77.43428 \\ p' intof Ihe engine, tvillt a descripti…	info	in:0.1402660608291626 into:0.07712338119745255 up:0.0635775700211525 to:0.056953996419906616 on:0.05007028952240944 the:0.03936179727315903 …	10442.73
32	0e78370512f1256b187f248215d2f434 GREAT FALLS DAILY TRIBUNE ChronAm 1919.0945205162354 47.504885 -111.291891 * "The closed shop was secured i…	always	by:0.2754487991333008 to:0.08750560134649277 in:0.076398566365242 at:0.052438732236623764 on:0.041814859956502914 as:0.03698819503188133 and…	10341.44
33	3c2e94914a8268165ac20d7552a69112 RICHMOND ENQUIRER ChronAm 1855.368493118975 37.538509 -77.43428 from that tn.rshn n eiiond in the conquest …	am	and:0.22423742711544037 in:0.11592583358287811 as:0.0462399497628212 that:0.04101084917783737 to:0.034963060170412064 with:0.030886031687259…	10332.28
34	0e6841bc63dc4256a9c924c234cdcaeb EVENING CAPITAL ChronAm 1903.828767091578 38.97864 -76.492786 At St. Joseph’s Hospital.\nMr. P. B. Bowdoin,…	neces-	that:0.22563901543617249 in:0.10587562620639801 to:0.0971669927239418 by:0.05883050337433815 at:0.037050824612379074 on:0.03595782443881035 …	10308.78
35	2d00eab82f6de971fa69f02157726f20 THE NEVADA JOURNAL ChronAm 1860.856557345426 39.261561 -121.016059 The counted ballots deposited on Tues-\n…	Watt,	the:0.22060084342956543 a:0.07185058295726776 it:0.04358012601733208 it.:0.02713184244930744 them:0.026298614218831062 his:0.024334885179996…	10285.65
36	6d5a410ed7640140dda4eef09b247f68 RICHMOND ENQUIRER ChronAm 1843.146575310756 37.538509 -77.43428 On motion of Mr. FILLMORE, the committee ro…	Buren,	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
37	39d72465e66cb5286ac3fd2e58dbec34 THE WICHITA CITY EAGLE ChronAm 1877.1821917491122 37.692236 -97.337545 past summer broken 2,500 acrss, and\…	wc	of:0.13637550175189972 to:0.1156020537018776 for:0.10456173121929169 and:0.08829277008771896 in:0.04025577753782272 that:0.02790352702140808…	10087.17
38	73d4733bf3ceaebb6992c59bbff4322d THE JASPER WEEKLY COURIER ChronAm 1872.5860655421473 38.391448 -86.930874 them well. I have been looking on…	shouted	have:0.10186372697353363 are:0.0496244840323925 should:0.0366545096039772 do:0.030935028567910194 will:0.030678339302539825 think:0.02791350…	9947.78
39	0985db88339a08ffcf4ad3d863235b74 THE DICKINSON PRESS ChronAm 1885.0068492833586 46.879176 -102.789624 ("Haggion Oros," the holy mountain\nof…	ft	a:0.10143429040908813 by:0.0866800993680954 the:0.0704701766371727 to:0.0604972280561924 in:0.05955313518643379 for:0.039184316992759705 as:…	9915.52
40	34070ba2fa628b8c627d61dabf3c5dc1 RICHMOND ENQUIRER ChronAm 1841.83698626966 37.538509 -77.43428 pate the speedy maturing of a train o{ measu…	mi	of:0.23692822456359863 and:0.08347779512405396 in:0.07762038707733154 for:0.05336635559797287 to:0.046941012144088745 which:0.04078270867466…	9898.22