Metric	Score
PerplexityHashed	396.30

Metric	Score
PerplexityHashed	360.94

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	02086dae55c9b8917b734d043ddf0e1d THE DICKINSON PRESS ChronAm 1892.4822404055353 46.879176 -102.789624 tariff, and demands Ibe enforcement of…	Neal	with:0.9072381854057312 by:0.011093358509242535 and:0.007959050126373768 in:0.006511182524263859 from:0.005668689496815205 between:0.0050657…	21490.03
2	9a23949c6410e0a789c008623c370c36 DEMOCRAT AND SENTINEL ChronAm 1866.891780790208 40.485194 -78.724957 The present President of the United\nS…	States.	States:0.8504562377929688 Slates:0.019997477531433105 State:0.01624738797545433 states:0.006891671568155289 Stales:0.005948992446064949 King…	11192.11
3	0ba3ca99842e04d54ea7df3d3133e753 CLARKSVILLE CHRONICLE ChronAm 1861.6424657217149 36.527761 -87.35887 supposed that imprisonment for debt hu…	Mates,	States:0.8504562377929688 Slates:0.019997477531433105 State:0.01624738797545433 states:0.006891671568155289 Stales:0.005948992446064949 King…	11192.11
4	0b10beeb0214b3ac3f65555659106adf ARIZONA REPUBLICAN ChronAm 1910.6205479134958 33.448587 -112.077346 pounds',, against ,488,000,000 In 1909,…	States'	States:0.8504562377929688 Slates:0.019997477531433105 State:0.01624738797545433 states:0.006891671568155289 Stales:0.005948992446064949 King…	11192.11
5	c954306d673d88d08987736c007f2dd6 THE WYANDOT PIONEER ChronAm 1868.5396174547157 40.827279 -83.281309 warrant in the Constitution, and if\nsa…	of.	of:0.5407325029373169 to:0.3208146095275879 and:0.012547863647341728 ot:0.006379776634275913 in:0.005189903546124697 from:0.0050956453196704…	10176.09
6	1f61d0be115721333a36e20b0f91f639 THE MINERS ChronAm 1852.3811475093605 42.500622 -90.664797 The people of L.wa demanded a new set of\nlaws, …	od,	ods:0.7178590297698975 od:0.1697753369808197 of:0.003575550625100732 and:0.0016181599348783493 the:0.0012941465247422457 due:0.0009260952938…	9875.80
7	054d3ae2d462f8f99310816383fbf6f7 RICHMOND ENQUIRER ChronAm 1835.7246575025367 37.538509 -77.43428 aged about 23 years, of light complexion, …	chicily	of:0.7521394491195679 in:0.08201945573091507 In:0.009756659157574177 and:0.007685767486691475 ot:0.007400394417345524 on:0.00672207074239850…	8431.79
8	11a618922a619ac74b505d8e1e13f9c2 COURIER DEMOCRAT ChronAm 1911.5876712011668 48.76059 -98.367824 Order Hearing Petition for Sale of Land\nUp…	to.	to:0.8169626593589783 the:0.013120177201926708 and:0.012293301522731781 for:0.007316873874515295 in:0.00594177283346653 by:0.005625157617032…	7814.84
9	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	to:0.8169626593589783 the:0.013120177201926708 and:0.012293301522731781 for:0.007316873874515295 in:0.00594177283346653 by:0.005625157617032…	7814.84
10	d9284676477f5d3c6cf470e2aba86f6a RICHMOND ENQUIRER ChronAm 1818.1547944888382 37.538509 -77.43428 It has hcon admitted hy the exccnli e\nCou…	cil,	try:0.4835033416748047 ty:0.22800758481025696 ties:0.04547804221510887 tries:0.043221648782491684 cil:0.03521570935845375 sel:0.025550507009…	7683.11
11	06f5c84e09b4a5d14a89751be629d857 ARIZONA REPUBLICAN ChronAm 1903.878082160071 33.448587 -112.077346 A wise programme, truly, and am-\nbitiou…	somewhat	to:0.8210675120353699 and:0.010868428274989128 plane:0.009495450183749199 lo:0.006550279911607504 for:0.00550881028175354 that:0.00510371569…	7614.87
12	226c65808a15af28f2ec41776b025c6f THE MEMPHIS APPEAL ChronAm 1886.1410958587012 35.149022 -90.051628 given as news, pure and simple, and\nhav…	Judge,	Court:0.7322986125946045 Judicial:0.05224204808473587 Bench:0.020498275756835938 court:0.015530223958194256 Council:0.006278051994740963 our…	6303.43
13	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.47965556383132935 lying:0.14573359489440918 on:0.07246261835098267 In:0.06541577726602554 and:0.033365387469530106 at:0.011256947182118…	5705.06
14	53b314958babe6fbde1dd312915114bf RICHMOND ENQUIRER ChronAm 1854.1027396943175 37.538509 -77.43428 into the expediency of appropriating S4.50…	to,	to:0.41739049553871155 upon:0.15774528682231903 that:0.11992081999778748 with:0.03740110248327255 on:0.030306654050946236 and:0.017098145559…	5435.92
15	483b31c888630a6712df48fe6cee758d RICHMOND ENQUIRER ChronAm 1831.2397259956874 37.538509 -77.43428 11. The said superior courts shall have th…	y	ty:0.39947208762168884 cil:0.3801772892475128 ties:0.015804605558514595 a:0.0033087977208197117 the:0.0032340839970856905 tv:0.0031968662515…	5397.21
16	1a1ad69bf7e365aa74b57eb1ca02b178 RICHMOND ENQUIRER ChronAm 1861.519178050482 37.538509 -77.43428 a< r.o gninsayers.\nThere is the very highe…	ri.tin-ru	ernment:0.6367477774620056 ernor:0.1168433427810669 eminent:0.028243940323591232 ern:0.011437514796853065 per:0.0024637782480567694 1:0.0020…	5130.41
17	47760e14f5f772dc8bc8d84795614664 FREMONT WEEKLY FREEMAN ChronAm 1852.0068305694697 41.35033 -83.121863 unite with the Galena road, over whic…	nor	of:0.6501490473747253 and:0.058654267340898514 The:0.02030089870095253 in:0.014407346025109291 which:0.014003819786012173 the:0.013261179439…	4926.87
18	55b4759355e39f94f1dc5f6a56e0dee4 THE NEW NORTH-WEST ChronAm 1879.332876680619 46.395761 -112.730038 Farragut, on board the" Hartford." The\n…	our	the:0.6348949670791626 his:0.03176821768283844 tho:0.0269935205578804 which:0.02168179862201214 a:0.021447639912366867 this:0.01852885819971…	4648.26
19	05886a003cc1e002dcca349e4bd67c8b THE DICKINSON PRESS ChronAm 1909.5027396943176 46.879176 -102.789624 When wisely followed, the practice of\…	all	the:0.6348949670791626 his:0.03176821768283844 tho:0.0269935205578804 which:0.02168179862201214 a:0.021447639912366867 this:0.01852885819971…	4648.26
20	104c6456c01727cf0ac8932be19be006 EVENING CAPITAL ChronAm 1884.6352458700162 38.97864 -76.492786 Professor Voelker, the agricultural\nchemist…	ment,	ment:0.6985254287719727 ments:0.0331856831908226 and:0.011074305512011051 ing:0.010338165797293186 the:0.00921487808227539 to:0.005861694924…	4617.80
21	366e401abc352060a99543482122e40d THE WICHITA CITY EAGLE ChronAm 1879.8095890093862 37.692236 -97.337545 Sunday morning, refused permission t…	nor	of:0.7023024559020996 and:0.031890369951725006 or:0.016689354553818703 ot:0.008783248253166676 in:0.005382031202316284 to:0.0048286858946084…	4616.54
22	3e9eb2473cebd9f0e4f87b791c40ccca THE DICKINSON PRESS ChronAm 1917.2835616121258 46.879176 -102.789624 NOTICE IS HEREBY GIVEN That\nunder aut…	Quar­	Quarter:0.3558711111545563 quarter:0.2902926206588745 corner:0.0903308242559433 quar:0.011930941604077816 comer:0.010293696075677872 of:0.00…	4604.47
23	02e25922b083a8046b8e43e93d0d306c THE JASPER WEEKLY COURIER ChronAm 1908.8866119902348 38.391448 -86.930874 Close Inspection of tho election …	en	to:0.6519308686256409 the:0.04078657552599907 it:0.021159635856747627 a:0.017328789457678795 by:0.011920254677534103 and:0.01009170804172754…	4596.82
24	74a6a7f335e47b93176365f32ed623b6 RICHMOND ENQUIRER ChronAm 1819.042465721715 37.538509 -77.43428 flume wbo have experienced its operation\ni…	ilie	to:0.668343722820282 in:0.027929730713367462 and:0.022858519107103348 by:0.01538434810936451 of:0.012811435386538506 the:0.01105586066842079…	4583.74
25	0ee98eb64613cfabb32a6fcde6d78e93 RICHMOND ENQUIRER ChronAm 1817.0753424340437 37.538509 -77.43428 t lie struggles « t the French Revolution,…	it	to:0.668343722820282 in:0.027929730713367462 and:0.022858519107103348 by:0.01538434810936451 of:0.012811435386538506 the:0.01105586066842079…	4583.74
26	19ac0c5fe4c9d90c0ce341b1498913b5 COURIER DEMOCRAT ChronAm 1894.6041095573314 48.76059 -98.367824 fold requirements, for the contemplat­\ned …	his	from:0.6630762815475464 the:0.026583928614854813 by:0.02035927213728428 to:0.012985621578991413 therefrom:0.012925932183861732 in:0.01116079…	4558.30
27	12ef1351ba9c0382b7f45bec46f4873c WATERBURY EVENING DEMOCRAT ChronAm 1889.8123287354135 41.558153 -73.051497 follows: Edward P. Hyland 132, J…	Britain,	York:0.5022076368331909 Jersey:0.08075538277626038 Orleans:0.05449720472097397 England:0.052053194493055344 Mexico:0.04108786955475807 Hamps…	4341.78
28	956245733747a1d97d071ffba0fd1c02 THE JASPER WEEKLY COURIER ChronAm 1883.9712328450025 38.391448 -86.930874 The Repablicaa oauens of tae Moaa…	York,	York:0.5022076368331909 Jersey:0.08075538277626038 Orleans:0.05449720472097397 England:0.052053194493055344 Mexico:0.04108786955475807 Hamps…	4341.78
29	1230980afbc326f7d32635a6fbd9a626 RICHMOND ENQUIRER ChronAm 1816.684426197885 37.538509 -77.43428 The West-India and Commercial Inter-\nests,…	England.)	York:0.5022076368331909 Jersey:0.08075538277626038 Orleans:0.05449720472097397 England:0.052053194493055344 Mexico:0.04108786955475807 Hamps…	4341.78
30	b9d18b6e2adb1acfebbd46cd9afc5824 RICHMOND ENQUIRER ChronAm 1821.0808218860984 37.538509 -77.43428 1 he first twelve certificates from A l« L…	York.	York:0.5022076368331909 Jersey:0.08075538277626038 Orleans:0.05449720472097397 England:0.052053194493055344 Mexico:0.04108786955475807 Hamps…	4341.78
31	36f3ce448336c5a72028b212a84adcf2 THE DICKINSON PRESS ChronAm 1912.3784152689234 46.879176 -102.789624 Section 6. The several members of\nthe…	provided	that:0.4333455264568329 to:0.08785169571638107 the:0.07102224230766296 of:0.06174168735742569 by:0.05037258565425873 and:0.03768597170710564…	4336.09
32	2a52681497a9f473ca14a55c1ac997fa THE DAILY ARGUS ChronAm 1877.1410958587012 41.509477 -90.578748 Fourteenth On Orleans street, adjacent to a…	;	to:0.643949031829834 of:0.06465621292591095 thereto:0.012129174545407295 the:0.011908206157386303 a:0.009197404608130455 and:0.0089936954900…	4314.86
33	531517feae16d174c438b774dddd97e2 RICHMOND ENQUIRER ChronAm 1820.1707649956993 37.538509 -77.43428 consideration of this stu ject, Mr.C. said…	r	erty:0.6744246482849121 erly:0.04489662125706673 er:0.019725210964679718 and:0.008824105374515057 the:0.004269610624760389 rty:0.00411032466…	4300.96
34	1b593f17221d49d2a980654eeefe752c THE INTERIOR JOURNAL ChronAm 1907.8726027080163 37.53119 -84.661888 in consulting a competent and reliable\…	if	of:0.6461533308029175 and:0.030104923993349075 which:0.023047052323818207 exercises:0.02289637178182602 to:0.011945950798690319 or:0.0097013…	4293.38
35	1a790a9832d9a7ac16e5f457008a8307 MARYLAND FREE PRESS ChronAm 1866.6999999682903 39.600652 -77.820551 riveted ey em ifor mtofc I fohe their p…	little	of:0.6461533308029175 and:0.030104923993349075 which:0.023047052323818207 exercises:0.02289637178182602 to:0.011945950798690319 or:0.0097013…	4293.38
36	0107777cc57db3d0f0271976e60befa9 ARIZONA REPUBLICAN ChronAm 1916.1680327552622 33.448587 -112.077346 bridge within x few days, according\nto…	Francisco;	Francisco:0.6121857166290283 Diego:0.03214777633547783 Juan:0.025817204266786575 Pedro:0.024313993752002716 Antonio:0.020249685272574425 Jos…	4245.02
37	9a8ae1a3b68fed3cb57ee7d9390b6b16 RICHMOND ENQUIRER ChronAm 1817.2753424340435 37.538509 -77.43428 impulse was given to agriculture, hy\nt!ic…	on	of:0.6602354645729065 and:0.03957995027303696 to:0.018236951902508736 in:0.010590674355626106 The:0.009737377986311913 ot:0.0065091191790997…	4197.98
38	4b29a6f5c0a14145f6936e3fb055e2ee RICHMOND ENQUIRER ChronAm 1827.7904109271942 37.538509 -77.43428 honourable friend* and colleague* ihe tnav…	f	of:0.6602354645729065 and:0.03957995027303696 to:0.018236951902508736 in:0.010590674355626106 The:0.009737377986311913 ot:0.0065091191790997…	4197.98
39	0a48ed904b556184f8475503e9fc9846 RICHMOND ENQUIRER ChronAm 1816.9877048864096 37.538509 -77.43428 by ir.v. nio Hie Subscriber* to Hie Capita…	(of	in:0.5351266264915466 In:0.11574039608240128 on:0.024115366861224174 among:0.019734414294362068 plat:0.01765492558479309 and:0.0167116038501…	4171.75
40	419b1c8767c6e1e70233c90f5628ae04 RICHMOND ENQUIRER ChronAm 1842.3547944888383 37.538509 -77.43428 Mr. MERRICK stated that be very much regre…	Well,	to:0.5229380130767822 with:0.09956489503383636 in:0.030183136463165283 on:0.025589432567358017 from:0.025387074798345566 by:0.02487259730696…	4120.03