Metric	Score
PerplexityHashed	379.56

Metric	Score
PerplexityHashed	341.57

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	a:0.979002624671916 ai:0.012987012987012988 :0.01	102603.74
2	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.9139784946236559 and:0.053304904051172705 805:0.010660980810234541 pieceor:0.010309278350515464 :0.011746342164421386	87176.07
3	5e8bbd887fa4b5368e011e5add115273 RICHMOND ENQUIRER ChronAm 1825.97397257103 37.538509 -77.43428 General Assembly. that it a law lc pas-td lo…	in	of:0.9398496240601504 ot:0.017543859649122806 op:0.01086048454469507 oi:0.007518796992481203 or:0.007518796992481203 :0.016708437761069117	61286.40
4	b541bf086ba2358b61d7928162ce5b61 RICHMOND ENQUIRER ChronAm 1829.9219177765094 37.538509 -77.43428 PUBLIC AUCTION.—By virtue of a deed of\ntr…	ol	of:0.9168399168399168 ot:0.02702702702702703 i:0.010482180293501049 01:0.010395010395010396 nf:0.010395010395010396 :0.02486085504953439	41189.25
5	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	a:0.9185059422750425 be:0.021922428330522766 ti:0.01517706576728499 1:0.008488964346349746 k:0.008488964346349746 :0.027416634934450457	37349.59
6	11a618922a619ac74b505d8e1e13f9c2 COURIER DEMOCRAT ChronAm 1911.5876712011668 48.76059 -98.367824 Order Hearing Petition for Sale of Land\nUp…	to.	to:0.8787878787878788 o:0.031055900621118012 i:0.031055900621118012 etc:0.029585798816568046 :0.029514521153317208	34694.79
7	06ea1c5e069d5ec88810b8df92a9941f THE EMPIRE COUNTY ARGUS ChronAm 1855.9931506532216 38.799901 -120.890216 preventative against Syphilitic an…	J.	j:0.9669421487603306 :0.03305785123966942	30976.00
8	09726909c77f27023d0f3d2206b97f8d ARIZONA REPUBLICAN ChronAm 1904.0341529738414 33.448587 -112.077346 A week or so later he sent another\nreq…	New	new:0.8770176787086856 now:0.0622598001537279 xew:0.01921598770176787 n:0.0038669760247486465 ne:0.0038550501156515036 :0.03378450729541849	30309.75
9	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	new:0.8770176787086856 now:0.0622598001537279 xew:0.01921598770176787 n:0.0038669760247486465 ne:0.0038550501156515036 :0.03378450729541849	30309.75
10	2bfa2ab7c2194bcca4d6f02a764d078d THE CHARLOTTE DEMOCRAT ChronAm 1881.57397257103 35.227087 -80.843127 tween corn and cotton, I shall take th…	New	new:0.9066147859922179 mew:0.019455252918287938 yet:0.019455252918287938 now:0.019455252918287938 :0.035019455252918164	29240.89
11	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.7733473242392445 on:0.13955928646379853 at:0.022035676810073453 within:0.017543859649122806 ln:0.00944386149003148 :0.03806999134772926…	26897.83
12	2517eb9eca35c47e2e6d4a657c4a9c5b RICHMOND ENQUIRER ChronAm 1852.424863356355 37.538509 -77.43428 Ml". II . <!. Farrell's Arubian Liniment ha…	well	i:0.776824034334764 1:0.07296137339055794 and:0.05394190871369295 what:0.036734693877551024 l:0.02145922746781116 :0.0380787622156229	26891.63
13	033af2cf06b15961da80de1bef035673 RICHMOND ENQUIRER ChronAm 1852.1379781104533 37.538509 -77.43428 i »icy now prupuso to acquiesce and unife …	«»f	of:0.6788321167883211 for:0.12056737588652482 to:0.0948905109489051 or:0.0364963503649635 entirely:0.031055900621118012 :0.03815774539016758…	26835.97
14	c0b9d92f28f115fbc94dd6d59fa12b37 CLARKSVILLE CHRONICLE ChronAm 1869.17397257103 36.527761 -87.35887 arms excent Colt's revolvers. On ar\nriv…	New	new:0.9100123609394314 now:0.029913473423980222 xew:0.011124845488257108 nw:0.005196733481811433 the:0.004202719406674907 :0.039549867259844…	25891.36
15	1aa3574819fc5ae35a94b6cf12e65e6f THE WICHITA CITY EAGLE ChronAm 1880.3647540667375 37.692236 -97.337545 It is therefore pertinent, I thiak, …	af	of:0.849624060150376 ol:0.03759398496240601 oi:0.03759398496240601 four:0.03546099290780142 :0.039726977017010445	25775.94
16	0548a5c9322228a04bc3b5aac668b17b ARIZONA REPUBLICAN ChronAm 1905.1301369545915 33.448587 -112.077346 DEPARTMENT OF THE INTER-\nIOR, "Washing…	D.	d:0.8829676071055381 i:0.034482758620689655 1:0.017763845350052248 p:0.013584117032392894 l:0.009404388714733543 :0.04179728317659348	24499.20
17	03217a2bfc936fe7bf78811851087cf0 RICHMOND ENQUIRER ChronAm 1843.23698626966 37.538509 -77.43428 Fellow-citizens! It appears to me, that a ma…	upon	of:0.8620689655172413 in:0.034482758620689655 i:0.019455252918287938 ot:0.019157088122605363 oi:0.019157088122605363 :0.04567884669857025	22417.38
18	08534dc69e19cc604cfed5e6714e1b1f PULLMAN HERALD ChronAm 1896.8319671814916 46.730427 -117.173895 By virtue of a Decree and Order of\ngale, m…	D	d:0.8596491228070176 u:0.08771929824561403 :0.05263157894736836	19456.00
19	02ddc3a213e07171a82cf2a479224f1b RICHMOND ENQUIRER ChronAm 1836.7090163618195 37.538509 -77.43428 Lord Falmcrstnn observed, that if at th.e …	lie	the:0.8853082973864501 tho:0.04288251712763258 th:0.007366014732029464 tbe:0.006343567622430855 a:0.004322400203407069 :0.053777202928049994…	19041.53
20	21a4004987635d163f83641f4f115d48 THE DICKINSON PRESS ChronAm 1897.905479420345 46.879176 -102.789624 Ill Groceries\n» We carry a full and co…	bs	be:0.8415841584158416 bo:0.033663366336633666 he:0.033663366336633666 lie:0.01768172888015717 have:0.017543859649122806 :0.05586352038161113…	18330.39
21	37f75e370b363f40448e5ac307921be0 THE DICKINSON PRESS ChronAm 1912.703551880945 46.879176 -102.789624 Dickinson, N. D. . September 9th, 1912.…	county	a:0.7525773195876289 his:0.047619047619047616 tho:0.047619047619047616 the:0.047619047619047616 your:0.045871559633027525 :0.058693977922200…	17446.42
22	0d0f4d0397b496ad31f3ddbb26d1d9af LOS ANGELES HERALD ChronAm 1891.001369831304 34.054935 -118.244476 Tuesday morning there passed away\nfrom …	Los	los:0.7969543147208121 loa:0.04568527918781726 ios:0.04568527918781726 io:0.025906735751295335 gos:0.025380710659898477 :0.06038768049235954…	16957.10
23	3c0a79c2abf40e6838bc66d32fd4091f ROCKY MOUNTAIN HUSBANDMAN ChronAm 1877.2589040778792 46.548394 -110.902887 PREPARING WOOL FOR MARKET.\nThe …	admissible,	to:0.8958652373660031 i:0.01386748844375963 o:0.007704160246533128 on:0.007656967840735069 ho:0.007656967840735069 :0.06724917826223398	15226.95
24	bcf3898847dc8339f8065c76d8b59817 RICHMOND ENQUIRER ChronAm 1830.9931506532216 37.538509 -77.43428 -uuaen witiuirawal ol one created for an l…	be	of:0.6589147286821705 in:0.10077519379844961 from:0.0948905109489051 as:0.03875968992248062 on:0.03875968992248062 :0.06790018672551368	15080.96
25	2bcecac3982dcdcce8877554a04cfed6 RICHMOND ENQUIRER ChronAm 1826.064383529934 37.538509 -77.43428 quire, the immense expense of yearly repair…	on	to:0.4782608695652174 by:0.18840579710144928 in:0.13043478260869565 1:0.07692307692307693 through:0.056179775280898875 :0.0697956985206617	14671.39
26	1aed5da15abd7ff69b3886afcc54689a RICHMOND ENQUIRER ChronAm 1818.2726027080162 37.538509 -77.43428 No object is more important, none more att…	ur	or:0.6644591611479028 to:0.16114790286975716 nine:0.05422993492407809 and:0.028446389496717725 8:0.0200445434298441 :0.07167206813170002	14287.30
27	5a6bc613a4f8a4e5e302ba4f79b6d981 RICHMOND ENQUIRER ChronAm 1827.1630136669203 37.538509 -77.43428 effects to society must arise from their g…	necessary	the:0.5428571428571428 a:0.25773195876288657 its:0.047619047619047616 pj^ctii:0.04132231404958678 political:0.03875968992248062 :0.071709846…	14279.77
28	15d740945e6f9c216e175eb550196d09 THE BEAVER HERALD ChronAm 1898.7438355847285 36.816137 -100.519871 Washington, Sept. 17. Tho members\nof th…	tho	the:0.813953488372093 n:0.04132231404958678 in:0.04 necessary:0.032679738562091505 :0.07204445901622869	14213.45
29	071a15ebf554115b250117286c4b1cea THE MEMPHIS APPEAL ChronAm 1887.319178050482 35.149022 -90.051628 tion as to the oppression and wreck-\nage…	tbe	the:0.8241758241758241 tho:0.03296703296703297 its:0.03296703296703297 heo:0.018315018315018316 die:0.018315018315018316 :0.0732600732600732…	13977.60
30	47de41bdd6590affacdd38266798fece RAFTSMAN'S JOURNAL ChronAm 1866.5246575025367 41.02728 -78.439188 obtained your own consent to do that sing…	no	the:0.6218905472636815 a:0.12953367875647667 this:0.12195121951219512 th:0.025380710659898477 tht:0.024875621890547265 :0.07636822191720094	13408.72
31	b5828ab8d65305bd78d78695875075c9 RICHMOND ENQUIRER ChronAm 1824.9193988754807 37.538509 -77.43428 company of R'fl men from Falmouth ;\nn«-xi…	spectacle.	to:0.654320987654321 in:0.1111111111111111 for:0.058823529411764705 from:0.056179775280898875 temporarily:0.042735042735042736 :0.0768295538…	13328.20
32	0487565a2bc670bca08bb8408efc82d3 THE WYANDOT PIONEER ChronAm 1854.4150684614408 40.827279 -83.281309 Sec. 1. Be it enacted by the General As…	all	the:0.6595744680851063 a:0.12781954887218044 no:0.06569343065693431 tbe:0.03546099290780142 this:0.034482758620689655 :0.07696880085728774	13304.09
33	0b144a1e75d1052ab45e98e7f8dd344e THE HOPE PIONEER ChronAm 1883.83698626966 47.32221 -97.72232 below his pockets, a scalloped doublet,\nwith …	very	a:0.6363636363636364 n:0.15151515151515152 so:0.13513513513513514 :0.07698607698607707	13301.11
34	279eab49341650e89e009f69ae918d67 COURIER DEMOCRAT ChronAm 1911.5301369545916 48.76059 -98.367824 Notico is hereby given, that that certain\n…	Page	1:0.2 $:0.2 7:0.2 5:0.2 s4030:0.12195121951219512 :0.07804878048780484	13120.00
35	12ea4cb698b1f421c10f62cd03fc5fd4 RICHMOND ENQUIRER ChronAm 1821.1493150367833 37.538509 -77.43428 Hwittipy Hie shuck'of itu eartbqn.tke whic…	The	a:0.45864661654135336 no:0.2116788321167883 the:0.1773049645390071 $:0.03759398496240601 ho:0.0364963503649635 :0.07827925147548165	13081.37
36	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.8774617067833698 thn:0.011037527593818985 that:0.010940919037199124 lhau:0.010940919037199124 lime:0.010940919037199124 :0.0786780085…	13015.07
37	3157f2eacc1ff8a858ec158c99e3455e RICHMOND ENQUIRER ChronAm 1857.6479451737696 37.538509 -77.43428 [From the Alexandria f»azetto, Asgust itO.…	in	the:0.8299637117677553 tho:0.03784344219803007 a:0.019260801665799063 tbe:0.01918092275790565 new:0.012960082944530845 :0.08079103866597914	12674.67
38	021fc687f08d32bec73ac4b1f6823671 ARIZONA REPUBLICAN ChronAm 1900.691780790208 33.448587 -112.077346 shall be formed, so that no fences shall…	wit:-	the:0.5435952637244349 wit:0.2981700753498385 tho:0.05705059203444564 say:0.013993541442411194 tb:0.005405405405405406 :0.08178512204346444	12520.61
39	0e345585fd26f4ccfb6a8963923fd0fb THE BEAVER HERALD ChronAm 1900.1438355847285 36.816137 -100.519871 ing to clenr a neighborhood of wolves.\n…	In	in:0.7974683544303798 had:0.03734439834024896 what:0.036734693877551024 on:0.02109704641350211 iu:0.02109704641350211 :0.08625846052481612	11871.30
40	0377c84e1d9dced43836684f77c1ce0c WATERBURY EVENING DEMOCRAT ChronAm 1898.5082191463723 41.558153 -73.051497 the Spanish admiral and his crew…	his	the:0.7310924369747899 a:0.09455587392550144 tho:0.047619047619047616 ihe:0.025210084033613446 her:0.014005602240896359 :0.08751695520615133…	11700.59