Metric	Score
PerplexityHashed	427.45

Metric	Score
PerplexityHashed	381.39

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	a:0.9153976311336718 1:0.01861252115059222 k:0.01861252115059222 be:0.018302828618968387 11:0.018302828618968387 :0.010771669327207078	95064.19
2	5e8bbd887fa4b5368e011e5add115273 RICHMOND ENQUIRER ChronAm 1825.97397257103 37.538509 -77.43428 General Assembly. that it a law lc pas-td lo…	in	of:0.92988606485539 op:0.018404907975460124 ot:0.018404907975460124 f:0.009725906277630416 ok:0.009640666082383875 :0.01393754683367543	73470.61
3	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	a:0.9600798403193613 ai:0.02152641878669276 :0.018393740893945854	55671.11
4	0548a5c9322228a04bc3b5aac668b17b ARIZONA REPUBLICAN ChronAm 1905.1301369545915 33.448587 -112.077346 DEPARTMENT OF THE INTER-\nIOR, "Washing…	D.	d:0.8737083811710677 i:0.04707233065442021 1:0.02411021814006889 p:0.012629161882893229 5f:0.012485811577752555 :0.02999409657379748	34140.05
5	b541bf086ba2358b61d7928162ce5b61 RICHMOND ENQUIRER ChronAm 1829.9219177765094 37.538509 -77.43428 PUBLIC AUCTION.—By virtue of a deed of\ntr…	ol	of:0.8911070780399274 ot:0.056261343012704176 01:0.019963702359346643 :0.03266787658802184	31345.78
6	c0b9d92f28f115fbc94dd6d59fa12b37 CLARKSVILLE CHRONICLE ChronAm 1869.17397257103 36.527761 -87.35887 arms excent Colt's revolvers. On ar\nriv…	New	new:0.914173045697054 now:0.025748086290883782 xew:0.01183020180932498 nw:0.004882585445245292 hew:0.0048712595685455815 :0.0384948211889463…	26600.98
7	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.7336293007769146 on:0.1453940066592675 within:0.032943676939426146 at:0.02330743618201998 ln:0.02330743618201998 :0.04141814326035176	24723.46
8	2517eb9eca35c47e2e6d4a657c4a9c5b RICHMOND ENQUIRER ChronAm 1852.424863356355 37.538509 -77.43428 Ml". II . <!. Farrell's Arubian Liniment ha…	well	i:0.696969696969697 1:0.1341991341991342 and:0.08366533864541832 what:0.0421455938697318 :0.04302023631601859	23802.75
9	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.8866213151927438 and:0.04656319290465632 pieceor:0.022403258655804482 :0.04441223324679544	23056.71
10	09726909c77f27023d0f3d2206b97f8d ARIZONA REPUBLICAN ChronAm 1904.0341529738414 33.448587 -112.077346 A week or so later he sent another\nreq…	New	new:0.8561151079136691 now:0.05675459632294164 xew:0.024780175859312553 ne:0.008863819500402902 naw:0.008792965627498003 :0.0446933347761757…	22911.69
11	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	new:0.8561151079136691 now:0.05675459632294164 xew:0.024780175859312553 ne:0.008863819500402902 naw:0.008792965627498003 :0.0446933347761757…	22911.69
12	3c0a79c2abf40e6838bc66d32fd4091f ROCKY MOUNTAIN HUSBANDMAN ChronAm 1877.2589040778792 46.548394 -110.902887 PREPARING WOOL FOR MARKET.\nThe …	admissible,	to:0.8706099815157117 on:0.02033271719038817 you:0.019963702359346643 high:0.0196078431372549 delaying:0.018302828618968387 :0.0511829271783…	20006.67
13	0377c84e1d9dced43836684f77c1ce0c WATERBURY EVENING DEMOCRAT ChronAm 1898.5082191463723 41.558153 -73.051497 the Spanish admiral and his crew…	his	the:0.7180043383947939 a:0.0929705215419501 tho:0.08893709327548806 her:0.023861171366594363 entering:0.02152641878669276 :0.054700456634480…	18720.14
14	02ddc3a213e07171a82cf2a479224f1b RICHMOND ENQUIRER ChronAm 1836.7090163618195 37.538509 -77.43428 Lord Falmcrstnn observed, that if at th.e …	lie	the:0.8822297827793771 tho:0.03951845066736456 th:0.008134347940173182 a:0.0055248618784530384 tbe:0.005495943470295734 :0.05909661326433635…	17327.56
15	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.8711755233494364 that:0.0177133655394525 lhau:0.0177133655394525 lime:0.0177133655394525 encouraging:0.015918958031837918 :0.05976542…	17133.65
16	021866549bdf587d1f6f63a5e6417e91 GREAT FALLS DAILY TRIBUNE ChronAm 1920.3975409519835 47.504885 -111.291891 In the District court of the Eig…	its	the:0.8262757871878393 tho:0.06623235613463627 his:0.022801302931596094 a:0.012208657047724752 ht:0.01207464324917673 :0.060407253449026754	16951.61
17	0ab7bd7affaf9f123bda6e08ea161ef6 DEMOCRATIC MESSENGER ChronAm 1889.1082191463724 38.177063 -75.392696 We desire to thank the many new-\nper-…	this	the:0.8199672667757775 tho:0.05073649754500818 any:0.01800327332242226 til:0.01800327332242226 his:0.01800327332242226 :0.07528641571194761	13601.39
18	0e345585fd26f4ccfb6a8963923fd0fb THE BEAVER HERALD ChronAm 1900.1438355847285 36.816137 -100.519871 ing to clenr a neighborhood of wolves.\n…	In	in:0.8406374501992032 on:0.043824701195219126 about:0.03914590747330961 :0.0763919411322681	13404.56
19	1aed5da15abd7ff69b3886afcc54689a RICHMOND ENQUIRER ChronAm 1818.2726027080162 37.538509 -77.43428 No object is more important, none more att…	ur	or:0.6188747731397459 to:0.147005444646098 nine:0.0893169877408056 by:0.038112522686025406 er:0.019963702359346643 :0.08672656942797852	11807.22
20	966db087909dd7edbeb3852d0d303adf RICHMOND ENQUIRER ChronAm 1826.0945205162354 37.538509 -77.43428 performed their whole duty in the matter. …	that	the:0.7243107769423559 said:0.0780338794779228 this:0.0502638156067759 a:0.03108373004760571 tho:0.028125870231133387 :0.08818192769420641	11612.36
21	cfca438e9a1d89824d1d3d5a792a41be RICHMOND ENQUIRER ChronAm 1829.001369831304 37.538509 -77.43428 My will, have opposition. It may he for tlw…	bo	be:0.6858638743455496 he:0.05759162303664921 ik:0.05759162303664921 lie:0.05472636815920398 tie:0.05472636815920398 :0.08950014326274403	11441.32
22	06ea1c5e069d5ec88810b8df92a9941f THE EMPIRE COUNTY ARGUS ChronAm 1855.9931506532216 38.799901 -120.890216 preventative against Syphilitic an…	J.	j:0.9099099099099099 :0.09009009009009006	11366.40
23	7569c23ae5ea2567963700bc346204b9 RICHMOND ENQUIRER ChronAm 1823.9493150367834 37.538509 -77.43428 uk iiml exeetiliug a system of internal im…	Was	is:0.5396258145890267 was:0.22694489181429875 are:0.06729220642812128 were:0.06094744944370583 being:0.014754212992098456 :0.090435424732749…	11323.00
24	3157f2eacc1ff8a858ec158c99e3455e RICHMOND ENQUIRER ChronAm 1857.6479451737696 37.538509 -77.43428 [From the Alexandria f»azetto, Asgust itO.…	in	the:0.8242089402310396 tho:0.03063787041687594 a:0.0258751902587519 new:0.0155700652938222 tbe:0.01054746358613762 :0.0931604702133727	10991.79
25	03217a2bfc936fe7bf78811851087cf0 RICHMOND ENQUIRER ChronAm 1843.23698626966 37.538509 -77.43428 Fellow-citizens! It appears to me, that a ma…	upon	of:0.8009950248756219 in:0.1044776119402985 :0.09452736318407962	10832.84
26	7cee156c97098384b8ed473c496c6341 RICHMOND ENQUIRER ChronAm 1817.209589009386 37.538509 -77.43428 laborer is enjoying all the pleasures con-\…	a	the:0.7816593886462883 our:0.044153323629306164 this:0.039111540318686626 tho:0.029597282872392043 th:0.010238907849829353 :0.09523955668349…	10751.84
27	15c214caa0d8d1a1233c72a8311e17ad ARIZONA REPUBLICAN ChronAm 1909.3301369545916 33.448587 -112.077346 It is quite time the people of Tempe\na…	it	i:0.46564885496183206 he:0.2907801418439716 we:0.07801418439716312 they:0.06832298136645963 :0.09723383743057357	10531.31
28	c83d4ad9b7dc44819a0abe4ff7487b63 RICHMOND ENQUIRER ChronAm 1818.4753424340436 37.538509 -77.43428 tie it enacted by the Senate and House of …	ol	of:0.6685082872928176 as:0.06077348066298342 to:0.06077348066298342 but:0.05759162303664921 with:0.05472636815920398 :0.09762676018536243	10488.93
29	2c62724fc23779fefeffc0d44eaf2e2d THE STAR OF THE NORTH ChronAm 1864.7226775640052 41.004121 -76.453816 are soon broken down to the yoke. The…	ty,	2:0.34065934065934067 47:0.20792079207920794 h:0.1208791208791209 m:0.1208791208791209 ti:0.10891089108910892 :0.10075073441410065	10163.70
30	ce3b8b04816157ffabc773ec11ad42f0 RICHMOND ENQUIRER ChronAm 1825.3931506532217 37.538509 -77.43428 cient data /or * ^errect calculation of tU…	a	the:0.8281786941580757 aaiu:0.036544850498338874 twenty:0.034267912772585674 :0.10100854257099978	10137.76
31	0b9cfb344fdb68e5061d717fbf496eca RICHMOND ENQUIRER ChronAm 1819.146575310756 37.538509 -77.43428 their incursions against us, and, having\nc…	their	the:0.7449521785334751 tho:0.05419766206163656 this:0.04311251314405888 a:0.033659066232356136 our:0.022316684378320937 :0.10176189565015248…	10062.71
32	d7fa1b06971f8f9ba60549f7b15056b1 RICHMOND ENQUIRER ChronAm 1834.4589040778792 37.538509 -77.43428 S’inary changes and derangements, will be …	the.	the:0.5940959409594097 his:0.1143911439114391 their:0.10652920962199312 tin:0.04059040590405904 tbe:0.04059040590405904 :0.10380289369904006…	9864.85
33	11a618922a619ac74b505d8e1e13f9c2 COURIER DEMOCRAT ChronAm 1911.5876712011668 48.76059 -98.367824 Order Hearing Petition for Sale of Land\nUp…	to.	to:0.8245614035087718 o:0.06832298136645963 :0.10711561512476853	9559.76
34	071a15ebf554115b250117286c4b1cea THE MEMPHIS APPEAL ChronAm 1887.319178050482 35.149022 -90.051628 tion as to the oppression and wreck-\nage…	tbe	the:0.7609561752988048 heo:0.043824701195219126 tho:0.043824701195219126 die:0.043824701195219126 :0.10756972111553798	9519.41
35	12ea4cb698b1f421c10f62cd03fc5fd4 RICHMOND ENQUIRER ChronAm 1821.1493150367833 37.538509 -77.43428 Hwittipy Hie shuck'of itu eartbqn.tke whic…	The	a:0.5041322314049587 no:0.2366412213740458 the:0.14893617021276598 :0.11029037700822963	9284.58
36	9eba7c9533cba430ed5be1bd429c8a94 RICHMOND ENQUIRER ChronAm 1829.3301369545916 37.538509 -77.43428 again committed which could only bd\ntied …	also	is:0.6680497925311204 the:0.08366533864541832 a:0.04761904761904762 in:0.04564315352697096 was:0.043824701195219126 :0.11119796648222358	9208.80
37	447ca324b991e9f22787e13a31980574 THE STAR OF THE NORTH ChronAm 1856.236338766191 41.004121 -76.453816 The feci is, we have in the United Sta…	this	a:0.45945945945945943 his:0.1603053435114504 in:0.09090909090909093 to:0.09090909090909093 the:0.08396946564885498 :0.11444754956205327	8947.33
38	87f7dd7699fc2fc5b7cd0151caedd907 THE ELKO INDEPENDENT ChronAm 1871.03698626966 40.832421 -115.763123 Directors.<ien. Addison, L. Page, Willi…	iu	from:0.40199335548172754 in:0.3238434163701067 therefrom:0.08831908831908832 t:0.04059040590405904 theiefrutu:0.030470914127423823 :0.114782…	8921.20
39	2bfa2ab7c2194bcca4d6f02a764d078d THE CHARLOTTE DEMOCRAT ChronAm 1881.57397257103 35.227087 -80.843127 tween corn and cotton, I shall take th…	New	new:0.8850574712643678 :0.11494252873563215	8908.80
40	021fc687f08d32bec73ac4b1f6823671 ARIZONA REPUBLICAN ChronAm 1900.691780790208 33.448587 -112.077346 shall be formed, so that no fences shall…	wit:-	the:0.48255114320096276 wit:0.3501805054151625 tho:0.025270758122743684 tb:0.013398294762484777 tj3:0.013237063778580025 :0.1153622347200662…	8876.39