Metric	Score
PerplexityHashed	283.52

Metric	Score
PerplexityHashed	239.18

worst items

note: the gold standard is taken from the challenge

#	input	expected output	actual output	test-A PerplexityHashed
1	2691d398853461547b101d4edb65ddf9 THE OASIS ChronAm 1910.9794520230848 31.340213 -110.936082 Development continues on the\nBuffalo group, the…	velopment	velop:0.9999469518661499 iversity:1.0861510418180842e-05 ivers:3.1136621601035586e-06 irect:1.9007732134923572e-06 ploy:1.5697142998760683e-…	41698710.71
2	1a1ad69bf7e365aa74b57eb1ca02b178 RICHMOND ENQUIRER ChronAm 1861.519178050482 37.538509 -77.43428 a< r.o gninsayers.\nThere is the very highe…	ri.tin-ru	ern:0.9971056580543518 vernment:0.00082593341358006 eral:0.0005523277795873582 ers:0.00032363575883209705 ernal:0.00020432562450878322 ert:0…	2701387.97
3	019ece7fdd30f8835be875f7094de8a5 THE JASPER WEEKLY COURIER ChronAm 1909.250684899797 38.391448 -86.930874 Tho queon of festivals, as Easter …	ers.	ers:0.9008340239524841 ings:0.08510655164718628 ering:0.011393452994525433 ery:0.0006090893875807524 ered:0.00031169463181868196 ern:0.00030…	2159360.23
4	14453ce06937921547bd704890587cbf EVENING CAPITAL ChronAm 1884.8702185476118 38.97864 -76.492786 Should your soil be new, perhaps a\npiece of…	ficient.	icient:0.9844136238098145 icult:0.011800048872828484 ient:0.001430854550562799 ering:0.00044732115929946303 icial:0.0001984705013455823 cien…	1233654.17
5	5c203724a1d3de91e777939d2a4cf1d0 DEMOCRAT AND SENTINEL ChronAm 1864.9139343946063 40.485194 -78.724957 heart does not throb with emotion at …	wife!	wife:0.9965713024139404 spouse:0.00037692429032176733 husband:0.00033444029395468533 Wife:0.0003329715982545167 wives:0.00029027651180513203…	1126918.15
6	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9937450289726257 Miss:0.002726652193814516 Mrs:0.0006769926403649151 Mr:0.000665942847263068 Ms:0.00024035637034103274 M:0.00023665030…	1002092.18
7	29fcd0e91abf8f2f456fd01ce98ef9b4 THE REVIEW ChronAm 1915.0561643518517 35.955692 -80.005318 The most important bill offered in\nthe legislat…	ing,	ers:0.9102087616920471 ings:0.07115639001131058 ery:0.005576626397669315 ily:0.004316152073442936 ing:0.0022550569847226143 ering:0.00178513…	905061.11
8	1879f42e9e0de79a444c78db0bd0aa4a ARIZONA REPUBLICAN ChronAm 1913.1575342148656 33.448587 -112.077346 point 22o feet west of the west line 01…	lino	line:0.9967076778411865 side:0.0003900381561834365 -:0.00030146283097565174 end:0.00027698418125510216 lines:0.0001667745236773044 of:0.0001…	695935.67
9	1113eae3406eef90c2c179690e2aa702 THE WICHITA CITY EAGLE ChronAm 1879.3493150367833 37.692236 -97.337545 population of Leavenworth, has two\n…	den	ies:0.9007188081741333 ers:0.08268831670284271 ings:0.008284368552267551 ied:0.0019678412936627865 ial:0.0007300864672288299 ying:0.00071642…	681092.10
10	2f20c5e34082c919371200e6a1159565 ARIZONA REPUBLICAN ChronAm 1912.56420761865 33.448587 -112.077346 Accompanying this showing will be\na requ…	sides,	sides:0.9908180236816406 the:0.004418105818331242 parties:0.001196239609271288 side:0.0008963770233094692 teams:0.00021610927069559693 cases…	652631.40
11	59dd736bfb81e37fabddf11899748f46 THE STAR OF THE NORTH ChronAm 1860.889344230672 41.004121 -76.453816 of domestic felicity. The existence of…	trust	velop:0.9762875437736511 ertain:0.013385117053985596 rage:0.00427072960883379 ert:0.0007641815464012325 ire:0.0007465005619451404 ourage:0.0…	582704.27
12	1b515315af748c90c2045b91dd516e0d ELK CITY MINING NEWS ChronAm 1911.6452054477422 45.78769 -115.200118 Oats—Condition 65.7 per cent of a\nnor…	average.	average:0.9941198825836182 averages:0.0009254306205548346 avg:0.0005203621694818139 ,:0.00032361826742999256 mean:0.0003107153461314738 annu…	508822.15
13	ba5e6082e79f1cccd1664d23646779f7 RAFTSMAN'S JOURNAL ChronAm 1865.5849314751395 41.02728 -78.439188 An open window with the direct rays of\nt…	ed	ied:0.9392253160476685 ished:0.026822155341506004 ized:0.013580018654465675 ised:0.005749680567532778 ited:0.004187919199466705 ily:0.001503…	353190.00
14	3864e02c4c3867d4cf58f4b7326eb561 THE JASPER WEEKLY COURIER ChronAm 1917.2808218860985 38.391448 -86.930874 know what women will accept, for …	another,	another:0.8922969102859497 the:0.05639522150158882 other:0.04502213001251221 in:0.0006957185105420649 a:0.0004392857663333416 some:0.0003939…	329766.95
15	0651c4f5c7788f83510b2a8976e58e3e BRADFORD OPINION ChronAm 1877.3986301052764 43.994599 -72.127742 1 have got to say something about\nthe Car…	ments.	ings:0.729247510433197 ments:0.20840436220169067 ents:0.03143547102808952 ers:0.007935778237879276 ive:0.006810000166296959 ives:0.002779266…	327572.52
16	0c8c1948dd06dabb9d447e60570cb071 LA JUNTA TRIBUNE ChronAm 1898.7876712011669 37.985009 -103.543832 "It will be borne In mind that the\ntroop…	follows:	follows:0.9501091837882996 fol:0.01860090345144272 follow:0.01843978837132454 following:0.0032394379377365112 followed:0.0015740536618977785…	259687.27
17	45d9b37949b2601721c458bf4a1c5a5e CLARKSVILLE CHRONICLE ChronAm 1861.4123287354134 36.527761 -87.35887 15. The right of the people to be secu…	de-	deprived:0.9893033504486084 compelled:0.001976352883502841 outlawed:0.0006654456374235451 subjected:0.0006246872944757342 denied:0.000443812…	252070.54
18	6a1ff8cbc825412d743f841cf5352b64 THE STAR OF THE NORTH ChronAm 1850.0452054477423 41.004121 -76.453816 We look upon the pructiceofelectingme…	mands	velop:0.9920405745506287 igh:0.0006382092251442373 ivers:0.0006097249570302665 irect:0.0005276972078718245 ert:0.0002736163733061403 xt:0.00…	249841.78
19	16b9eb2107c6352464ca43134f296b01 THE JASPER WEEKLY COURIER ChronAm 1917.2999999682902 38.391448 -86.930874 know what women will accept, for …	another,	another:0.8796545267105103 the:0.0640704482793808 other:0.04820355027914047 in:0.0009100356255657971 a:0.0005308575928211212 some:0.00045890…	247231.51
20	525f291294207246600f444e5ee435c0 RICHMOND ENQUIRER ChronAm 1830.0616438039067 37.538509 -77.43428 lieve that a portion of it always will be …	by	ings:0.5042692422866821 ers:0.4803297817707062 ents:0.0021439739502966404 ering:0.0020406441763043404 ies:0.0013473550789058208 ery:0.001287…	244943.84
21	0b4f47c072781044dc785153b75ff5b4 THE WYANDOT PIONEER ChronAm 1860.872950788049 40.827279 -83.281309 We are enabled here to offer the communi…	tion.	ents:0.8940101265907288 ional:0.04500746354460716 ient:0.019733935594558716 ency:0.0059921713545918465 ions:0.005982093047350645 ive:0.00509…	213472.88
22	423b124d513ea6d46dc9f1ba079d3b57 RAFTSMAN'S JOURNAL ChronAm 1859.2041095573313 41.02728 -78.439188 Lawrence Cocxtt. George Martin, son of\nm…	expected.	expected:0.9536991715431213 hoped:0.025175580754876137 wished:0.0029387669637799263 desired:0.0025930495467036963 done:0.002267617965117097 …	209892.03
23	2a6dd6f3c1630663d67d93b91e99fe8a RAFTSMAN'S JOURNAL ChronAm 1859.5438355847286 41.02728 -78.439188 The distinction, however, between these\n…	be	ia:0.9815003871917725 ian:0.0027421722188591957 iz:0.002227427903562784 ili:0.0013644708087667823 ives:0.0007646874291822314 ills:0.00071622…	161688.34
24	3ff22426092d3a6869b2bd48364ba5f2 RAFTSMAN'S JOURNAL ChronAm 1858.9356164066464 41.02728 -78.439188 aware that the earliest and the best frui…	tages.	ices:0.8780823945999146 ents:0.07743527740240097 ages:0.016052989289164543 ies:0.005669428501278162 ICES:0.0030408429447561502 ers:0.0025267…	161651.82
25	1a9b1795a77d050c3a5914bc4c23a0e0 DEMOCRATIC MESSENGER ChronAm 1919.1438355847285 38.177063 -75.392696 all the following real estate hy the\n…	seip.	se:0.9702754020690918 se:0.013916974887251854 seq:0.00497355917468667 Se:0.0013381673488765955 s:0.001096343738026917 sec:0.0004394111747387…	160884.29
26	1617fc516278396df91b7eee8876b1b3 DEMOINE COURIER ChronAm 1854.5301369545916 41.020015 -92.411296 7 he Most Wonderful Itemed<f\nT7* V KR used…	ing,	ings:0.7505048513412476 ers:0.21803663671016693 ing:0.011168675497174263 ingly:0.0029711343813687563 ing:0.0028479427564889193 ering:0.00229…	154467.52
27	2d3c2ade86d27881ee102cdce29baff6 CENTRE DEMOCRAT ChronAm 1861.1794520230847 40.913486 -77.773747 iron uot otherwise provided for, thirty per…	valorem	val:0.9889106750488281 val:0.0009165656520053744 v:0.0008555443491786718 -:0.0007278364500962198 vo:0.00021753719192929566 Val:0.00016559082…	150351.11
28	8166145a1546f64b2a5f831d625b983a THE CHARLOTTE DEMOCRAT ChronAm 1872.1188524273932 35.227087 -80.843127 tion as will induce him to use it on…	Phosphate	Ph:0.979296863079071 F:0.004909162409603596 Comp:0.00176592031493783 P:0.0014674365520477295 phosph:0.0007728235214017332 ph:0.0007395786815…	142005.86
29	4911b35775a00fd595f91b9defd5a4e4 THE NEW NORTH-WEST ChronAm 1877.4342465436328 46.395761 -112.730038 N ti4ce is hereby given that William T.…	chains:	chains:0.9815741181373596 chains:0.004441655706614256 Chains:0.002279991749674082 chain:0.001869448460638523 ch:0.00048417094512842596 -:0.0…	139558.01
30	7ae25aeded89b4cda4d417ca47a18542 RICHMOND ENQUIRER ChronAm 1848.2773223727484 37.538509 -77.43428 The mat'.er reported to the Assembly at i;…	essed	ected:0.7854510545730591 anded:0.15527988970279694 ended:0.028824958950281143 ect:0.014330771751701832 lied:0.0018550163367763162 ensed:0.00…	137347.74
31	0c6efe832f549afeeed54dc5dad18a79 WATERBURY EVENING DEMOCRAT ChronAm 1890.1191780504819 41.558153 -73.051497 The second trait considered was …	blood.	blood:0.9780580401420593 their:0.0028930839616805315 human:0.0026726429350674152 the:0.0017623259918764234 innocent:0.0012333198683336377 Bl…	128192.66
32	722be35b48622205b21132839ce2809c MOUNTAIN HOME REPUBLICAN ChronAm 1924.1434425913276 43.13295 -115.691197 CHRIS S. HOLST , HATTIE HOLST,\nan…	Counties,	Count:0.8243513107299805 counties:0.07447020709514618 County:0.05161771550774574 county:0.023189349099993706 ,:0.011793319135904312 Co:0.001…	120611.26
33	1a4d8480064e27a48ebc052fe9d47b11 THE EMPIRE COUNTY ARGUS ChronAm 1854.6890410641806 38.799901 -120.890216 On the amount of postage on letter…	pf	of:0.9734463691711426 -:0.004975363612174988 o:0.0034913867712020874 and:0.0016858080634847283 ot:0.0012830010382458568 the:0.00117857579607…	120184.33
34	039eead30217414e210935aa97c52752 ARIZONA REPUBLICAN ChronAm 1896.4822404055353 33.448587 -112.077346 Section 1. The fiscal year for the City…	oi	of:0.969835102558136 o:0.007304059807211161 ot:0.0030438851099461317 in:0.002833775943145156 ol:0.0022746350150555372 ,:0.001129921642132103…	120179.28
35	0349558a29ec5f70c68da27ec5735439 THE CHARLOTTE DEMOCRAT ChronAm 1872.443989039415 35.227087 -80.843127 Sec. 8. That there shall be appointed…	law.	law:0.9366775751113892 the:0.030021194368600845 this:0.008236986584961414 statute:0.0032441015355288982 said:0.0027534645050764084 act:0.002…	118707.80
36	3cf87073e97e6b146b4dc01faa3418b8 THE HOPE PIONEER ChronAm 1921.9164383244547 47.32221 -97.72232 Notice ia hereby given that that certain\nre…	January,	November:0.2188045084476471 December:0.14434289932250977 February:0.11393150687217712 March:0.08297322690486908 June:0.0742407962679863 Janu…	116821.37
37	2c0d95582280cbfe0d09338e19d935c6 ARIZONA REPUBLICAN ChronAm 1910.5136985984273 33.448587 -112.077346 The voters of this district should\nbe …	grounds.	grounds:0.9592525362968445 ground:0.01199124101549387 premises:0.009612085297703743 lands:0.004645575303584337 site:0.0013377595460042357 si…	116721.38
38	c7570094e5a80c9758757c2f35366f3e RICHMOND ENQUIRER ChronAm 1845.1191780504819 37.538509 -77.43428 Mr. DANIEL of Princc George withdrew the\n…	section,	section:0.9710659980773926 Section:0.005529902409762144 sec:0.0018097205320373178 part:0.0017947040032595396 and:0.0013860240578651428 claus…	115415.77
39	4197d22c241f4173bdeb0bcb10c30b92 THE NEW NORTH-WEST ChronAm 1877.3575342148656 46.395761 -112.730038 N Mticein hereby given that William T. …	chains;	chains:0.9632097482681274 chain:0.021035363897681236 Chains:0.002814625157043338 -:0.00071123824454844 ,:0.00039094421663321555 Chain:0.0003…	108161.04
40	09ed47a77659c979861e04f00881ccf3 THE BEAVER HERALD ChronAm 1905.568493118975 36.816137 -100.519871 sped quickly upstairs, then along the\nco…	ed	ers:0.9123687148094177 ingly:0.029433313757181168 ings:0.017401745542883873 ership:0.009174116887152195 ery:0.005757986102253199 ing:0.00285…	107369.45