Metric	Score
PerplexityHashed	263.30

Metric	Score
PerplexityHashed	232.15

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	to:0.32220086455345154 of:0.17541475594043732 in:0.05139753967523575 for:0.04889164865016937 from:0.03233587369322777 are:0.0255313199013471…	79325.47
2	aaf2c727d944cdb5458c41ee8ae527e2 RICHMOND ENQUIRER ChronAm 1833.2698629819888 37.538509 -77.43428 that it ia only necessary to say th.it som…	there;	of:0.773250937461853 and:0.026969604194164276 ot:0.013245470821857452 in:0.008521771058440208 for:0.008026202209293842 to:0.0070933299139142…	65275.73
3	425de22ab4cbbe437665a39d8282a66a THE WASHINGTONIAN ChronAm 1845.4890410641806 38.894955 -77.036646 cause are as five to one, and they only w…	expresses	to:0.41689765453338623 in:0.0487530343234539 for:0.04232901334762573 that:0.03804785758256912 the:0.037896838039159775 with:0.03185723721981…	61780.30
4	001ef5d0be696bbaef13cbc4bae74927 PULLMAN HERALD ChronAm 1895.683561612126 46.730427 -117.173895 for several years how some :rra;n\nbuyers on…	willbe	of:0.5454072952270508 is:0.042967889457941055 in:0.040310900658369064 was:0.03651493042707443 that:0.029106076806783676 and:0.02034824900329…	60226.66
5	c70e7b003bdb1ab83bc3ff37571dacca RICHMOND ENQUIRER ChronAm 1837.1082191463724 37.538509 -77.43428 lie submitted the petitions, the whole num…	liy	by:0.3313741087913513 in:0.10412237793207169 to:0.0679381713271141 at:0.04190162941813469 the:0.033505119383335114 a:0.03325723856687546 tha…	52992.73
6	607b99895f3593172d93044ff219c248 RICHMOND ENQUIRER ChronAm 1817.1904109271943 37.538509 -77.43428 The power to regulate commerce a-\nmongthe…	“common	of:0.6073703169822693 and:0.05556996166706085 that:0.015456097200512886 for:0.011869475245475769 is:0.011391188949346542 as:0.01029722020030…	47646.20
7	4a352d5df0eead57d4320c7f0578eecc RICHMOND ENQUIRER ChronAm 1859.228767091578 37.538509 -77.43428 PROTECTION OF 8LA VERY IN MEXICO.\nThe Terr…	(	of:0.6496878266334534 to:0.0576908215880394 in:0.020466124638915062 and:0.01583954133093357 ot:0.010212138295173645 that:0.01005144976079464…	46704.30
8	18cd8ee77ca14c215b0b797c8c436966 LOS ANGELES HERALD ChronAm 1909.028767091578 34.054935 -118.244476 SAN BERNARDINO, Jan. 10 . —Offi-\ncers l…	Koenig-	that:0.22324657440185547 the:0.17987583577632904 a:0.050653696060180664 what:0.040984444320201874 how:0.033391572535037994 to:0.019354330375…	45026.92
9	7c47a497632bb62477591f9819607f7d THE NEW NORTH-WEST ChronAm 1878.4698629819889 46.395761 -112.730038 I do not complain of this at all, becau…	po	of:0.20230616629123688 and:0.06404536217451096 is:0.058146119117736816 in:0.03539754077792168 was:0.03161979094147682 the:0.0312842540442943…	42706.15
10	39d72465e66cb5286ac3fd2e58dbec34 THE WICHITA CITY EAGLE ChronAm 1877.1821917491122 37.692236 -97.337545 past summer broken 2,500 acrss, and\…	wc	of:0.22433039546012878 for:0.09548945724964142 to:0.06418439000844955 and:0.05424568057060242 in:0.04953109845519066 from:0.0225886702537536…	37809.50
11	3e696de11e68313472a0e1551fb62c13 ARIZONA REPUBLICAN ChronAm 1915.491780790208 33.448587 -112.077346 tion of the following avenues with\nAdam…	hereinafter	of:0.3640722632408142 and:0.1309242993593216 for:0.08615123480558395 to:0.0394037663936615 is:0.027928056195378304 was:0.02438005618751049 w…	37647.86
12	8f97bdb915a6a3ffa901b32896010c10 THE JASPER WEEKLY COURIER ChronAm 1883.741095858701 38.391448 -86.930874 propoaitfosi ta scum such terms as…	ior	and:0.08371294289827347 for:0.07289820909500122 to:0.05815978720784187 of:0.057731207460165024 in:0.04878843203186989 that:0.036092605441808…	36773.19
13	52c8749bba53ec321531bad0f754c2c2 RICHMOND ENQUIRER ChronAm 1860.4549180011638 37.538509 -77.43428 Mr. Itayard, from the commltiee on the jud…	ent	to:0.1998700052499771 of:0.14038343727588654 that:0.07648686319589615 and:0.05688157305121422 is:0.030502676963806152 was:0.0282749272882938…	36351.65
14	198e18f8b1949f288d9f917e01f99cfb RICHMOND ENQUIRER ChronAm 1831.9794520230848 37.538509 -77.43428 f fl 1 HE undersigned proposes to sell 50,…	great	and:0.09107072651386261 to:0.05081500485539436 of:0.048470985144376755 that:0.04170005023479462 who:0.031042039394378662 are:0.0276030860841…	33261.64
15	40e079ba27f7a185d1469cba2af14d78 RICHMOND ENQUIRER ChronAm 1839.37397257103 37.538509 -77.43428 eo by the President; and in many, those prej…	»nt	of:0.25629228353500366 and:0.12569144368171692 in:0.04601326584815979 is:0.03717369586229324 which:0.028396470472216606 or:0.027285054326057…	33189.85
16	e4826c020d9f4b55389aef1d013602da THE WYANDOT PIONEER ChronAm 1866.6999999682903 40.827279 -83.281309 Andrew Johnson is responsible for all\n…	up-	of:0.4039023220539093 and:0.04941285029053688 in:0.04443224519491196 was:0.03540751710534096 to:0.029903335496783257 with:0.0284660272300243…	32675.44
17	061998691abf3c78a47527af21e21aba WATERBURY EVENING DEMOCRAT ChronAm 1907.9657533929478 41.558153 -73.051497 tors have put up have changed ha…	thnt	of:0.2492978721857071 and:0.07580766081809998 in:0.02341640740633011 to:0.019774485379457474 will:0.019519777968525887 are:0.018554994836449…	32617.36
18	8264e8f56765cfbe563b1983e73dd85c RICHMOND ENQUIRER ChronAm 1850.719178050482 37.538509 -77.43428 As soon as the scheme of the Administration…	admitted	of:0.4027783274650574 was:0.03900298476219177 is:0.0280904620885849 the:0.027708452194929123 in:0.024984704330563545 to:0.02233557403087616 …	32439.85
19	6a91fa7e91ff0b2e402d7931f596b92f RICHMOND ENQUIRER ChronAm 1827.6369862696602 37.538509 -77.43428 -'■ip* lor the l’oro», intending to procee…	|	to:0.2211318165063858 of:0.20793023705482483 for:0.16075670719146729 in:0.03840986639261246 at:0.023711267858743668 and:0.023011058568954468…	31214.36
20	0985db88339a08ffcf4ad3d863235b74 THE DICKINSON PRESS ChronAm 1885.0068492833586 46.879176 -102.789624 ("Haggion Oros," the holy mountain\nof…	ft	by:0.09014963358640671 the:0.08976402878761292 of:0.06785973906517029 a:0.06714184582233429 in:0.05788194388151169 and:0.046811990439891815 …	30996.02
21	b92a23883605606abbe38437fa519b9f RICHMOND ENQUIRER ChronAm 1832.5122950503442 37.538509 -77.43428 try 1 lour hi general, and making some val…	th»ir	for:0.11109469085931778 to:0.08813102543354034 in:0.0530339851975441 upon:0.05236754193902016 and:0.03803779184818268 on:0.03522889688611030…	30187.78
22	36757a12c376d999c6af2726c1118cea RAFTSMAN'S JOURNAL ChronAm 1864.1871584383223 41.02728 -78.439188 "The undersigned, who, by original ap-\np…	inthe	to:0.8419459462165833 by:0.01157444342970848 with:0.008649298921227455 that:0.007877127267420292 to,:0.007492275908589363 and:0.006831720005…	29808.58
23	3ccb8903d1f81845930c7843d7e0c165 RICHMOND ENQUIRER ChronAm 1837.064383529934 37.538509 -77.43428 was a man of clear and vigorous mind, of in…	lien	the:0.17251619696617126 he:0.06444701552391052 it:0.04844481125473976 they:0.041953589767217636 there:0.029401959851384163 I:0.0240287631750…	28973.52
24	5245a476d4a17892fdb1bd6c8028ded5 THE CHARLOTTE DEMOCRAT ChronAm 1878.719178050482 35.227087 -80.843127 the Bishops' pulpit, is a long bench …	allotted	of:0.21699321269989014 and:0.06342785060405731 in:0.05097058042883873 for:0.04385189712047577 that:0.025097308680415154 as:0.024106662720441…	28925.62
25	054d3ae2d462f8f99310816383fbf6f7 RICHMOND ENQUIRER ChronAm 1835.7246575025367 37.538509 -77.43428 aged about 23 years, of light complexion, …	chicily	of:0.17772434651851654 in:0.15556477010250092 by:0.09490147978067398 and:0.04418445751070976 the:0.03741055727005005 with:0.0327531024813652…	28375.77
26	bce31631920f7238e593f7375aaf86b5 RICHMOND ENQUIRER ChronAm 1829.541095858701 37.538509 -77.43428 t--M to obtain the finds necessary to suppl…	fail,	of:0.13970902562141418 and:0.12327112257480621 to:0.08839630335569382 for:0.049788761883974075 are:0.032173458486795425 were:0.0267448537051…	28242.07
27	0f454586967d73c64eaa4d0e5f44dde3 THE JASPER WEEKLY COURIER ChronAm 1873.6205479134958 38.391448 -86.930874 to relnto a reply which he onco m…	stretches	and:0.2600597143173218 but:0.09156583249568939 that:0.024751976132392883 he:0.02248193509876728 the:0.021143248304724693 to:0.01905087940394…	28115.26
28	14cb52f1e290ab5ea1f0da656cf44c5d RICHMOND ENQUIRER ChronAm 1854.7547944888381 37.538509 -77.43428 work our weariness; vet infancy lungctli a…	hi::'.	the:0.18802182376384735 that:0.10562492161989212 a:0.046070344746112823 how:0.04379632696509361 what:0.03675854951143265 him:0.0266658458858…	27786.83
29	44b442cdc0b335449418daaeea559937 THE MINERS ChronAm 1852.993169367284 42.500622 -90.664797 It is a question whether the waters of the La\n'l…	[if	and:0.055378712713718414 in:0.05153084173798561 a:0.04264574125409126 the:0.041918765753507614 with:0.034542061388492584 by:0.03434336557984…	27757.19
30	3925ee631db68a7ce6866932dfb77942 THE WICHITA CITY EAGLE ChronAm 1876.7609289301254 37.692236 -97.337545 "Well, name your day, and give me\nt…	expec-	and:0.2413082718849182 but:0.04849214851856232 the:0.03821016848087311 to:0.01979881152510643 which:0.01963779330253601 are:0.01719426177442…	27640.45
31	02e25922b083a8046b8e43e93d0d306c THE JASPER WEEKLY COURIER ChronAm 1908.8866119902348 38.391448 -86.930874 Close Inspection of tho election …	en	to:0.7566622495651245 the:0.028389720246195793 in:0.02068989910185337 a:0.01870151236653328 by:0.018521083518862724 for:0.01515000220388174 …	27301.76
32	53e3f3a7d1eb3c8dbca2bb5e6a6b8ce2 CENTRE DEMOCRAT ChronAm 1882.2041095573313 40.913486 -77.773747 The crying need of American agri-\nculture …	consumed,	of:0.6752209663391113 to:0.01952216774225235 and:0.017758280038833618 in:0.017501434311270714 or:0.013334851711988449 ot:0.0082273343577981 …	26619.67
33	3d3a8ed32448a9aa46794d2c234199de THE WICHITA CITY EAGLE ChronAm 1874.1547944888382 37.692236 -97.337545 hei fin provided shall become due.\n…	of.luue;	of:0.7854345440864563 and:0.013922152109444141 ot:0.01278990600258112 at:0.007640497293323278 was:0.006550854071974754 ol:0.0062694158405065…	25750.40
34	81b78f72b2a8df3fcf12f94e115cac30 RICHMOND ENQUIRER ChronAm 1843.8013698313039 37.538509 -77.43428 Permit me, however, to make this passing r…	excited	to:0.2757119834423065 of:0.0736183449625969 was:0.04034806787967682 the:0.03805781528353691 that:0.031686246395111084 is:0.03065645135939121…	25355.10
35	257a1ff7a1e76fab24715d96c0833753 GREAT FALLS DAILY TRIBUNE ChronAm 1920.7745901323112 47.504885 -111.291891 Griffith produced a letter which…	Tuesday	The:0.23671412467956543 In:0.03755073621869087 It:0.03740760311484337 He:0.03168165311217308 That:0.03086966462433338 There:0.02993714064359…	24262.26
36	409fd331bd419b3f7b419a4a682b9e03 THE STAR OF THE NORTH ChronAm 1851.5027396943176 41.004121 -76.453816 instances are recorded of persons in …	sUch	a:0.14519715309143066 the:0.09494289755821228 his:0.032219406217336655 of:0.029990535229444504 no:0.026155663654208183 an:0.0254799090325832…	23581.03
37	459a095107121862f9aefd60063dca47 DEMOCRAT AND SENTINEL ChronAm 1857.382191749112 40.485194 -78.724957 Saw Me change to fifty Dalars bils for…	Sarah	you:0.1448134183883667 the:0.08450160920619965 me:0.04543519392609596 us:0.042831454426050186 that:0.0374458022415638 him:0.0328841432929039…	23298.06
38	3d16bab423e6d821c072278ff57317a9 RAFTSMAN'S JOURNAL ChronAm 1861.5027396943176 41.02728 -78.439188 J. F . Speed, Esq My dear Sir : The recen…	required	to:0.06353434175252914 who:0.060204342007637024 and:0.05872715264558792 of:0.05182161182165146 in:0.043713219463825226 are:0.036539837718009…	23199.84
39	9f66ba75fc53a7681185533ebb60da8c RICHMOND ENQUIRER ChronAm 1835.5520547628107 37.538509 -77.43428 Santiago. Their chief was shot.”\nExtract …	distance.	in:0.1164126768708229 of:0.08908040821552277 and:0.05780903622508049 from:0.03448290005326271 In:0.03370160982012749 on:0.03232391178607941 …	23030.32
40	193ded078f040d56714549874eb70b57 EVENING CAPITAL ChronAm 1885.2890410641805 38.97864 -76.492786 Pitiilshine&t or Falsi Hers.\nDuring the fou…	continues,	of:0.44995999336242676 in:0.07698018103837967 and:0.04794355481863022 that:0.020766079425811768 at:0.017118291929364204 on:0.014542721211910…	22767.72