Metric	Score
PerplexityHashed	325.07

Metric	Score
PerplexityHashed	287.21

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	02086dae55c9b8917b734d043ddf0e1d THE DICKINSON PRESS ChronAm 1892.4822404055353 46.879176 -102.789624 tariff, and demands Ibe enforcement of…	Neal	with:0.9417771697044373 and:0.009617992676794529 in:0.004385910462588072 with,:0.003843689104542136 to:0.0028799460269510746 on:0.0023464583…	91341.95
2	47760e14f5f772dc8bc8d84795614664 FREMONT WEEKLY FREEMAN ChronAm 1852.0068305694697 41.35033 -83.121863 unite with the Galena road, over whic…	nor	of:0.9025754928588867 and:0.016633423045277596 in:0.013834415003657341 to:0.006420949473977089 on:0.0038585613947361708 ot:0.003640570212155…	43031.55
3	02e25922b083a8046b8e43e93d0d306c THE JASPER WEEKLY COURIER ChronAm 1908.8866119902348 38.391448 -86.930874 Close Inspection of tho election …	en	to:0.6386870741844177 the:0.07277786731719971 a:0.02810882404446602 it:0.015303052961826324 for:0.014726503752171993 his:0.01262076292186975…	13661.44
4	39c705cf07381ee0e5703e69bc1b6594 RICHMOND ENQUIRER ChronAm 1852.9030054328578 37.538509 -77.43428 The foil >wing is the message from the Pre…	guarantees	of:0.5621778964996338 and:0.1062851995229721 in:0.03350774943828583 or:0.026027610525488853 by:0.01717071421444416 is:0.014506842009723186 w…	12827.20
5	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.5396834015846252 In:0.13908466696739197 on:0.059244394302368164 and:0.052478715777397156 at:0.016906466335058212 iu:0.01547691784799099…	11458.74
6	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	of:0.3676930367946625 to:0.3434877395629883 and:0.04412082955241203 in:0.01544460654258728 for:0.012964574620127678 from:0.01063799858093261…	11285.50
7	36f3ce448336c5a72028b212a84adcf2 THE DICKINSON PRESS ChronAm 1912.3784152689234 46.879176 -102.789624 Section 6. The several members of\nthe…	provided	that:0.42449241876602173 the:0.10590452700853348 to:0.09517133235931396 of:0.07387638837099075 by:0.05824173986911774 and:0.0281815994530916…	10019.83
8	35efa3ee0bd7da6438ff1344224d8ea3 EVENING CAPITAL ChronAm 1886.1273972285642 38.97864 -76.492786 “Never heard a word,” remarked the\nman with…	Well,	to:0.6891270279884338 in:0.033296603709459305 and:0.02676672302186489 of:0.025738997384905815 by:0.01897512748837471 the:0.00960347056388855…	9969.60
9	033af2cf06b15961da80de1bef035673 RICHMOND ENQUIRER ChronAm 1852.1379781104533 37.538509 -77.43428 i »icy now prupuso to acquiesce and unife …	«»f	of:0.4723532795906067 the:0.14048460125923157 for:0.0471501499414444 to:0.021726282313466072 a:0.02036534808576107 and:0.01603195257484913 t…	9720.48
10	208071e7f99faa05148eebdfc3e89f17 THE NEVADA JOURNAL ChronAm 1853.3246575025369 39.261561 -121.016059 bion River is Salmon Creek and Bay, whi…	the"	the:0.7187228202819824 tho:0.03874976933002472 this:0.023574847728013992 a:0.013059432618319988 his:0.01205650344491005 tbe:0.00743981963023…	9594.00
11	03cd5dfc26e01576269b4d7efe5555ab CLARKSVILLE CHRONICLE ChronAm 1869.9438355847285 36.527761 -87.35887 feast Tennessee rumor attrihutes the\n…	We	of:0.4674714207649231 and:0.12976163625717163 in:0.04862599819898605 as:0.025231048464775085 to:0.02487332373857498 with:0.01563461311161518…	9290.75
12	419b1c8767c6e1e70233c90f5628ae04 RICHMOND ENQUIRER ChronAm 1842.3547944888383 37.538509 -77.43428 Mr. MERRICK stated that be very much regre…	Well,	to:0.6161612868309021 with:0.07087763398885727 at:0.022324174642562866 in:0.021312400698661804 on:0.018223848193883896 from:0.01245852094143…	9122.48
13	425de22ab4cbbe437665a39d8282a66a THE WASHINGTONIAN ChronAm 1845.4890410641806 38.894955 -77.036646 cause are as five to one, and they only w…	expresses	to:0.44339534640312195 by:0.1138726994395256 the:0.05459509789943695 in:0.03140578791499138 a:0.02859371528029442 at:0.023201676085591316 fo…	8940.38
14	6a91fa7e91ff0b2e402d7931f596b92f RICHMOND ENQUIRER ChronAm 1827.6369862696602 37.538509 -77.43428 -'■ip* lor the l’oro», intending to procee…	|	of:0.27742719650268555 for:0.189149409532547 to:0.16637054085731506 and:0.024979451671242714 was:0.022408783435821533 is:0.01957597211003303…	8917.54
15	4b9b38e0e8362d1b98eead250229cf61 CLARKSVILLE CHRONICLE ChronAm 1871.4205479134957 36.527761 -87.35887 "O Lord, our Heavenly Father,\nhigh, a…	O	of:0.6108441352844238 to:0.048424553126096725 and:0.02769281342625618 in:0.0254596546292305 for:0.01872062124311924 is:0.011287379078567028 …	8885.08
16	5ae79f4ad00f6a5fd32a070815effcdc RICHMOND ENQUIRER ChronAm 1844.1953551596337 37.538509 -77.43428 What say ye, Harrison and Tyler men of 184…	ns	of:0.30324551463127136 and:0.16201388835906982 in:0.09008784592151642 to:0.047263260930776596 for:0.046899616718292236 or:0.0421027317643165…	8759.01
17	5339934f3b56c46ba5d1c9c7029d60b8 RAFTSMAN'S JOURNAL ChronAm 1866.678082160071 41.02728 -78.439188 BALTisiORE,August 31. Last night an at-\nt…	These	of:0.7073060870170593 and:0.021240632981061935 which:0.013802490197122097 ot:0.01292269304394722 to:0.011468705721199512 or:0.00881727784872…	8656.64
18	33d3f8e9f2aec86a354938138601a98f THE DUPUYER ACANTHA ChronAm 1897.669862981989 48.191772 -112.500531 The original pamphlet is one purport­\n…	solely	by:0.23842284083366394 him:0.145070880651474 the:0.13558830320835114 to:0.03718617931008339 me:0.036265503615140915 them:0.03270630538463592…	8327.82
19	0758337ce52d9c452a8906e590e0687a ARIZONA REPUBLICAN ChronAm 1905.7849314751395 33.448587 -112.077346 would be unfair to be committed to a\nf…	It.	that:0.3740762174129486 by:0.06996768712997437 to:0.0673668310046196 the:0.06360068917274475 in:0.04360356554389 as:0.026145540177822113 a:0…	8285.61
20	53e3f3a7d1eb3c8dbca2bb5e6a6b8ce2 CENTRE DEMOCRAT ChronAm 1882.2041095573313 40.913486 -77.773747 The crying need of American agri-\nculture …	consumed,	of:0.6132458448410034 and:0.044234372675418854 or:0.030085721984505653 to:0.016336996108293533 is:0.016115941107273102 ot:0.0135836731642484…	8275.62
21	366e401abc352060a99543482122e40d THE WICHITA CITY EAGLE ChronAm 1879.8095890093862 37.692236 -97.337545 Sunday morning, refused permission t…	nor	of:0.7657788395881653 and:0.023420164361596107 ot:0.013531805947422981 from:0.007610824424773455 ol:0.006924759596586227 to:0.00639327708631…	8228.17
22	793e52abc58395d029e7abaa13451b1b THE MINERS ChronAm 1849.505479420345 42.500622 -90.664797 cording the prevailing opinions of the times,\nsa…	gathering	of:0.3127715587615967 and:0.168660506606102 from:0.07284557074308395 to:0.06362981349229813 in:0.037296075373888016 or:0.021420560777187347 …	8178.01
23	06f5c84e09b4a5d14a89751be629d857 ARIZONA REPUBLICAN ChronAm 1903.878082160071 33.448587 -112.077346 A wise programme, truly, and am-\nbitiou…	somewhat	to:0.7960333228111267 plane:0.006983418017625809 lo:0.005065244622528553 in:0.004320703446865082 for:0.004094464238733053 by:0.0036791446618…	8135.62
24	84fc769632c8ec4004b5577b69c2ee44 RICHMOND ENQUIRER ChronAm 1830.491780790208 37.538509 -77.43428 hy agreement to he conveyed, or that which …	execu-	of:0.32658806443214417 and:0.2036987692117691 or:0.11912096291780472 at:0.07632019370794296 in:0.022188913077116013 to:0.017165765166282654 …	8127.78
25	0769f5e9b40321e9a9aeffdc63c6bb1a THE DICKINSON PRESS ChronAm 1887.9986301052766 46.879176 -102.789624 Working the Itrain Too Little.\nThere …	but	of:0.5601194500923157 and:0.05461738258600235 to:0.023158103227615356 that:0.02302170917391777 in:0.021970927715301514 is:0.0184524059295654…	8117.19
26	1c100350abc8bc56fc793fdc9df6d595 WATERBURY EVENING DEMOCRAT ChronAm 1905.8808218860984 41.558153 -73.051497 The Xaugatuck high school footba…	every	with:0.6307327151298523 in:0.04786384850740433 and:0.025285599753260612 by:0.0165453739464283 at:0.014668541960418224 the:0.0123721463605761…	8085.43
27	054d3ae2d462f8f99310816383fbf6f7 RICHMOND ENQUIRER ChronAm 1835.7246575025367 37.538509 -77.43428 aged about 23 years, of light complexion, …	chicily	by:0.20050117373466492 in:0.14629915356636047 of:0.12576009333133698 that:0.08023202419281006 the:0.031057529151439667 upon:0.03015304729342…	8030.00
28	36a56b85961a382a94857ff3e371aa96 RICHMOND ENQUIRER ChronAm 1853.6890410641806 37.538509 -77.43428 Fearoti to beg l.im not i» Hiibpn-na me be…	was	of:0.16195157170295715 the:0.13102111220359802 he:0.1158560961484909 they:0.1052839383482933 it:0.10491009056568146 we:0.02729880064725876 I…	7951.00
29	03217a2bfc936fe7bf78811851087cf0 RICHMOND ENQUIRER ChronAm 1843.23698626966 37.538509 -77.43428 Fellow-citizens! It appears to me, that a ma…	upon	of:0.16195157170295715 the:0.13102111220359802 he:0.1158560961484909 they:0.1052839383482933 it:0.10491009056568146 we:0.02729880064725876 I…	7951.00
30	1c4bd4984043ea81cef0695fdd80fee4 CARSON DAILY APPEAL ChronAm 1873.2534246258244 39.78373 -100.445882 we donbt if it is any worse than the\nc…	facts	that:0.4945264756679535 the:0.11332995444536209 when:0.029944486916065216 by:0.017006587237119675 in:0.014782020822167397 it:0.0147676989436…	7874.00
31	74a6a7f335e47b93176365f32ed623b6 RICHMOND ENQUIRER ChronAm 1819.042465721715 37.538509 -77.43428 flume wbo have experienced its operation\ni…	ilie	to:0.6267581582069397 in:0.039711736142635345 for:0.020457938313484192 of:0.01995917595922947 and:0.019339432939887047 by:0.0157072320580482…	7789.83
32	45d55d77578ebab266ad6ce98a921722 THE CHARLOTTE DEMOCRAT ChronAm 1877.223287639523 35.227087 -80.843127 Sec. 3. Said Courts shall beheld for …	books	of:0.5884914398193359 and:0.04045724496245384 in:0.02714933082461357 for:0.02291196770966053 are:0.018352104350924492 as:0.01422174647450447…	7776.91
33	0b7268bb4389d0b3cb833c4a0a5331e4 THE CHARLOTTE DEMOCRAT ChronAm 1894.7794520230848 35.227087 -80.843127 culosis among: aainabi throughout th…	Tuberculosis	to:0.274783194065094 and:0.15298452973365784 of:0.08382275700569153 in:0.03989811986684799 that:0.03564271330833435 on:0.02927299402654171 f…	7694.41
34	0119fa50aa441e4b1dac76aa61e769b5 GREAT FALLS DAILY TRIBUNE ChronAm 1920.6079234656447 47.504885 -111.291891 Now it happens that the differen…	below	of:0.5834392309188843 and:0.051986102014780045 in:0.019315069541335106 have:0.014220735989511013 to:0.01343874167650938 or:0.012972632423043…	7558.79
35	0ca84db43aeca9850304de5d3e30eadc WATERBURY EVENING DEMOCRAT ChronAm 1892.5259562525298 41.558153 -73.051497 attribute the success in life of…	showing	and:0.34146440029144287 of:0.2160428911447525 in:0.06311891973018646 to:0.027995096519589424 is:0.02283686399459839 as:0.02126712165772915 o…	7480.64
36	280e443c19d67cd7601e2f3474af4d59 THE JASPER WEEKLY COURIER ChronAm 1914.6561643518519 38.391448 -86.930874 selves confronted by a habit whic…	thorn,	the:0.3676756024360657 him:0.05254280939698219 a:0.03399459272623062 me:0.033791251480579376 this:0.033598799258470535 them:0.02615070529282…	7455.66
37	814553b95dd2aeb642b6e0722be8d6f8 RICHMOND ENQUIRER ChronAm 1818.6671232559615 37.538509 -77.43428 MELANCHOLY DiSASTEL.\nNoufoi.k, August 20.…	>f	of:0.6030809283256531 and:0.0409332700073719 which:0.03186682239174843 to:0.020921805873513222 in:0.017114143818616867 or:0.0169672966003417…	7401.92
38	69c47c5c35b6acd54ffcd36a122caec4 CENTRE DEMOCRAT ChronAm 1880.6516393126392 40.913486 -77.773747 is precisely adapted to growing calves\nand…	according	of:0.6467133164405823 and:0.036199137568473816 are:0.019428014755249023 were:0.013777575455605984 which:0.012895221821963787 to:0.0117214079…	7371.98
39	bcf3898847dc8339f8065c76d8b59817 RICHMOND ENQUIRER ChronAm 1830.9931506532216 37.538509 -77.43428 -uuaen witiuirawal ol one created for an l…	be	of:0.35306084156036377 in:0.07258982211351395 was:0.05267767608165741 is:0.039336126297712326 to:0.03587858006358147 that:0.0285002272576093…	7275.13
40	c2e37377272a7b325ddb973bfcc19126 RAFTSMAN'S JOURNAL ChronAm 1868.2308742853168 41.02728 -78.439188 damaged the road,evenine had approached;\…	The	to:0.5619577765464783 with:0.05284935235977173 in:0.04313294589519501 from:0.031493090093135834 at:0.024050822481513023 on:0.022230228409171…	7270.46