Metric	Score
PerplexityHashed	343.70

Metric	Score
PerplexityHashed	309.95

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	c0b9d92f28f115fbc94dd6d59fa12b37 CLARKSVILLE CHRONICLE ChronAm 1869.17397257103 36.527761 -87.35887 arms excent Colt's revolvers. On ar\nriv…	New	new:0.8993152186338225 now:0.029521170023913284 xew:0.010080409003658692 the:0.00576023988804656 nw:0.00432018351617585 hew:0.00216009895836…	21935.38
2	02ddc3a213e07171a82cf2a479224f1b RICHMOND ENQUIRER ChronAm 1836.7090163618195 37.538509 -77.43428 Lord Falmcrstnn observed, that if at th.e …	lie	the:0.8757290462062659 tho:0.03788869894346044 tbe:0.010723226933232959 th:0.0050041801942377 a:0.004289299351863293 tin:0.00357441850948888…	17292.42
3	5e8bbd887fa4b5368e011e5add115273 RICHMOND ENQUIRER ChronAm 1825.97397257103 37.538509 -77.43428 General Assembly. that it a law lc pas-td lo…	in	of:0.8894616587922327 ot:0.02439924076798733 op:0.00887247941883421 oi:0.006654370654669479 or:0.006654370654669479 f:0.002218153126340015 o…	17203.85
4	09726909c77f27023d0f3d2206b97f8d ARIZONA REPUBLICAN ChronAm 1904.0341529738414 33.448587 -112.077346 A week or so later he sent another\nreq…	New	new:0.8483268747383959 now:0.05067930927775172 xew:0.017627614576343816 n:0.004406936695780656 xcw:0.004406936695780656 jfew:0.0022034903823…	14598.26
5	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	new:0.8483268747383959 now:0.05067930927775172 xew:0.017627614576343816 n:0.004406936695780656 xcw:0.004406936695780656 jfew:0.0022034903823…	14598.26
6	7569c23ae5ea2567963700bc346204b9 RICHMOND ENQUIRER ChronAm 1823.9493150367834 37.538509 -77.43428 uk iiml exeetiliug a system of internal im…	Was	is:0.5400335548242179 was:0.2335655052337175 are:0.06715751450584398 were:0.049526191678724046 being:0.016442698284015855 be:0.0093109272528…	13259.43
7	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.7411906259853185 on:0.12118330538979127 at:0.01690934692599807 within:0.011272916738766004 ln:0.00845470164514997 la:0.0084547016451499…	11783.94
8	966db087909dd7edbeb3852d0d303adf RICHMOND ENQUIRER ChronAm 1826.0945205162354 37.538509 -77.43428 performed their whole duty in the matter. …	that	the:0.7216384193669474 said:0.07436443537690908 this:0.04249396957669616 tho:0.035664584048079116 a:0.021246992376554225 such:0.009864683162…	11751.38
9	0548a5c9322228a04bc3b5aac668b17b ARIZONA REPUBLICAN ChronAm 1905.1301369545915 33.448587 -112.077346 DEPARTMENT OF THE INTER-\nIOR, "Washing…	D.	d:0.8351516264705081 i:0.02850352354152607 1:0.014251790274229572 p:0.011401443620770271 n:0.0057007503138516704 l:0.0057007503138516704 5f:…	10618.03
10	3157f2eacc1ff8a858ec158c99e3455e RICHMOND ENQUIRER ChronAm 1857.6479451737696 37.538509 -77.43428 [From the Alexandria f»azetto, Asgust itO.…	in	the:0.8102648958776544 tho:0.035979818619259155 new:0.014391944718002782 a:0.014391944718002782 tbe:0.014391944718002782 diameter:0.00431760…	9904.87
11	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	a:0.8406183356541513 be:0.02223866690933403 11:0.008895520136320705 ti:0.008895520136320705 1:0.004447804545316261 k:0.004447804545316261 ru…	9659.60
12	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.8153648684181227 and:0.05060895938538817 pieceor:0.005623317677580258 805:0.005623317677580258 r:0.005623317677580258 pr:0.005623317677…	9181.15
13	0ba3ca99842e04d54ea7df3d3133e753 CLARKSVILLE CHRONICLE ChronAm 1861.6424657217149 36.527761 -87.35887 supposed that imprisonment for debt hu…	Mates,	states:0.8293837079918185 state:0.021476046887769926 slates:0.015340039335080949 stales:0.0071586959314956485 mates:0.005113360080599323 kin…	9034.22
14	021fc687f08d32bec73ac4b1f6823671 ARIZONA REPUBLICAN ChronAm 1900.691780790208 33.448587 -112.077346 shall be formed, so that no fences shall…	wit:-	the:0.5564613925972536 wit:0.2594897993429259 tho:0.043248347944143506 say:0.011532935072322097 placeof:0.005766496368354569 theplaceof:0.00…	8915.88
15	3c0a79c2abf40e6838bc66d32fd4091f ROCKY MOUNTAIN HUSBANDMAN ChronAm 1877.2589040778792 46.548394 -110.902887 PREPARING WOOL FOR MARKET.\nThe …	admissible,	to:0.8424483334000437 i:0.011865547473501641 high:0.003955235226582193 on:0.003955235226582193 you:0.003955235226582193 delaying:0.003955235…	8132.80
16	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	a:0.8600156737832058 ai:0.006719005779035669 :0.13326532043775852	7683.92
17	258b002f6b1504c43b7bf1da305e4f54 DEMOCRATIC MESSENGER ChronAm 1912.1106557060818 38.177063 -75.392696 children consecrated by their parents.…	four	few:0.6409487792711976 hundred:0.07540575721958608 thousand:0.04293939854625281 dozen:0.04189209665356464 half:0.03875019097550013 lew:0.013…	7530.75
18	21a4004987635d163f83641f4f115d48 THE DICKINSON PRESS ChronAm 1897.905479420345 46.879176 -102.789624 Ill Groceries\n» We carry a full and co…	bs	be:0.7468203239960146 bo:0.040643379017054525 he:0.0355629693409469 lie:0.015241330636516401 have:0.010160920960408775 being:0.0101609209604…	7511.21
19	1aed5da15abd7ff69b3886afcc54689a RICHMOND ENQUIRER ChronAm 1818.2726027080162 37.538509 -77.43428 No object is more important, none more att…	ur	or:0.6048133931566823 to:0.16057000601387794 nine:0.03211408684005504 and:0.026761756874479084 by:0.021409426908903132 8:0.01070476697775122…	7405.58
20	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.8275808272362629 that:0.005591873425779318 encouraging:0.005591873425779318 lhau:0.005591873425779318 lime:0.005591873425779318 thun:…	7373.91
21	021866549bdf587d1f6f63a5e6417e91 GREAT FALLS DAILY TRIBUNE ChronAm 1920.3975409519835 47.504885 -111.291891 In the District court of the Eig…	its	the:0.745878586792043 tho:0.038941509104570726 his:0.023964028645090386 a:0.02096853255319432 south:0.011982044277506113 north:0.00898654818…	7299.05
22	0f8bd4e78c4e809572af17f22056feb6 THE DAILY ARGUS ChronAm 1876.4658469629123 41.509477 -90.578748 Galveston, and bought a bottle of Roblrds, …	th	the:0.772791495723459 tho:0.03299562520149018 tbe:0.013892914929796149 this:0.010419694880397236 september:0.010419694880397236 tha:0.006946…	7033.56
23	0a5eddbabb2fd3443b67366d07d9518c CAMERON COUNTY PRESS ChronAm 1907.7356164066464 41.511452 -78.235287 the ministry in reverence an spiritual…	consigned	of:0.7791061680709551 about:0.022999499877125476 around:0.020124569579810538 let:0.011499778687865713 ot:0.008624848390550771 wear:0.0057499…	7006.73
24	0d376f51595c1a2ca532e8cb8e118020 THE WASHINGTON BEE ChronAm 1892.8647540667375 38.894955 -77.036646 United States marshals:\nSib In pursuanc…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
25	565ec5bf9f9328ebfce865e68484332d THE MINERS ChronAm 1852.132513629579 42.500622 -90.664797 sensibly alive to the spirit of improvein"nt that…	Uni'ed	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
26	18dbf8e415736ebbc436aa5b44b54293 RAFTSMAN'S JOURNAL ChronAm 1859.2616438039067 41.02728 -78.439188 over the diocese of Baltimore. There are\…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
27	0ae7b53d3ab733d1b27fc0c1f4ef4e1c THE NEW NORTH-WEST ChronAm 1886.7684931189751 46.395761 -112.730038 value from the dawnings of history. His…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
28	0c14c7de32087c48d4146c0f336b3018 WATERBURY EVENING DEMOCRAT ChronAm 1903.932876680619 41.558153 -73.051497 down the boxmdary line in accorda…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
29	2d81dc481d23c0df43954be5a6639298 RICHMOND ENQUIRER ChronAm 1833.7301369545917 37.538509 -77.43428 »ng, 40 feel wide and 4 feet deep. It p«*»…	western	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
30	69453f01c1a693d2a5ee97cc145007d8 RICHMOND ENQUIRER ChronAm 1826.4287670915778 37.538509 -77.43428 ters;but does not in tlie course of this c…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
31	970b5604f73013ff82d483e814a4c85d RICHMOND ENQUIRER ChronAm 1828.0013660885954 37.538509 -77.43428 But, sir. to I.•> serious: J am fir from t…	United	united:0.7902176566342043 southern:0.02480598327665678 inited:0.009775240446372615 several:0.009249689997761282 confederate:0.00767303865192…	6924.89
32	327c1f738994b34c965467662851edfa COURIER DEMOCRAT ChronAm 1910.5712328450024 48.76059 -98.367824 In the Matter of the Estate of Bertha Overb…	doorof	of:0.7601842571986402 and:0.022384712822092926 on:0.017907773839225524 in:0.015221610449505086 ot:0.015221610449505086 by:0.0107446714666376…	6896.27
33	1256da5f7452f9255ffd462f5d0355ce EVENING CAPITAL ChronAm 1889.3301369545916 38.97864 -76.492786 Annapolitans and Anne Arundelans\nhave much …	Delegates.	the:0.7414574365939064 a:0.04070749458750631 tho:0.02616911404795444 vice:0.014538409616312946 its:0.013084571562357759 our:0.00726921934653…	6849.29
34	120145f56f521b1db5cd7decd709cf04 BRADFORD OPINION ChronAm 1876.4221311159179 43.994599 -72.127742 Whereas a joint resolution of the Senate\n…	iu	in:0.4277987303107815 with:0.28735976737430907 by:0.05833622781636944 for:0.025927236369491194 that:0.021606037509907427 at:0.01512423922053…	6786.67
35	51c6e9116830cef76c337d98d45de66f RICHMOND ENQUIRER ChronAm 1824.4057376732949 37.538509 -77.43428 Your memorialists are no disorganizes.— We…	n|	at:0.6122419147343893 the:0.1266708079548539 to:0.029556586598946808 always:0.021111871698433152 a:0.021111871698433152 no:0.012667156797919…	6088.17
36	b0a2ef677f12238e33c9db9700a4c6f2 RICHMOND ENQUIRER ChronAm 1820.9467212798522 37.538509 -77.43428 to furnish Hie cilizens of this Cum mon we…	That	by:0.40374326819656553 that:0.3405486806865966 for:0.024575743136751826 in:0.02106493271953133 except:0.014043311885090334 on:0.014043311885…	5972.65
37	a2e588be6653e02051120f35d1264f41 RICHMOND ENQUIRER ChronAm 1840.771857891874 37.538509 -77.43428 like I lie application of such a rule to yo…	not,	they:0.3009925059977978 you:0.24769175342879562 we:0.14736092506361498 there:0.09719551088102465 any:0.01358648724337412 yon:0.0125413744479…	5944.14
38	2940830ef61b974238fa74a5f9d25f47 THE JASPER WEEKLY COURIER ChronAm 1897.4999999682902 38.391448 -86.930874 which authorities dmagree. The mo…	from	by:0.441480105003829 in:0.14624030323500598 that:0.10071267025196318 to:0.052425786785099585 on:0.04828691105936842 at:0.023453656704981434 …	5806.19
39	0843e1424fe4c0e34c1806a54325d3f0 LOS ANGELES HERALD ChronAm 1890.5136985984273 34.054935 -118.244476 Under and by virtue of an order of sale…	Beginning	beginning:0.5965667113657316 commencing:0.1782844007029337 commence:0.013714311261832934 starting:0.013714311261832934 baglnnln:0.0068572242…	5780.46
40	7adf864d914899358f05dbfdbf51b989 RICHMOND ENQUIRER ChronAm 1832.1789617170107 37.538509 -77.43428 sion, Henry R. \\\\ in-tun and James Potts…	tho	said:0.4522236796245704 a:0.16735841448551267 the:0.13175025634313048 trust:0.03204741354446027 which:0.01780415028750739 snid:0.01068251865…	5770.61