Metric	Score
PerplexityHashed	177.87

Metric	Score
PerplexityHashed	154.46

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	08dab6a9d80517beeb95261a488b7a8b DEMOCRATIC MESSENGER ChronAm 1899.8616438039066 38.177063 -75.392696 Meemlitig sun of the* other will re-tu…	we*	we:0.9999445553539461 he:1.2468286791283862e-05 I:1.1461321135925734e-05 they:7.699696237058385e-06 the:3.694395798196162e-06 it:2.349870458…	85653333.86
2	3cb40649e3495dde5470b1dc82f36d06 THE HOPE PIONEER ChronAm 1921.187671201167 47.32221 -97.72232 The position of flagman at Saunders\nCrossing…	he	I:0.9119071341145969 we:0.08634675796132214 you:0.00039208810647676574 why:0.00027245093801799524 she:0.00022949179942446094 they:0.00021031…	7090014.76
3	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.9984414964836222 and:0.0010691123283411083 of:0.00011187878745758967 said:9.972217344448201e-05 described:5.546231701096381e-05 r:4.062…	6488949.42
4	966db087909dd7edbeb3852d0d303adf RICHMOND ENQUIRER ChronAm 1826.0945205162354 37.538509 -77.43428 performed their whole duty in the matter. …	that	such:0.7855458436967734 the:0.09763058939988042 said:0.06536702359917641 this:0.050423566114486944 tho:0.0001716488653262804 tbe:0.000126217…	1725228.01
5	597c7a52b2da58ecb7724299c9ef18fc CLARKSVILLE CHRONICLE ChronAm 1868.4658469629123 36.527761 -87.35887 conversation turned upon politics,\nOe…	nnd	and:0.9962842618126481 they:0.0009277979506334504 the:0.0006630058174380153 if:0.0004443430193285289 not:0.00030303185495368824 The:0.000294…	1336379.61
6	3c0a4ab581afacb8c52773d58770e306 THE STAR OF THE NORTH ChronAm 1850.582191749112 41.004121 -76.453816 aro the only truo sourco of all politi…	He	You:0.9941815537443734 we:0.0025317804539820585 It:0.0005943384704142226 We:0.00045897217086876834 be:0.0004025958534737417 I:0.000365809032…	1204284.19
7	7adf864d914899358f05dbfdbf51b989 RICHMOND ENQUIRER ChronAm 1832.1789617170107 37.538509 -77.43428 sion, Henry R. \\\\ in-tun and James Potts…	tho	said:0.7671922103741349 a:0.09154451441883957 the:0.04398506892769287 wild:0.03825111805169933 laid:0.03273596577106676 any:0.02362299526226…	688863.38
8	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	to:0.7296040698954666 the:0.22983864238528764 The:0.0371678048795963 Senate:0.0006820333422938088 by:0.00040859959823728767 to.:0.0002628591…	659515.21
9	9eb4938c1a67731f76861cd0a63c178c RICHMOND ENQUIRER ChronAm 1828.976775924661 37.538509 -77.43428 numerous branch of the State Legislature,\n…	greater	highest:0.7604412793345331 greatest:0.21672407764783796 largest:0.01690023387262798 least:0.0024023151119492397 proper:0.0003807005200597712…	435852.64
10	d0bfb818a1b00934cbb910b45812c3f3 RICHMOND ENQUIRER ChronAm 1846.905479420345 37.538509 -77.43428 Two lexers wer" read,dated S»-pt and Ociobe…	Itoin	into:0.8931297356112762 to:0.05052848535829316 in:0.0328229292654839 up:0.009666986123720562 all:0.003476199628134573 of:0.00312878339973079…	430847.66
11	25b3446d846abfdc133ac2dfba763c20 RICHMOND ENQUIRER ChronAm 1844.547814176027 37.538509 -77.43428 Now, gentlemen, I appeal t»you to say whe¬\…	othci	other:0.9774743125718276 better:0.017769530129493442 small:0.000300703362685627 possible:8.450951424864402e-05 fair:5.381896499662661e-05 na…	240730.50
12	206d9cb268506222006832d199fb1e76 DEMOCRATIC MESSENGER ChronAm 1912.0150272907813 38.177063 -75.392696 "Warden. I made S2OOO on that deal\nan…	lie	they:0.7066132696130102 she:0.18209782237811029 be:0.06890319182131106 he:0.018880170183042614 you:0.005846869036697291 ho:0.005477137389037…	182589.77
13	3dbc0028d8db80d0000aa17a75006093 RICHMOND ENQUIRER ChronAm 1832.301912536683 37.538509 -77.43428 The Report notices the proposition that the…	ignorant	aware:0.9863712271005477 not:0.0050084627389246445 proud:0.0009659164201390634 quite:0.00038122175633058643 informed:0.0003512682501542054 a…	165076.65
14	a49b26abe23d8ddeaaec9814277a4559 RICHMOND ENQUIRER ChronAm 1818.015068461441 37.538509 -77.43428 However, your committee animated by a\nioti…	individual	their:0.6114482776274198 the:0.35571388408825244 tbe:0.01469291714656793 our:0.004843390567454552 of:0.0025566170936116065 its:0.00134457853…	161056.23
15	21a4004987635d163f83641f4f115d48 THE DICKINSON PRESS ChronAm 1897.905479420345 46.879176 -102.789624 Ill Groceries\n» We carry a full and co…	bs	be:0.9416197949580304 bo:0.02871385924806786 he:0.010321492897458238 was:0.00957054374218355 lie:0.0013690917234044438 tie:0.000727263439092…	158449.47
16	b92a23883605606abbe38437fa519b9f RICHMOND ENQUIRER ChronAm 1832.5122950503442 37.538509 -77.43428 try 1 lour hi general, and making some val…	th»ir	your:0.8901363820330683 the:0.0974745467036402 his:0.0016740072518577882 their:0.0016001270658538046 special:0.0009660836448533364 particula…	152548.75
17	6ade4df3a1375dd19ceb4b425b5944c0 RICHMOND ENQUIRER ChronAm 1819.6068492833588 37.538509 -77.43428 evil, aud ss almost hopeless any other re-…	this	the:0.9757742559547725 that:0.003187776684078616 of:0.0027495293269334514 any:0.002376475639791937 in:0.0022522022034780057 and:0.0018835514…	136289.13
18	17e76454a4fad963ed9c5872c509ce32 THE CHARLOTTE DEMOCRAT ChronAm 1879.9465753107559 35.227087 -80.843127 Saunders shows that tea, although be…	into	in:0.6357043371201894 of:0.1813097194682902 In:0.07997727211621804 throughout:0.05591052599527834 which:0.012885498523339912 than:0.01089026…	136058.99
19	824cece626f91a0d11cdd811c51714a1 RICHMOND ENQUIRER ChronAm 1849.8095890093862 37.538509 -77.43428 the cost of timber standing, believing tha…	cot	cut:0.9766541679585407 be:0.006702591272291484 never:0.003537138237114617 run:0.0025348378232487065 to:0.0010535383621561112 give:0.00067062…	134280.46
20	1b5aab8898a13668aad5668b9a46906b THE STAR OF THE NORTH ChronAm 1861.4835616121259 41.004121 -76.453816 striking eenl demonstrating the impor…	at	its:0.5159384670556005 the:0.3924624139286148 to:0.060550169265387144 seeking:0.012585577062089843 of:0.0034783478868934824 from:0.002689495…	121302.21
21	2efb916d2aab3933a0423f697b858740 THE DICKINSON PRESS ChronAm 1910.8068492833586 46.879176 -102.789624 West; thence north up to and along the…	or	of:0.9990867945365014 the:0.0005268631291776592 and:3.660160715630496e-05 to:1.0483657474642584e-05 by:9.675854962546599e-06 or:8.0375738268…	120031.89
22	19e0b8e943e282b9a84a281ec17d59e7 THE REVIEW ChronAm 1921.4945205162355 35.955692 -80.005318 To make certain that I avoided any\npossibility …	ample,	ample:0.9619538525616859 the:0.010038272864899124 good:0.008177797778586748 a:0.0025103674967025527 this:0.001900324077813122 some:0.0017635…	116610.78
23	11201bd00405e06f810f2f5218483534 THE JASPER WEEKLY COURIER ChronAm 1874.5794520230847 38.391448 -86.930874 1787 we lnlvc added some of the l…	there	the:0.6354901023742872 only:0.31946262109530343 not:0.013280075606772891 but:0.01186903491765474 that:0.003310531285588967 no:0.002198871015…	108057.65
24	bfdb2d0cf0266aa34ac94655559ea3f2 RICHMOND ENQUIRER ChronAm 1832.2636611705627 37.538509 -77.43428 This cause caino on this day to he again h…	unless	the:0.9214898069969512 sufficient:0.03750434955661843 this:0.014124285339815683 any:0.005549686684311914 be-:0.004430252675915809 whatever:0…	107353.81
25	1b05fb0149488b9dd8758a60ddea6ab6 THE MINNESOTIAN ChronAm 1851.8260273655505 44.950404 -93.101503 The east half and northwest quarter of\nthe…	thirty-one,	section:0.9818513433275222 sections:0.0057240787695728886 all:0.0011968668728144585 the:0.0006189399518545406 land:0.0004084665938903151 24:…	106064.69
26	8a1bd50d2d41cb4badf568bd94c3b981 MOUNTAIN HOME REPUBLICAN ChronAm 1924.3346994219287 43.13295 -115.691197 All that portion of Elmore Coun-\n…	North	north:0.6023284994021992 south:0.3773748440310218 west:0.004150656118356932 east:0.0018764507371214802 South:0.00141051213901477 East:0.0012…	105236.07
27	8514460df8ad5f2adc1919e896c6b9c9 RICHMOND ENQUIRER ChronAm 1844.424863356355 37.538509 -77.43428 friends since last Fall.seem, from the he-l…	another	the:0.8554198886895309 this:0.04873002657635655 a:0.042927104130417296 tho:0.030305112020463 every:0.00842790339703127 The:0.001762659868310…	103000.55
28	d3da3a4b1c1e579a5228f3f05bed0be9 RAFTSMAN'S JOURNAL ChronAm 1864.5122950503442 41.02728 -78.439188 serveuiy me views and policy indicated in…	bv	and:0.9561881895135947 of:0.025230336040671226 to:0.0024556815818960317 between:0.0016089511305136942 that:0.0013002437697484746 with:0.0008…	98441.80
29	9eba7c9533cba430ed5be1bd429c8a94 RICHMOND ENQUIRER ChronAm 1829.3301369545916 37.538509 -77.43428 again committed which could only bd\ntied …	also	is:0.8703123307706069 the:0.04283969836798625 may:0.025568731437800484 was:0.024774037622657126 be:0.00943876439490092 it:0.0057047113853631…	95944.44
30	000f6825814e211d6f133a9d5921176e THE HARTFORD REPUBLICAN ChronAm 1911.6671232559615 37.451159 -86.90916 vasses free from the "jiputation of\…	can	to:0.6034627957224615 who:0.3082793450696465 would:0.02009187067709005 will:0.012818043821559176 shall:0.012693184776673798 should:0.0088595…	94400.84
31	124853eea403ed0491cf68d75bf6d073 COURIER DEMOCRAT ChronAm 1916.5696720995245 48.76059 -98.367824 You are hereby notified that the said above…	notified,	notified:0.9865980760069475 ordered:0.0004904079339577218 informed:0.00018556150856220176 provides:0.00017894620750588916 requested:0.000151…	86100.64
32	59424d2064d2a287f41c5001504c5745 RICHMOND ENQUIRER ChronAm 1821.6068492833588 37.538509 -77.43428 This disordered state of the circulating m…	Cincinnati,	it:0.7723517327337376 home:0.20315999756120945 that:0.005549336988908577 the:0.002194874690548272 If:0.0013769667683904583 of:0.000789733197…	78797.42
33	05dad252f529ad26c06249658e92a0e7 LOS ANGELES HERALD ChronAm 1908.736338766191 34.054935 -118.244476 "T here did not seem to bo any such\nrig…	Judge	court:0.6904263522319065 attorney:0.2927183875089315 judge:0.0032684559567368477 and:0.0001885658728636792 court,:0.00018164749105476982 tel…	78674.57
34	a2e588be6653e02051120f35d1264f41 RICHMOND ENQUIRER ChronAm 1840.771857891874 37.538509 -77.43428 like I lie application of such a rule to yo…	not,	you:0.970432817434463 they:0.0040007246457184386 so,:0.003651483877065376 we:0.0025722538917645793 true,:0.00234378889926001 there:0.0022119…	76725.30
35	91c1a51984bdda7502a5df990869d3fa RICHMOND ENQUIRER ChronAm 1849.319178050482 37.538509 -77.43428 from every direction, no: only from imhu?,,…	Irom	from:0.4681061755310894 above:0.19168187619214053 below:0.18329770359167435 to:0.07095089113076018 in:0.02798962654980937 down:0.01728277654…	75732.82
36	462892e2857012343b8b64926d8814e8 RICHMOND ENQUIRER ChronAm 1841.9821917491122 37.538509 -77.43428 Mr. BARROW said that, as the representativ…	licerating	with:0.9613275301566254 organized:0.016476702621651355 to:0.0013257151095586795 for:0.0013074468527205115 the:0.0009892279319466835 of:0.000…	66113.52
37	4d5976b000958a896c10cea25d976674 FREMONT WEEKLY FREEMAN ChronAm 1852.6762294765736 41.35033 -83.121863 time ts coming, if it be not now at t…	unsuspected.to	to:0.5826268387760437 and:0.3808892816271922 the:0.005364371512713403 but:0.0034523621366770443 cannot:0.002504572661169761 not:0.0023997914…	63696.16
38	898ff4600baba9243e5826bbe234d777 DELAWARE REPUBLICAN ChronAm 1866.1356164066465 39.745947 -75.546589 •3S» much larger scale. Our sokool Is c…	aronnd	about:0.6001934298860212 around:0.212975349382759 for:0.10860752573269213 of:0.049485535131255386 against:0.004901633077924922 to:0.00388263…	63468.56
39	3945dffe91dbb1dc53aead1445a27603 THE NEW NORTH-WEST ChronAm 1871.9575342148655 46.395761 -112.730038 Ytvirtue o an order and decree Isued ou…	Counrt	Court:0.9697285501109787 White:0.0076715688129902005 court:0.004632014794474715 the:0.00044806789619119815 next:0.00039110057408979054 State…	63130.46
40	257fb76d2ac310c9cf23ad6728d25e47 EVENING CAPITAL ChronAm 1900.1109588723998 38.97864 -76.492786 We marched the entire distance, six\nmiles, …	any	the:0.9254344582871443 his:0.018763195608317924 an:0.011076629780210736 my:0.006998028517744355 your:0.0064949039614860616 their:0.004941200…	61033.97