Metric	Score
PerplexityHashed	412.64

Metric	Score
PerplexityHashed	364.70

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	a:0.9855491329479769 3:0.002890173410404624 k:0.002890173410404624 ai:0.002881844380403458 was:0.0028735632183908046 :0.01	103125.49
2	06ea1c5e069d5ec88810b8df92a9941f THE EMPIRE COUNTY ARGUS ChronAm 1855.9931506532216 38.799901 -120.890216 preventative against Syphilitic an…	J.	j:0.9809523809523809 1:0.009523809523809525 :0.01	102448.76
3	08534dc69e19cc604cfed5e6714e1b1f PULLMAN HERALD ChronAm 1896.8319671814916 46.730427 -117.173895 By virtue of a Decree and Order of\ngale, m…	D	d:0.92 1:0.02666666666666667 u:0.013333333333333334 o:0.013333333333333334 el:0.013157894736842105 :0.013508771929824581	75802.60
4	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.9101941747572816 and:0.053268765133171914 of:0.0048543689320388345 r:0.0024330900243309003 pr:0.0024271844660194173 805:0.0024213075060…	41965.31
5	11a618922a619ac74b505d8e1e13f9c2 COURIER DEMOCRAT ChronAm 1911.5876712011668 48.76059 -98.367824 Order Hearing Petition for Sale of Land\nUp…	to.	to:0.9375 o:0.006289308176100629 i:0.006289308176100629 io:0.00625 tu:0.00625 etc:0.006211180124223602 :0.031210203523575175	32809.78
6	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	a:0.9345132743362832 be:0.012367491166077738 11:0.007067137809187279 fi:0.00530035335689046 k:0.0035398230088495575 s:0.0035398230088495575 …	30410.94
7	03217a2bfc936fe7bf78811851087cf0 RICHMOND ENQUIRER ChronAm 1843.23698626966 37.538509 -77.43428 Fellow-citizens! It appears to me, that a ma…	upon	of:0.9274809160305344 in:0.022900763358778626 i:0.0038314176245210726 ot:0.003816793893129771 oi:0.003816793893129771 nf:0.00381679389312977…	29822.47
8	12538a81545ba5fb9089011b3eaeb163 THE NEW NORTH-WEST ChronAm 1888.7418032470653 46.395761 -112.730038 As fast as the destructives have progre…	J.	j:0.9655172413793104 :0.03448275862068961	29696.00
9	c0b9d92f28f115fbc94dd6d59fa12b37 CLARKSVILLE CHRONICLE ChronAm 1869.17397257103 36.527761 -87.35887 arms excent Colt's revolvers. On ar\nriv…	New	new:0.9117647058823529 now:0.0350383631713555 xew:0.00690537084398977 the:0.005370843989769821 nw:0.00332565873624968 n:0.002814738996929375…	29441.94
10	1aa3574819fc5ae35a94b6cf12e65e6f THE WICHITA CITY EAGLE ChronAm 1880.3647540667375 37.692236 -97.337545 It is therefore pertinent, I thiak, …	af	of:0.8951612903225806 ot:0.03225806451612903 ^:0.008130081300813009 f:0.008130081300813009 u:0.008130081300813009 ol:0.008064516129032258 :0…	25519.69
11	07c1b22fd8023185425518121bb8b644 THE MEMPHIS APPEAL ChronAm 1887.0123287354136 35.149022 -90.051628 tbat will be proposed in Congress will\n…	in	of:0.92 on:0.02 now:0.0196078431372549 :0.040392156862745	25351.46
12	0548a5c9322228a04bc3b5aac668b17b ARIZONA REPUBLICAN ChronAm 1905.1301369545915 33.448587 -112.077346 DEPARTMENT OF THE INTER-\nIOR, "Washing…	D.	d:0.8887665198237885 i:0.03634361233480176 1:0.022026431718061675 p:0.004405286343612335 n:0.004405286343612335 l:0.003303964757709251 :0.04…	25129.51
13	2517eb9eca35c47e2e6d4a657c4a9c5b RICHMOND ENQUIRER ChronAm 1852.424863356355 37.538509 -77.43428 Ml". II . <!. Farrell's Arubian Liniment ha…	well	i:0.8275862068965517 1:0.07471264367816093 and:0.03409090909090909 what:0.011299435028248588 l:0.005747126436781609 t:0.005747126436781609 :…	25087.86
14	1152c364458e5fe2dfe72d001581462d THE BEAVER HERALD ChronAm 1899.223287639523 36.816137 -100.519871 cargo of soldier deod, on Thursday,\nMarc…	City,	city:0.8842105263157894 citv:0.031578947368421054 chy:0.010638297872340425 cnv:0.010638297872340425 cltj:0.010526315789473684 citt:0.0105263…	24450.05
15	2bfa2ab7c2194bcca4d6f02a764d078d THE CHARLOTTE DEMOCRAT ChronAm 1881.57397257103 35.227087 -80.843127 tween corn and cotton, I shall take th…	New	new:0.8741258741258742 now:0.038461538461538464 xew:0.027972027972027972 mew:0.006993006993006993 said:0.006968641114982578 ew:0.00350877192…	24398.30
16	019c8e1ff022be553ae21c8875fb8ad6 ARIZONA REPUBLICAN ChronAm 1904.908469913732 33.448587 -112.077346 The Pathfinder, published in Wash-\ningt…	re-	re­:0.32941176470588235 re¬:0.3058823529411765 re:0.27380952380952384 r:0.024096385542168676 n:0.012048192771084338 rc:0.011904761904761904 …	23898.98
17	02ddc3a213e07171a82cf2a479224f1b RICHMOND ENQUIRER ChronAm 1836.7090163618195 37.538509 -77.43428 Lord Falmcrstnn observed, that if at th.e …	lie	the:0.8884664131812421 tho:0.03954372623574144 tbe:0.012927756653992395 th:0.005578093306288032 a:0.004057823991884352 these:0.0032936407398…	22196.91
18	09726909c77f27023d0f3d2206b97f8d ARIZONA REPUBLICAN ChronAm 1904.0341529738414 33.448587 -112.077346 A week or so later he sent another\nreq…	New	new:0.8915562913907285 now:0.04056291390728477 xew:0.012417218543046357 ne:0.004142502071251036 hew:0.0024834437086092716 xcw:0.002483443708…	22090.78
19	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	new:0.8915562913907285 now:0.04056291390728477 xew:0.012417218543046357 ne:0.004142502071251036 hew:0.0024834437086092716 xcw:0.002483443708…	22090.78
20	1aed5da15abd7ff69b3886afcc54689a RICHMOND ENQUIRER ChronAm 1818.2726027080162 37.538509 -77.43428 No object is more important, none more att…	ur	or:0.6815144766146993 to:0.1915367483296214 nine:0.024390243902439025 by:0.022271714922048998 and:0.022222222222222223 8:0.00669642857142857…	19934.53
21	3c0a79c2abf40e6838bc66d32fd4091f ROCKY MOUNTAIN HUSBANDMAN ChronAm 1877.2589040778792 46.548394 -110.902887 PREPARING WOOL FOR MARKET.\nThe …	admissible,	to:0.9318518518518518 i:0.004451038575667656 t:0.002967359050445104 we:0.002962962962962963 io:0.002962962962962963 you:0.002958579881656804…	19751.09
22	14b623d9235295bc2f1ec47d619982fc THE BEAVER HERALD ChronAm 1916.7609289301254 36.816137 -100.519871 hurrying swarms and ho looked\nncross, o…	In	in:0.7857142857142857 at:0.09523809523809523 ia:0.023809523809523808 property:0.020833333333333332 togatherin:0.02 :0.054404761904761845	18821.88
23	21a4004987635d163f83641f4f115d48 THE DICKINSON PRESS ChronAm 1897.905479420345 46.879176 -102.789624 Ill Groceries\n» We carry a full and co…	bs	be:0.8245967741935484 bo:0.056451612903225805 he:0.036290322580645164 lie:0.014084507042253521 have:0.008032128514056224 b:0.006060606060606…	18794.49
24	071cde98a8fbb711837c0a4387af3354 COURIER DEMOCRAT ChronAm 1892.2663934109999 48.76059 -98.367824 Whereas, default bas been made in the condi…	Now	now:0.875 is:0.014084507042253521 xow:0.013888888888888888 dow:0.013888888888888888 mow:0.013888888888888888 new:0.013888888888888888 :0.055…	18497.13
25	4d41aef961aa1d8bd1a90480f2a68d50 ARIZONA SILVER BELT ChronAm 1883.2260273655504 33.399478 -110.87095 Rfsolved, That whilst wo do not\nfor th…	That	that:0.7575757575757576 by:0.109375 at:0.03125 upon:0.030303030303030304 thst:0.015151515151515152 :0.05634469696969702	18173.85
26	87f7dd7699fc2fc5b7cd0151caedd907 THE ELKO INDEPENDENT ChronAm 1871.03698626966 40.832421 -115.763123 Directors.<ien. Addison, L. Page, Willi…	iu	from:0.5173501577287066 in:0.2857142857142857 therefrom:0.10559006211180125 to:0.015873015873015872 front:0.009433962264150943 lo:0.00634920…	17155.50
27	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.7853457172342622 on:0.11042311661506708 within:0.015416238437821172 iu:0.011351909184726523 at:0.009287925696594427 ln:0.00722394220846…	16800.34
28	87a4f356f42c84cae123acc373277a27 RICHMOND ENQUIRER ChronAm 1818.5794520230847 37.538509 -77.43428 tnon with Ins coiiniivnicn, the gnat ad-\n…	he	be:0.8181818181818182 lie:0.058823529411764705 if:0.030303030303030304 bo:0.030303030303030304 :0.0623885918003565	16413.26
29	47de41bdd6590affacdd38266798fece RAFTSMAN'S JOURNAL ChronAm 1866.5246575025367 41.02728 -78.439188 obtained your own consent to do that sing…	no	the:0.6881188118811881 a:0.115 this:0.06403940886699508 tbe:0.0297029702970297 tho:0.024752475247524754 that:0.014778325123152709 :0.0636080…	16098.60
30	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	to:0.7878787878787878 the:0.058823529411764705 lu:0.030303030303030304 by:0.030303030303030304 tothe:0.027777777777777776 :0.064913844325609…	15774.76
31	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.911062906724512 lhau:0.004338394793926247 thun:0.004338394793926247 tban:0.004338394793926247 thau:0.004338394793926247 to:0.00217864…	14754.01
32	3157f2eacc1ff8a858ec158c99e3455e RICHMOND ENQUIRER ChronAm 1857.6479451737696 37.538509 -77.43428 [From the Alexandria f»azetto, Asgust itO.…	in	the:0.8539971278123504 tho:0.034944949736716135 a:0.015333013895543843 tbe:0.01292484442316898 new:0.009573958831977022 he:0.002394636015325…	14456.85
33	c70e7b003bdb1ab83bc3ff37571dacca RICHMOND ENQUIRER ChronAm 1837.1082191463724 37.538509 -77.43428 lie submitted the petitions, the whole num…	liy	by:0.8333333333333334 bi:0.03333333333333333 that:0.03125 here:0.03125 :0.0708333333333333	14456.47
34	e11d5304f5e0f716206d72f21e2d8b3d RICHMOND ENQUIRER ChronAm 1817.6315068176052 37.538509 -77.43428 By the brig Henry, from Havana, the Editor…	re-	re¬:0.3333333333333333 re­:0.28205128205128205 re:0.24675324675324675 r:0.039473684210526314 n:0.013157894736842105 rc:0.012987012987012988 …	14174.28
35	021fc687f08d32bec73ac4b1f6823671 ARIZONA REPUBLICAN ChronAm 1900.691780790208 33.448587 -112.077346 shall be formed, so that no fences shall…	wit:-	the:0.6197478991596639 wit:0.25840336134453784 tho:0.03571428571428571 say:0.007352941176470588 he:0.0031545741324921135 tbe:0.0031512605042…	14128.88
36	32510d2ec2b19ad0b20ad16ee28b17b0 THE EMPIRE COUNTY ARGUS ChronAm 1856.8346994219287 38.799901 -120.890216 Messrs. Editors :—One more week wi…	Demo-	demo¬:0.48523206751054854 demo­:0.23628691983122363 demo:0.18220338983050846 demi:0.012711864406779662 dmj:0.00425531914893617 den:0.0042553…	13643.31
37	0d0f4d0397b496ad31f3ddbb26d1d9af LOS ANGELES HERALD ChronAm 1891.001369831304 34.054935 -118.244476 Tuesday morning there passed away\nfrom …	Los	los:0.8273809523809523 loa:0.047619047619047616 ios:0.017857142857142856 io:0.011976047904191617 lob:0.011904761904761904 ha:0.0059880239520…	13251.54
38	12ea4cb698b1f421c10f62cd03fc5fd4 RICHMOND ENQUIRER ChronAm 1821.1493150367833 37.538509 -77.43428 Hwittipy Hie shuck'of itu eartbqn.tke whic…	The	a:0.37373737373737376 no:0.3 the:0.2079207920792079 to:0.02 $:0.010101010101010102 ho:0.01 :0.07824082408240829	13087.80
39	58c1bbd2c277e2d1ab2bdf8b4efd8c22 THE NEW NORTH-WEST ChronAm 1874.7164383244547 46.395761 -112.730038 Notice is hereby published that JOHN •.…	6	w:0.35714285714285715 >:0.21428571428571427 e:0.14285714285714285 2:0.07142857142857142 i:0.07142857142857142 and:0.0625 :0.0803571428571430…	12743.11
40	396a07ccb25887b881644548aba25de9 DEMOCRATIC MESSENGER ChronAm 1881.9410958587011 38.177063 -75.392696 —The Forty-seventh Congress began j\ni…	Re-	re¬:0.3404255319148936 re:0.3010752688172043 re­:0.22340425531914893 r:0.021739130434782608 ll:0.021505376344086023 i:0.010869565217391304 :…	12644.96