Metric	Score
PerplexityHashed	533.82

Metric	Score
PerplexityHashed	488.34

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1b543c550cecf520486e7452eea2fa59 ARIZONA REPUBLICAN ChronAm 1907.6123287354135 33.448587 -112.077346 N. 2355 bears N. 46 degrees 05 min-\nut…	ft.	no:0.4495249974622658 ft:0.1364767413434543 chs:0.13416357688937441 feet:0.11334509680265542 foot:0.019661936412419954 feot:0.01387902527722…	7702.22
2	12b0d793b3c409a90a19544a25f41dfc ARIZONA REPUBLICAN ChronAm 1907.5876712011668 33.448587 -112.077346 Hualapal No. 6 Lode. Beginning at\ncor.…	ft.	no:0.4495249974622658 ft:0.1364767413434543 chs:0.13416357688937441 feet:0.11334509680265542 foot:0.019661936412419954 feot:0.01387902527722…	7702.22
3	071cde98a8fbb711837c0a4387af3354 COURIER DEMOCRAT ChronAm 1892.2663934109999 48.76059 -98.367824 Whereas, default bas been made in the condi…	Now	now:0.39425524914656557 is:0.3779733262561242 thereof:0.008141077744669909 la:0.00581508876032114 i:0.00581508876032114 ia:0.004652094268146…	5035.70
4	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	land:0.3649689180152993 or:0.35060006486100315 ground:0.021553327627621403 and:0.02107436585581153 real:0.013889939278663456 the:0.013410977…	4773.84
5	16282674fcb25ab86d7110ec03ef8c01 GREAT FALLS DAILY TRIBUNE ChronAm 1919.2890410641805 47.504885 -111.291891 J. D. Holliday discussed "Domest…	such	with:0.36095130194857006 to:0.25591258181163523 of:0.14960066506698 for:0.005729448394572286 and:0.0050928500907120745 ot:0.0050928500907120…	4705.44
6	17e76454a4fad963ed9c5872c509ce32 THE CHARLOTTE DEMOCRAT ChronAm 1879.9465753107559 35.227087 -80.843127 Saunders shows that tea, although be…	into	states:0.4179245601916798 of:0.2213345349744134 in:0.06943293121312676 to:0.030286654601469377 by:0.01709478870442033 from:0.011396527103919…	4403.73
7	962ed3c2a06db2eded649dde1fcc54dc MARYLAND FREE PRESS ChronAm 1866.3931506532217 39.600652 -77.820551 roni tlto law of equality, wlikli Las b…	within	states:0.4179245601916798 of:0.2213345349744134 in:0.06943293121312676 to:0.030286654601469377 by:0.01709478870442033 from:0.011396527103919…	4403.73
8	09bd6e031f2665e0c377cca00d1dc274 RICHMOND ENQUIRER ChronAm 1842.278082160071 37.538509 -77.43428 poor children ol ihc stale, end hsd thai ft…	llie	the:0.5939077247540258 this:0.07468611519056738 a:0.052177986303087405 tho:0.019950438123286538 such:0.009719470447159278 that:0.00818482529…	4242.39
9	967dc3a5f19e727fa3ad0fd33fc72b9a RICHMOND ENQUIRER ChronAm 1843.264383529934 37.538509 -77.43428 scr.ption and this gross persecution? Why, …	that	of:0.39184616365780023 in:0.24313744596052644 at:0.04780867733329029 to:0.03631874976698229 for:0.021659187009968623 and:0.01650852982507193…	4218.83
10	95ec85dff60e9b831fcf9a21c604ad98 RICHMOND ENQUIRER ChronAm 1846.541095858701 37.538509 -77.43428 Need I '.peak ol Virginia's sons, wl:ose bi…	And	of:0.45598064887855805 in:0.2158913553222106 and:0.01966089334466051 with:0.01928279996898122 to:0.008696185449961176 ot:0.00718381194724402…	3746.74
11	1d9343a7e05978a9043f3453699152de THE CHARLOTTE DEMOCRAT ChronAm 1881.6506848997972 35.227087 -80.843127 about 7,000 sailors in our naval est…	J.n	of:0.44146599432210615 in:0.19825840894239777 and:0.024882704513298676 to:0.023277373916732944 during:0.02006671272360148 from:0.01765871682…	3731.91
12	1f0eacebbc0a4a749798e792faed403e THE JASPER WEEKLY COURIER ChronAm 1872.6625682743877 38.391448 -86.930874 specifically, the illegal acts, f…	sales	of:0.40786035303397716 in:0.10095764884786455 for:0.08801980160850528 secure:0.05387236873085212 to:0.0504788350287251 enforce:0.01760397728…	3641.45
13	7adf864d914899358f05dbfdbf51b989 RICHMOND ENQUIRER ChronAm 1832.1789617170107 37.538509 -77.43428 sion, Henry R. \\\\ in-tun and James Potts…	tho	trust:0.3566677228603114 said:0.10974393372038728 a:0.09739774426339108 by:0.0617309747209576 certain:0.049659145029672426 the:0.03347191885…	3514.93
14	2f8a0a04559dd9ef6882641430da6649 RAFTSMAN'S JOURNAL ChronAm 1863.5356164066463 41.02728 -78.439188 What Invasion has Taught Pennsylvania.\nI…	must	of:0.3709880409382644 to:0.24191158638980248 will:0.035047334729353605 and:0.021370359412960283 can:0.0205155484556857 that:0.01795111558386…	3504.26
15	60968fe1fe01b1f023195da3cb1761a2 THE CHARLOTTE DEMOCRAT ChronAm 1873.8616438039066 35.227087 -80.843127 There are no fish in the great Salt …	In	in:0.42838651313390713 the:0.17074483295036869 all:0.045227091322491 this:0.023883993555807347 his:0.02286765556691765 her:0.015245120650244…	3487.21
16	30b026f21ef8013b6f843fd53c8c4d19 THE DICKINSON PRESS ChronAm 1913.7383561326737 46.879176 -102.789624 Nonca is Hkbbbt Grv*K, That by virtue\…	Willtams,	the:0.4811843054576497 state:0.11055495164638574 war:0.06059083352695983 tho:0.023117744937390394 agriculture:0.014168947662269334 and:0.011…	3431.04
17	1101683610abad4d84b07f683e390245 RICHMOND ENQUIRER ChronAm 1862.5630136669204 37.538509 -77.43428 We extract the following: I\nTin? Arkansas…	which	it:0.35921575017247026 that:0.18263345591958582 to:0.08526564880818228 by:0.030255588293265013 will:0.01705317376968487 the:0.01540287195423…	3301.38
18	241256d0c48f29c657f9514228dbd935 THE NEW NORTH-WEST ChronAm 1897.1356164066465 46.395761 -112.730038 Combination among members of the\nsame …	always	to:0.3179944282357635 would:0.14709000905373165 will:0.12747802652464604 should:0.0322198256690873 shall:0.02801725798428324 of:0.0266164020…	3194.17
19	00598601512a7dcb54c3a70d6106db4e EVENING CAPITAL ChronAm 1896.1243169082675 38.97864 -76.492786 “When in Rome, flo as the Romans\ndo,” euj.s…	12	m:0.36866025522067913 10:0.16058209563581316 ten:0.05201957759153526 11:0.042595747900191695 9:0.03166410545823316 8:0.01809379070269842 :0.…	3137.40
20	23c6dc7098cafab96c1d35b72c28fabe DEMOCRATIC MESSENGER ChronAm 1921.7301369545917 38.177063 -75.392696 The City was especially well repre-\ns…	ious	which:0.3798142418714639 the:0.25745325191305746 tho:0.013438560955541724 tbe:0.0070729603218674005 this:0.005658382403273107 efficient:0.00…	3094.55
21	3b811ed939f6cdb42b7aa70228fcbfc9 THE NEW NORTH-WEST ChronAm 1879.0452054477423 46.395761 -112.730038 - Two Indian murderers were hanged at\n…	It	it:0.21171873131962238 to:0.1591592045093409 that:0.12584682836197938 there:0.07032620144971019 which:0.057001250990765584 for:0.04441657555…	3088.70
22	79e597038cfe7627f108f056b1611a89 RICHMOND ENQUIRER ChronAm 1830.0178081874683 37.538509 -77.43428 more confidence, look for them among the. …	tor	of:0.35228680148930314 for:0.19162046956872805 and:0.04569416809958188 under:0.03537614678358164 to:0.030217136125581523 in:0.01179209806129…	3074.95
23	254d32629d6dd10a52efca4eaadd25ce THE DICKINSON PRESS ChronAm 1917.532876680619 46.879176 -102.789624 Notice is hereby given that that cer­\n…	All	of:0.4424030252404352 in:0.1000673962297319 all:0.0579337803514915 and:0.02282243378629116 to:0.021652055567451152 also:0.01755573180151111 …	3033.48
24	1f40013a149705070a8abdf628f0ce24 RICHMOND ENQUIRER ChronAm 1850.9027396943177 37.538509 -77.43428 live from Charleston, la here, and in an i…	In	in:0.43551870068838877 the:0.16317501081323363 a:0.034352646894118405 said:0.010404899755308526 iu:0.01007458600166977 it:0.0082578603566566…	3027.65
25	0513b0a19d58a88a2ceee1535e1db466 GREAT FALLS DAILY TRIBUNE ChronAm 1920.9275955967921 47.504885 -111.291891 "As compared with beef, lamb eon…	from	of:0.3062256725268131 at:0.16360418962313764 to:0.07891318111850305 in:0.05656205320076286 that:0.03086585851982347 and:0.01824583391320826 …	2963.11
26	0c8a4f102cebb11d6fe4e63d8e826cd2 THE CHARLOTTE DEMOCRAT ChronAm 1876.974043684224 35.227087 -80.843127 ernors, and their corrupt and unscrup…	But	of:0.3062256725268131 at:0.16360418962313764 to:0.07891318111850305 in:0.05656205320076286 that:0.03086585851982347 and:0.01824583391320826 …	2963.11
27	b0a2ef677f12238e33c9db9700a4c6f2 RICHMOND ENQUIRER ChronAm 1820.9467212798522 37.538509 -77.43428 to furnish Hie cilizens of this Cum mon we…	That	of:0.43782253898048157 for:0.09203005137093768 in:0.05911106455380396 to:0.02662145582558937 is:0.018749524195405216 notice:0.01603012963225…	2928.77
28	141f945313ca897cedc210eb1635379d THE WEEKLY MESSENGER ChronAm 1892.252732208814 30.125201 -91.83345 medirected by theiHo.The 21st Judicial D…	satisfy	of:0.43782253898048157 for:0.09203005137093768 in:0.05911106455380396 to:0.02662145582558937 is:0.018749524195405216 notice:0.01603012963225…	2928.77
29	12ac3599d7015dd5c6f7d8a2aec17b02 THE MEMPHIS APPEAL ChronAm 1887.5438355847286 35.149022 -90.051628 witklpg ber later then Jo'y 15th. I 'd i…	farther	the:0.567544026110346 tho:0.023993760645871835 this:0.01538062684111503 tbe:0.014457791076319658 congress:0.011996895703531999 a:0.011074059…	2880.02
30	35302ed694ab8d077985529913e2c06f RICHMOND ENQUIRER ChronAm 1850.546575310756 37.538509 -77.43428 pl« s, which, in inv opinion, should form t…	e	of:0.41527717265291814 to:0.06720673423011458 in:0.06620364939316126 and:0.03711418912151485 for:0.02758488317045827 that:0.0195602044748316…	2789.79
31	39c705cf07381ee0e5703e69bc1b6594 RICHMOND ENQUIRER ChronAm 1852.9030054328578 37.538509 -77.43428 The foil >wing is the message from the Pre…	guarantees	of:0.41527717265291814 to:0.06720673423011458 in:0.06620364939316126 and:0.03711418912151485 for:0.02758488317045827 that:0.0195602044748316…	2789.79
32	85f980d4a7f3a6a526d26c0612699111 RICHMOND ENQUIRER ChronAm 1847.519178050482 37.538509 -77.43428 There is much to corroborate the opinion th…	Ty."	of:0.3513342778529217 in:0.22047544981404246 to:0.017675275554736778 during:0.01550463148774115 and:0.014884447468599541 which:0.01302389541…	2789.42
33	531517feae16d174c438b774dddd97e2 RICHMOND ENQUIRER ChronAm 1820.1707649956993 37.538509 -77.43428 consideration of this stu ject, Mr.C. said…	r	the:0.46916512225481233 and:0.07921769668618071 said:0.030397507185855977 best:0.020572060242394392 tho:0.018729788940495345 a:0.01289592981…	2774.90
34	597c7a52b2da58ecb7724299c9ef18fc CLARKSVILLE CHRONICLE ChronAm 1868.4658469629123 36.527761 -87.35887 conversation turned upon politics,\nOe…	nnd	the:0.36682154823263785 to:0.18912258981508268 in:0.02157785759281629 that:0.019039301043994074 tho:0.017770022769582967 of:0.01650074449517…	2773.81
35	2317a30f6a14e505a61d6b0758c6e9ae GREAT FALLS DAILY TRIBUNE ChronAm 1919.4424657217148 47.504885 -111.291891 A protest was filed by four plum…	Johnson's	the:0.3253120304612097 an:0.1885141860615842 proposed:0.04754567567416522 section:0.0383702105010196 following:0.0166827473644936 article:0.…	2772.10
36	1eaf6eb3e8f56d778dac66eeb9ae2519 THE MEMPHIS APPEAL ChronAm 1886.3794520230847 35.149022 -90.051628 excited and in a hurry. This was not\nso…	had	the:0.4821730745358524 a:0.062296299025026196 mind:0.02450323614521889 tho:0.02076546069556762 his:0.017027685245916347 in:0.013289909796265…	2695.13
37	59c31bb587cd7c9999f6ee55b7939d50 THE CHARLOTTE DEMOCRAT ChronAm 1878.5657533929477 35.227087 -80.843127 "For all practical purposes the over…	better	the:0.5237631270205004 a:0.03372405587644488 tho:0.02789521390871609 and:0.01290676313455636 tbe:0.01082503386036751 this:0.0087433045861786…	2679.63
38	a9ef4b3d46d18636acdd7ce250020c5d RICHMOND ENQUIRER ChronAm 1826.6479451737696 37.538509 -77.43428 J- Estate of Weldon’s Iieits, in Halifax c…	A	the:0.2775070807020606 in:0.21228209167538278 a:0.06378091739693181 this:0.03754651221645994 tho:0.012756202733995673 these:0.01179347226865…	2664.35
39	26e8a7c218feadee59e2146efa24cc6c THE NEVADA JOURNAL ChronAm 1859.919178050482 39.261561 -121.016059 The “College ctf California,” by the\nwi…	To	of:0.2668822465973049 to:0.16645026970199725 will:0.10534829774471216 would:0.026688287868667 should:0.024581323318415792 may:0.023176680284…	2646.86
40	275efb19dc2778c353fdbb0eb7ca5152 THE NEVADA JOURNAL ChronAm 1851.6999999682903 39.261561 -121.016059 Mtssas. Kditors.— Being some-\nwhat int…	entire	the:0.5028854454377367 and:0.03096131882809324 tho:0.027208443069766053 this:0.018764472613529884 his:0.015011596855202699 all:0.01501159685…	2624.58