Metric	Score
PerplexityHashed	132.60

Metric	Score
PerplexityHashed	118.45

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	A:0.9984 P:0.0003 S:0.0002 D:0.0002 M:0.0001 X:0.0001 a:0.0001 :0.0005 AD:0.0001 on:0.0000	2048000.00
2	12eb8650fe054cdfbcf101899590a01a CLARKSVILLE CHRONICLE ChronAm 1859.4972602422629 36.527761 -87.35887 or road ; on the east by a street or a…	Cir-	Cir:0.9850 cir:0.0141 :0.0005 Ju:0.0002 sen:0.0001 Har:0.0001 rec:0.0000 Sur:0.0000 Dis:0.0000 in:0.0000	2048000.00
3	32510d2ec2b19ad0b20ad16ee28b17b0 THE EMPIRE COUNTY ARGUS ChronAm 1856.8346994219287 38.799901 -120.890216 Messrs. Editors :—One more week wi…	Demo-	Demo:0.7232 demo:0.2760 :0.0006 Dem:0.0001 elec:0.0000 San:0.0000 Pro:0.0000 Presidents:0.0000 intel:0.0000 dem:0.0000	1706496.00
4	1b41f6cc7caeec7338317b8203e2cc1a ARIZONA REPUBLICAN ChronAm 1893.8452054477423 33.448587 -112.077346 Recently a gentleman was traveling\nove…	suffi-	suffi:0.9549 an:0.0421 au:0.0007 effi:0.0003 An:0.0003 nn:0.0003 :0.0011 sol:0.0002 the:0.0001 no:0.0001	931002.18
5	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m:0.9822 M:0.0056 ni:0.0048 in:0.0042 seq:0.0007 ra:0.0002 In:0.0002 iu:0.0002 n:0.0002 :0.0018	568945.78
6	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.9124 a:0.0822 oclock:0.0008 m:0.0005 Racine:0.0004 A:0.0004 u:0.0004 :0.0023 n:0.0003 P:0.0002	445172.87
7	d7ef84541fdaca435eac300545a72f13 RICHMOND ENQUIRER ChronAm 1835.064383529934 37.538509 -77.43428 py march. In our cities, on the contrary, w…	in-	in:0.6529 In:0.3363 iu:0.0022 la:0.0017 of:0.0016 con:0.0012 lu:0.0004 co:0.0004 ia:0.0004 :0.0029	353103.45
8	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	A:0.9930 P:0.0010 S:0.0008 D:0.0005 a:0.0004 M:0.0004 next:0.0004 :0.0031 AD:0.0002 at:0.0002	330322.58
9	c23e0b1d0ce15db1d62271289c0d82aa RAFTSMAN'S JOURNAL ChronAm 1864.4549180011638 41.02728 -78.439188 machine, and six small houses erected the…	de-	de:0.9910 De:0.0027 di:0.0008 :0.0035 E:0.0006 Inde:0.0005 dc:0.0003 Di:0.0002 cor:0.0002 dt:0.0001	292542.17
10	12b0d793b3c409a90a19544a25f41dfc ARIZONA REPUBLICAN ChronAm 1907.5876712011668 33.448587 -112.077346 Hualapal No. 6 Lode. Beginning at\ncor.…	ft.	ft:0.8390 feet:0.1114 chs:0.0351 feot:0.0038 foet:0.0022 :0.0056 leet:0.0009 fret:0.0008 foot:0.0006 chains:0.0006	182857.14
11	3945dffe91dbb1dc53aead1445a27603 THE NEW NORTH-WEST ChronAm 1871.9575342148655 46.395761 -112.730038 Ytvirtue o an order and decree Isued ou…	Counrt	Court:0.9876 :0.0056 court:0.0025 White:0.0020 Conrt:0.0008 School:0.0004 Market:0.0004 Poor:0.0003 said:0.0002 Koanoke:0.0001	182838.86
12	9a23949c6410e0a789c008623c370c36 DEMOCRAT AND SENTINEL ChronAm 1866.891780790208 40.485194 -78.724957 The present President of the United\nS…	States.	States:0.9496 Slates:0.0203 Stales:0.0117 State:0.0051 states:0.0028 :0.0057 Stat:0.0014 Statea:0.0013 Kingdom:0.0013 Mates:0.0009	179667.09
13	483b31c888630a6712df48fe6cee758d RICHMOND ENQUIRER ChronAm 1831.2397259956874 37.538509 -77.43428 11. The said superior courts shall have th…	y	ty:0.9386 cil:0.0321 ties:0.0079 chants:0.0056 try:0.0053 tv:0.0024 :0.0060 chant:0.0009 sin:0.0007 chandise:0.0004	170649.60
14	12053b3589509ff26b86805ecd91fd2e COURIER DEMOCRAT ChronAm 1906.987671201167 48.76059 -98.367824 Notice is hereby given, that that certain\nm…	o'clock	oclock:0.9893 clock:0.0021 :0.0063 and:0.0007 ember:0.0005 months:0.0003 hundred:0.0002 hours:0.0002 years:0.0002 I:0.0002	162539.68
15	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.9867 tban:0.0016 thau:0.0009 exceed:0.0008 :0.0076 about:0.0005 han:0.0005 tnan:0.0005 titan:0.0004 thun:0.0003	134709.89
16	e11d5304f5e0f716206d72f21e2d8b3d RICHMOND ENQUIRER ChronAm 1817.6315068176052 37.538509 -77.43428 By the brig Henry, from Havana, the Editor…	re-	re:0.9626 ac:0.0103 rt:0.0057 de:0.0054 ro:0.0022 :0.0090 r:0.0013 con:0.0013 ex:0.0011 in:0.0011	113777.78
17	02078c083ad81359022bfeb35b84a400 THE HOPE PIONEER ChronAm 1887.132876680619 47.32221 -97.72232 Default having been made in the payment of\nt…	mort­	mort:0.9040 Mort:0.0795 :0.0102 es:0.0014 therewith:0.0013 fore:0.0011 fur:0.0008 mortgages:0.0007 pur:0.0006 and:0.0004	100392.16
18	1ef4f5e00de54cfbc0786c63fc0ee4ea THE DICKINSON PRESS ChronAm 1894.2260273655504 46.879176 -102.789624 As the fortune of war has favored his\…	the	of:0.9638 ot:0.0101 ol:0.0041 oi:0.0035 for:0.0029 cf:0.0019 o:0.0012 :0.0103 ef:0.0011 f:0.0010	99407.53
19	1b543c550cecf520486e7452eea2fa59 ARIZONA REPUBLICAN ChronAm 1907.6123287354135 33.448587 -112.077346 N. 2355 bears N. 46 degrees 05 min-\nut…	ft.	ft:0.8838 feet:0.0722 chs:0.0276 :0.0109 feot:0.0015 foet:0.0012 cha:0.0009 leet:0.0008 fret:0.0006 cor:0.0006	93954.35
20	1f61d0be115721333a36e20b0f91f639 THE MINERS ChronAm 1852.3811475093605 42.500622 -90.664797 The people of L.wa demanded a new set of\nlaws, …	od,	ods:0.9649 od:0.0181 :0.0113 tor:0.0016 man:0.0014 tee:0.0011 tages:0.0007 general:0.0005 men:0.0003 ened:0.0002	90628.53
21	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9651 Mra:0.0068 Mis:0.0064 Mr:0.0052 Miss:0.0030 :0.0113 Capt:0.0006 Airs:0.0005 Rev:0.0005 Mm:0.0005	90610.41
22	0e826a9041caededa070fb4c285bf8cf THE WICHITA CITY EAGLE ChronAm 1882.9136985984271 37.692236 -97.337545 alter ease of Kulield rillcs with sw…	o'clock	oclock:0.9598 noon:0.0206 midnight:0.0039 :0.0114 daylight:0.0012 p:0.0009 once:0.0007 dusk:0.0005 sunrise:0.0005 halfpast:0.0004	89815.58
23	0d5796d2750f24561946833dff100370 THE BEAVER HERALD ChronAm 1919.5027396943176 36.816137 -100.519871 three parts of corn meal; while tho ,\nt…	In	Is:0.5197 is:0.4440 are:0.0070 la:0.0050 be:0.0030 being:0.0029 aro:0.0019 was:0.0017 when:0.0014 ls:0.0013	84628.10
24	2d5739b0fabcd810a292edde3beaa382 ARIZONA REPUBLICAN ChronAm 1917.160273940893 33.448587 -112.077346 With respect to the submarine situ-\nati…	con-	in:0.5252 sub:0.2822 In:0.0934 con:0.0596 circum:0.0179 per:0.0028 the:0.0020 re:0.0018 iu:0.0016 ac:0.0014	84628.10
25	0c2196a34e9901dfbe5ad9259263bc2f ARIZONA REPUBLICAN ChronAm 1912.7117486022566 33.448587 -112.077346 3. That a cement concrete curb be\nbuil…	par-	par:0.9809 :0.0123 per:0.0015 res:0.0010 prose:0.0010 sue:0.0009 pe:0.0008 pai:0.0005 constitu:0.0005 r:0.0005	83243.71
26	0349d547b82df2e09f71d292840b48f9 PULLMAN HERALD ChronAm 1896.1051912252074 46.730427 -117.173895 signed by the courts of other states to\nta…	au-	au:0.9220 an:0.0247 inti:0.0233 approxi:0.0062 re:0.0040 sec:0.0030 :0.0124 An:0.0020 esti:0.0012 the:0.0012	82580.65
27	2accc190b911380550ef0bd86b29fb43 RICHMOND ENQUIRER ChronAm 1846.7821917491121 37.538509 -77.43428 The object of the meeting w»> explained in…	at¬	at:0.9486 con:0.0176 de:0.0082 in:0.0047 the:0.0025 nt:0.0019 a:0.0018 In:0.0014 ac:0.0008 :0.0125	81920.00
28	4e6c58037b6f031ea37fdbe185238148 THE STAR OF THE NORTH ChronAm 1855.201369831304 41.004121 -76.453816 national character are impaired in vir…	Com-	com:0.7229 Com:0.2567 :0.0127 de:0.0022 oom:0.0020 con:0.0011 ad:0.0007 em:0.0007 Coin:0.0006 Con:0.0005	80637.98
29	0c59c1843cad3b98138627d97f8a9405 COURIER DEMOCRAT ChronAm 1912.2964480558085 48.76059 -98.367824 In a number of cases in which arrests\nhave…	corre­	corre:0.9343 re:0.0147 pro:0.0104 con:0.0060 de:0.0053 ex:0.0049 dis:0.0047 im:0.0031 pre:0.0020 Im:0.0014	77575.76
30	124853eea403ed0491cf68d75bf6d073 COURIER DEMOCRAT ChronAm 1916.5696720995245 48.76059 -98.367824 You are hereby notified that the said above…	notified,	notified:0.9501 ordered:0.0154 satisfied:0.0084 further:0.0025 covenant:0.0022 tified:0.0019 sured:0.0017 provided:0.0014 and:0.0013 request…	74202.90
31	c954306d673d88d08987736c007f2dd6 THE WYANDOT PIONEER ChronAm 1868.5396174547157 40.827279 -83.281309 warrant in the Constitution, and if\nsa…	of.	of:0.9513 ot:0.0105 to:0.0086 ol:0.0043 oi:0.0028 o:0.0027 for:0.0022 cf:0.0016 f:0.0011 in:0.0010	73669.06
32	27507ae84e31865d5a76df5c226be0ae THE CHARLOTTE DEMOCRAT ChronAm 1878.1821917491122 35.227087 -80.843127 By Bynum, J. Siraonton vs. Houston e…	plain-	plain:0.9449 Plain:0.0305 execu:0.0072 :0.0146 Execu:0.0008 sum:0.0005 Es:0.0004 na:0.0004 pe:0.0004 mo:0.0003	70136.99
33	7246a7de7f09e2a9c953aa0264e49aa6 RICHMOND ENQUIRER ChronAm 1842.382191749112 37.538509 -77.43428 lcri« citry nifcBsui? bsaflhg eitcnsircly u…	circum¬	circum:0.3894 sub:0.3348 in:0.1295 In:0.0792 con:0.0360 ob:0.0057 pre:0.0027 dif:0.0026 re:0.0019 guar:0.0016	61686.75
34	61d0a03433552a2f98c8997bbaa38e73 THE WYANDOT PIONEER ChronAm 1868.6734972361364 40.827279 -83.281309 prominent secession leaders acqui-\nesc…	thus	been:0.9517 become:0.0156 yet:0.0067 beeu:0.0028 only:0.0020 boon:0.0016 already:0.0012 :0.0166 come:0.0009 boen:0.0008	61680.58
35	3ff22426092d3a6869b2bd48364ba5f2 RAFTSMAN'S JOURNAL ChronAm 1858.9356164066464 41.02728 -78.439188 aware that the earliest and the best frui…	tages.	tages:0.8285 tage:0.1507 :0.0179 ants:0.0007 tors:0.0005 tion:0.0005 ery:0.0004 er:0.0003 ments:0.0002 ered:0.0002	57200.98
36	a46a5a890b809b63b0644f1f3f50d16e RICHMOND ENQUIRER ChronAm 1822.17397257103 37.538509 -77.43428 »v hat officers nave been specially appointe…	tion,	tion:0.8159 tions:0.1433 lion:0.0091 :0.0185 tors:0.0030 ion:0.0025 tiona:0.0024 tlon:0.0021 tionary:0.0016 ture:0.0015	55345.82
37	0a1661ff6d5076299f4fbb72b63e45ff RAFTSMAN'S JOURNAL ChronAm 1867.1767122970573 41.02728 -78.439188 Also A certain tract of land situate in D…	beginning,	beginning:0.9766 :0.0186 residence:0.0014 land:0.0007 ground:0.0006 stone:0.0005 stones:0.0005 which:0.0005 sale:0.0004 location:0.0003	55059.27
38	58c1bbd2c277e2d1ab2bdf8b4efd8c22 THE NEW NORTH-WEST ChronAm 1874.7164383244547 46.395761 -112.730038 Notice is hereby published that JOHN •.…	6	W:0.5959 E:0.3601 K:0.0083 :0.0194 min:0.0067 X:0.0038 VV:0.0021 V:0.0015 S:0.0012 East:0.0011	52788.78
39	337fe30b62e352ab9f11f319f7dbe684 RICHMOND ENQUIRER ChronAm 1820.9275955967921 37.538509 -77.43428 mid -aid, Mia! before Counsel was ca'led 1…	therefore,	that:0.9396 tbat:0.0112 thal:0.0091 thai:0.0049 if:0.0034 hat:0.0031 thut:0.0030 whether:0.0026 tiiat:0.0014 when:0.0013	50196.08
40	0651c4f5c7788f83510b2a8976e58e3e BRADFORD OPINION ChronAm 1877.3986301052764 43.994599 -72.127742 1 have got to say something about\nthe Car…	ments.	ment:0.5417 ments:0.3955 ances:0.0162 ers:0.0067 ings:0.0047 ing:0.0044 :0.0240 ants:0.0028 ance:0.0022 ed:0.0018	42666.67