Metric	Score
PerplexityHashed	105.79

Metric	Score
PerplexityHashed	96.29

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.6032 a:0.3866 A:0.0071 Washington:0.0023 P:0.0005 :0.0100	103393.28
2	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	A:0.9951 P:0.0034 a:0.0007 AD:0.0001 Washington:0.0001 :0.0100	103362.56
3	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	A:0.9911 P:0.0038 a:0.0023 Washington:0.0007 AD:0.0005 r:0.0002 S:0.0002 N:0.0002 p:0.0001 :0.0101	102318.89
4	32510d2ec2b19ad0b20ad16ee28b17b0 THE EMPIRE COUNTY ARGUS ChronAm 1856.8346994219287 38.799901 -120.890216 Messrs. Editors :—One more week wi…	Demo-	Demo:0.6203 demo:0.3790 Grand:0.0001 :0.0102	101355.92
5	ee21a1f4d082e7ebf867d3506aeba084 MOUNTAIN HOME REPUBLICAN ChronAm 1925.7712328450025 43.13295 -115.691197 H. A. Beach and John W. Caldwell,\…	sive,	sive:0.9964 ants:0.0006 ding:0.0004 sively:0.0004 ters:0.0004 cates:0.0002 :0.0102 ices:0.0001 cated:0.0001 cate:0.0001	101285.65
6	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m:0.9811 M:0.0089 ni:0.0051 in:0.0019 p:0.0012 ill:0.0003 :0.0103 ra:0.0002	100312.23
7	d7ef84541fdaca435eac300545a72f13 RICHMOND ENQUIRER ChronAm 1835.064383529934 37.538509 -77.43428 py march. In our cities, on the contrary, w…	in-	in:0.6478 In:0.3092 con:0.0209 sub:0.0075 Con:0.0035 iu:0.0025 ex:0.0012 of:0.0011 re:0.0009 Sub:0.0005 la:0.0005 ia:0.0004 ln:0.0003 at:0.0…	98352.76
8	1480d040bf88ccd74e068709857438bb GREAT FALLS DAILY TRIBUNE ChronAm 1920.8374316623658 47.504885 -111.291891 Bonds numbered 1 to 7, inclusive…	sive,	sive:0.9770 cates:0.0090 rels:0.0079 due:0.0009 cate:0.0007 cations:0.0006 ually:0.0003 date:0.0003 annually:0.0003 tum:0.0002 sions:0.0002 …	97453.89
9	327c1f738994b34c965467662851edfa COURIER DEMOCRAT ChronAm 1910.5712328450024 48.76059 -98.367824 In the Matter of the Estate of Bertha Overb…	doorof	of:0.9509 ot:0.0228 ol:0.0084 o:0.0025 or:0.0023 oi:0.0018 door:0.0017 f:0.0012 cf:0.0010 af:0.0007 ef:0.0005 at:0.0005 :0.0108 on:0.0004 in…	95601.78
10	12053b3589509ff26b86805ecd91fd2e COURIER DEMOCRAT ChronAm 1906.987671201167 48.76059 -98.367824 Notice is hereby given, that that certain\nm…	o'clock	oclock:0.9916 clock:0.0047 days:0.0007 :0.0109 P:0.0003 day:0.0003 OCLOCK:0.0003 cents:0.0001	94781.06
11	39bc47b995780f5bd41c50c2273de08b THE NEVADA JOURNAL ChronAm 1860.3784152689234 39.261561 -121.016059 ftivored grape growing regions of Europ…	moun-	cer:0.7017 moun:0.2851 foun:0.0071 mod:0.0015 Cap:0.0008 cap:0.0007 :0.0110 Moun:0.0002 Cer:0.0002 cur:0.0001 con:0.0001	93882.18
12	8972157574e4b774d8ed5beaa441e2c3 RICHMOND ENQUIRER ChronAm 1842.815068461441 37.538509 -77.43428 The improvements consist of a small dwellin…	tlun	than:0.9847 tban:0.0041 thau:0.0015 or:0.0009 tnan:0.0007 titan:0.0006 and:0.0006 over:0.0005 of:0.0005 tlian:0.0005 to:0.0005 thnn:0.0004 h…	91389.73
13	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.9560 and:0.0311 of:0.0062 :0.0113 aud:0.0003 No:0.0003 nor:0.0003 oi:0.0002 a:0.0002 block:0.0002 Or:0.0002 in:0.0002 one:0.0002 One:0.…	91326.30
14	12eb8650fe054cdfbcf101899590a01a CLARKSVILLE CHRONICLE ChronAm 1859.4972602422629 36.527761 -87.35887 or road ; on the east by a street or a…	Cir-	Cir:0.9818 cir:0.0115 New:0.0018 :0.0114 Pro:0.0006 Common:0.0002 Aud:0.0001 Hen:0.0001 Au:0.0001 regis:0.0001 Super:0.0001 In:0.0001 Town:0…	90543.16
15	1b543c550cecf520486e7452eea2fa59 ARIZONA REPUBLICAN ChronAm 1907.6123287354135 33.448587 -112.077346 N. 2355 bears N. 46 degrees 05 min-\nut…	ft.	ft:0.9173 feet:0.0452 chs:0.0162 chains:0.0059 cha:0.0030 foot:0.0015 :0.0117 feot:0.0009 foet:0.0007 S:0.0006 links:0.0005 M:0.0005 leet:0.…	88239.04
16	61d0a03433552a2f98c8997bbaa38e73 THE WYANDOT PIONEER ChronAm 1868.6734972361364 40.827279 -83.281309 prominent secession leaders acqui-\nesc…	thus	been:0.9673 yet:0.0069 become:0.0049 boon:0.0028 beeu:0.0022 so:0.0021 lieen:0.0019 leen:0.0014 boen:0.0008 oeen:0.0006 even:0.0006 ben:0.00…	88186.53
17	337fe30b62e352ab9f11f319f7dbe684 RICHMOND ENQUIRER ChronAm 1820.9275955967921 37.538509 -77.43428 mid -aid, Mia! before Counsel was ca'led 1…	therefore,	that:0.9616 if:0.0079 tbat:0.0038 as:0.0027 thai:0.0024 thut:0.0022 when:0.0016 tiiat:0.0012 whether:0.0012 hat:0.0011 tnat:0.0009 therefore…	86713.01
18	3945dffe91dbb1dc53aead1445a27603 THE NEW NORTH-WEST ChronAm 1871.9575342148655 46.395761 -112.730038 Ytvirtue o an order and decree Isued ou…	Counrt	Court:0.9834 White:0.0067 Conrt:0.0017 :0.0120 City:0.0012 Market:0.0008 Poor:0.0006 Mansion:0.0005 School:0.0004 County:0.0003 said:0.0003 …	86067.20
19	12b0d793b3c409a90a19544a25f41dfc ARIZONA REPUBLICAN ChronAm 1907.5876712011668 33.448587 -112.077346 Hualapal No. 6 Lode. Beginning at\ncor.…	ft.	ft:0.8533 feet:0.0892 chs:0.0287 chains:0.0074 cha:0.0051 foot:0.0030 feot:0.0020 :0.0121 poles:0.0010 foet:0.0009 leet:0.0006 feel:0.0004 S…	85279.74
20	0e826a9041caededa070fb4c285bf8cf THE WICHITA CITY EAGLE ChronAm 1882.9136985984271 37.692236 -97.337545 alter ease of Kulield rillcs with sw…	o'clock	oclock:0.9843 noon:0.0036 clock:0.0033 midnight:0.0022 :0.0122 sunrise:0.0004 dusk:0.0003 minutes:0.0003 p:0.0002 halfpast:0.0002 sunset:0.0…	84555.54
21	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9717 Mra:0.0077 Mr:0.0055 Miss:0.0048 Mis:0.0033 :0.0126 Mm:0.0006 Airs:0.0004 Sirs:0.0004 Messrs:0.0003 Dr:0.0003 Prof:0.0002 Rev:0.0…	81960.63
22	0a1661ff6d5076299f4fbb72b63e45ff RAFTSMAN'S JOURNAL ChronAm 1867.1767122970573 41.02728 -78.439188 Also A certain tract of land situate in D…	beginning,	beginning:0.9937 :0.0127 land:0.0005 sale:0.0003 trust:0.0003 said:0.0002 range:0.0002 tract:0.0002 commencement:0.0001	81291.09
23	2d5739b0fabcd810a292edde3beaa382 ARIZONA REPUBLICAN ChronAm 1917.160273940893 33.448587 -112.077346 With respect to the submarine situ-\nati…	con-	in:0.4754 In:0.4364 con:0.0253 sub:0.0204 de:0.0145 at:0.0058 circum:0.0030 iu:0.0014 re:0.0013 ex:0.0010 :0.0128 ob:0.0009 Con:0.0009 on:0.…	80648.00
24	0b3f1e51f2cf34a3e4c83384b5d193ae THE MEMPHIS APPEAL ChronAm 1887.0671232559614 35.149022 -90.051628 The Coahoma, from O.'ceoU.bronght\n14 ba…	tt)	to:0.6883 from:0.2637 via:0.0086 at:0.0058 in:0.0047 through:0.0025 into:0.0024 In:0.0019 Irom:0.0018 the:0.0017 lo:0.0013 :0.0131 by:0.0010…	78722.93
25	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	shall:0.8376 may:0.0435 to:0.0248 will:0.0140 should:0.0139 must:0.0139 snail:0.0123 would:0.0046 ahall:0.0040 sliall:0.0035 might:0.0023 :0…	77577.62
26	14b8cb9a6a47bd51d7434da5e1f0ac2d ARIZONA REPUBLICAN ChronAm 1907.9712328450025 33.448587 -112.077346 Washington, Dec. 20. Telegrams on\nwhic…	forthwith	no:0.8827 a:0.0413 any:0.0309 the:0.0055 little:0.0054 some:0.0047 uo:0.0046 nothing:0.0040 much:0.0025 an:0.0013 none:0.0011 still:0.0011 o…	76998.69
27	9a23949c6410e0a789c008623c370c36 DEMOCRAT AND SENTINEL ChronAm 1866.891780790208 40.485194 -78.724957 The present President of the United\nS…	States.	States:0.9351 Slates:0.0280 Stales:0.0137 Kingdom:0.0038 :0.0140 State:0.0035 Statea:0.0033 states:0.0025 Mates:0.0015 tates:0.0013 Stat:0.0…	73779.20
28	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	New:0.9351 Xew:0.0397 Now:0.0091 Mew:0.0017 :0.0142 Nev:0.0011 Nw:0.0010 Sew:0.0007 San:0.0006 Vera:0.0005 Santa:0.0004 the:0.0004 White:0.0…	72660.73
29	e11d5304f5e0f716206d72f21e2d8b3d RICHMOND ENQUIRER ChronAm 1817.6315068176052 37.538509 -77.43428 By the brig Henry, from Havana, the Editor…	re-	re:0.8112 ac:0.1396 in:0.0155 rt:0.0037 In:0.0032 ex:0.0021 :0.0143 r:0.0016 com:0.0012 evi:0.0010 im:0.0009 imme:0.0009 ro:0.0008 nc:0.0008…	72138.29
30	124853eea403ed0491cf68d75bf6d073 COURIER DEMOCRAT ChronAm 1916.5696720995245 48.76059 -98.367824 You are hereby notified that the said above…	notified,	notified:0.9482 ordered:0.0138 satisfied:0.0093 informed:0.0033 given:0.0026 directed:0.0022 conditioned:0.0016 :0.0143 and:0.0014 declared:…	72123.97
31	ca3e974ee984b1ab201eafc6c56ddebf RICHMOND ENQUIRER ChronAm 1834.746575310756 37.538509 -77.43428 The call on tire people ol Amherst, which I…	Vir-	Vir:0.9930 :0.0144 South:0.0002 San:0.0002 of:0.0001 Gen:0.0001	71680.00
32	3cf87073e97e6b146b4dc01faa3418b8 THE HOPE PIONEER ChronAm 1921.9164383244547 47.32221 -97.72232 Notice ia hereby given that that certain\nre…	January,	May:0.1696 June:0.1214 August:0.1054 April:0.1008 March:0.0957 December:0.0934 January:0.0754 October:0.0702 February:0.0609 September:0.033…	70258.94
33	7246a7de7f09e2a9c953aa0264e49aa6 RICHMOND ENQUIRER ChronAm 1842.382191749112 37.538509 -77.43428 lcri« citry nifcBsui? bsaflhg eitcnsircly u…	circum¬	circum:0.6501 sub:0.2382 in:0.0591 In:0.0283 de:0.0100 :0.0149 guar:0.0016 inti:0.0008 ob:0.0008 con:0.0005 ef:0.0004 re:0.0004 at:0.0003 iu…	69254.01
34	58c1bbd2c277e2d1ab2bdf8b4efd8c22 THE NEW NORTH-WEST ChronAm 1874.7164383244547 46.395761 -112.730038 Notice is hereby published that JOHN •.…	6	E:0.5851 W:0.3750 K:0.0050 w:0.0045 VV:0.0042 V:0.0037 :0.0151 East:0.0018 X:0.0018 mln:0.0014 west:0.0012 min:0.0011 West:0.0010 J:0.0010 B…	68282.49
35	0d5796d2750f24561946833dff100370 THE BEAVER HERALD ChronAm 1919.5027396943176 36.816137 -100.519871 three parts of corn meal; while tho ,\nt…	In	Is:0.4861 is:0.4373 are:0.0244 la:0.0063 was:0.0053 aro:0.0049 being:0.0048 ls:0.0036 be:0.0024 ia:0.0023 when:0.0022 :0.0152 arc:0.0017 nro…	67860.21
36	607b99895f3593172d93044ff219c248 RICHMOND ENQUIRER ChronAm 1817.1904109271943 37.538509 -77.43428 The power to regulate commerce a-\nmongthe…	“common	of:0.9347 ot:0.0155 and:0.0095 for:0.0058 ol:0.0057 oi:0.0031 f:0.0021 in:0.0021 or:0.0020 to:0.0018 cf:0.0014 :0.0155 the:0.0010 by:0.0010 …	66560.00
37	a46a5a890b809b63b0644f1f3f50d16e RICHMOND ENQUIRER ChronAm 1822.17397257103 37.538509 -77.43428 »v hat officers nave been specially appointe…	tion,	tion:0.7865 tions:0.1644 lion:0.0101 tive:0.0062 tiona:0.0050 :0.0156 lions:0.0034 tives:0.0030 tors:0.0022 tlon:0.0015 ion:0.0015 tiou:0.00…	66159.59
38	0c2196a34e9901dfbe5ad9259263bc2f ARIZONA REPUBLICAN ChronAm 1912.7117486022566 33.448587 -112.077346 3. That a cement concrete curb be\nbuil…	par-	par:0.9404 exten:0.0259 :0.0159 appro:0.0034 succes:0.0033 du:0.0017 quali:0.0016 progres:0.0016 attract:0.0014 w:0.0013 equal:0.0012 defi:0…	64853.33
39	02078c083ad81359022bfeb35b84a400 THE HOPE PIONEER ChronAm 1887.132876680619 47.32221 -97.72232 Default having been made in the payment of\nt…	mort­	mort:0.7959 Mort:0.1864 :0.0160 ac:0.0014 attor:0.0009 of:0.0008 al:0.0006 re:0.0006 Com:0.0006 Aud:0.0005 ne:0.0005 at:0.0005 Re:0.0003 com…	64454.40
40	a6c673941053ba5fc006050f0d22ffb9 RICHMOND ENQUIRER ChronAm 1830.760273940893 37.538509 -77.43428 MEETING OK THE LEGISLATURE\nIt will be seen…	coo-	con:0.8418 pre:0.0565 discon:0.0119 ar:0.0092 repre:0.0086 sur:0.0085 ad:0.0073 incon:0.0066 eon:0.0054 de:0.0050 sub:0.0041 em:0.0031 recon…	64047.70