Metric	Score
PerplexityHashed	138.03

Metric	Score
PerplexityHashed	123.73

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	02078c083ad81359022bfeb35b84a400 THE HOPE PIONEER ChronAm 1887.132876680619 47.32221 -97.72232 Default having been made in the payment of\nt…	mort­	mort:0.9918 Mort:0.0078 and:0.0001 :0.0001 or:0.0000 of:0.0000 mortgage:0.0000 said:0.0000 in:0.0000 to:0.0000 en:0.0000 public:0.0000 the:0…	10237952.00
2	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	shall:0.5231 may:0.1811 should:0.0869 to:0.0741 will:0.0566 would:0.0470 must:0.0175 might:0.0042 cannot:0.0033 ahall:0.0020 and:0.0010 mav:…	5116928.00
3	327c1f738994b34c965467662851edfa COURIER DEMOCRAT ChronAm 1910.5712328450024 48.76059 -98.367824 In the Matter of the Estate of Bertha Overb…	doorof	of:0.9603 ot:0.0103 by:0.0058 at:0.0046 ol:0.0046 in:0.0018 on:0.0013 to:0.0013 oi:0.0012 f:0.0009 In:0.0008 that:0.0008 cf:0.0007 At:0.0004…	2558976.00
4	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9949 Mr:0.0009 Miss:0.0009 Mra:0.0007 Dr:0.0005 :0.0007 Mis:0.0002 Rev:0.0001 wife:0.0001 Col:0.0001 Prof:0.0001 the:0.0000 M:0.0000 C…	1461686.86
5	36f3ce448336c5a72028b212a84adcf2 THE DICKINSON PRESS ChronAm 1912.3784152689234 46.879176 -102.789624 Section 6. The several members of\nthe…	provided	that:0.9689 That:0.0099 as:0.0036 and:0.0018 by:0.0016 of:0.0015 tbat:0.0013 If:0.0013 if:0.0010 And:0.0006 thai:0.0006 tliat:0.0005 with:0.…	1023283.20
6	12b0d793b3c409a90a19544a25f41dfc ARIZONA REPUBLICAN ChronAm 1907.5876712011668 33.448587 -112.077346 Hualapal No. 6 Lode. Beginning at\ncor.…	ft.	ft:0.9400 feet:0.0419 leet:0.0048 chs:0.0043 feot:0.0013 No:0.0008 chains:0.0008 corner:0.0007 poles:0.0006 :0.0010 foot:0.0005 inches:0.000…	1022668.80
7	124853eea403ed0491cf68d75bf6d073 COURIER DEMOCRAT ChronAm 1916.5696720995245 48.76059 -98.367824 You are hereby notified that the said above…	notified,	notified:0.9917 ordered:0.0036 :0.0012 alleges:0.0003 directed:0.0002 and:0.0002 ordained:0.0001 evidence:0.0001 provided:0.0001 tified:0.00…	852736.00
8	05f5fc6c60a00bd384ecebe40bf59d87 COURIER DEMOCRAT ChronAm 1909.0178081874683 48.76059 -98.367824 Notice is hereby given. That that certain\n…	A.	A:0.9857 and:0.0029 AD:0.0017 next:0.0013 S:0.0012 :0.0013 th:0.0006 st:0.0005 M:0.0005 from:0.0005 I:0.0004 at:0.0002 G:0.0002 D:0.0002 Ist…	786668.31
9	1b543c550cecf520486e7452eea2fa59 ARIZONA REPUBLICAN ChronAm 1907.6123287354135 33.448587 -112.077346 N. 2355 bears N. 46 degrees 05 min-\nut…	ft.	ft:0.9589 feet:0.0205 chs:0.0058 leet:0.0025 poles:0.0014 :0.0018 chains:0.0012 M:0.0012 corner:0.0012 S:0.0010 feot:0.0009 N:0.0004 No:0.00…	568490.67
10	32510d2ec2b19ad0b20ad16ee28b17b0 THE EMPIRE COUNTY ARGUS ChronAm 1856.8346994219287 38.799901 -120.890216 Messrs. Editors :—One more week wi…	Demo-	demo:0.5013 Demo:0.4936 :0.0019 great:0.0003 most:0.0002 old:0.0002 more:0.0002 only:0.0002 pri:0.0001 very:0.0001 the:0.0001 American:0.000…	538354.53
11	0a1661ff6d5076299f4fbb72b63e45ff RAFTSMAN'S JOURNAL ChronAm 1867.1767122970573 41.02728 -78.439188 Also A certain tract of land situate in D…	beginning,	beginning:0.9942 :0.0021 land:0.0008 ground:0.0006 lot:0.0003 acres:0.0002 the:0.0001 feet:0.0001 sale:0.0001 laud:0.0001 lots:0.0001 sectio…	487228.95
12	03dab7360adf2a8d9e3dc5d39f3f8c77 THE DICKINSON PRESS ChronAm 1904.8647540667375 46.879176 -102.789624 Not long ago Dr. J . N. Hirsch, of Chi…	Discovery,	Discovery:0.9951 :0.0022 is:0.0013 Is:0.0002 has:0.0002 was:0.0001 are:0.0001 try:0.0001 system:0.0001 and:0.0001 money:0.0000 being:0.0000 …	465221.82
13	d7ef84541fdaca435eac300545a72f13 RICHMOND ENQUIRER ChronAm 1835.064383529934 37.538509 -77.43428 py march. In our cities, on the contrary, w…	in-	in:0.5862 In:0.3106 by:0.0217 of:0.0170 from:0.0141 and:0.0115 to:0.0067 at:0.0036 for:0.0034 or:0.0033 with:0.0028 iu:0.0024 By:0.0015 into…	300995.76
14	c23e0b1d0ce15db1d62271289c0d82aa RAFTSMAN'S JOURNAL ChronAm 1864.4549180011638 41.02728 -78.439188 machine, and six small houses erected the…	de-	de:0.9931 :0.0037 im:0.0005 said:0.0004 north:0.0002 to:0.0001 W:0.0001 the:0.0001 st:0.0001 w:0.0001 Im:0.0001 deg:0.0001 com:0.0001 east:0…	276507.68
15	337fe30b62e352ab9f11f319f7dbe684 RICHMOND ENQUIRER ChronAm 1820.9275955967921 37.538509 -77.43428 mid -aid, Mia! before Counsel was ca'led 1…	therefore,	that:0.9593 tbat:0.0062 when:0.0033 thai:0.0027 however:0.0020 as:0.0020 for:0.0017 this:0.0014 it:0.0013 thit:0.0008 what:0.0008 if:0.0008 …	255923.20
16	39af98b820588dbe5193186eb3ab1031 CLARKSVILLE CHRONICLE ChronAm 1872.4549180011638 36.527761 -87.35887 CniitlldiUcs for oii(trr8.\niV sucires…	ex-	ex:0.6897 com:0.0728 re:0.0646 op:0.0421 im:0.0289 sup:0.0202 de:0.0188 ad:0.0186 dis:0.0177 con:0.0078 pro:0.0023 :0.0040 and:0.0014 in:0.0…	255872.00
17	436b5cf9cb503db111fb80182402d332 RAFTSMAN'S JOURNAL ChronAm 1855.9849314751395 41.02728 -78.439188 facts, as developed by the evidence were,…	"would	would:0.7052 might:0.0954 should:0.0859 could:0.0383 will:0.0184 didnt:0.0130 may:0.0086 must:0.0066 did:0.0032 wonld:0.0030 wouldnt:0.0025 …	249581.27
18	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	on:0.8776 in:0.0287 from:0.0186 In:0.0099 oa:0.0076 to:0.0071 at:0.0063 and:0.0052 ou:0.0050 along:0.0048 by:0.0025 near:0.0025 On:0.0022 up…	238044.28
19	0b3f1e51f2cf34a3e4c83384b5d193ae THE MEMPHIS APPEAL ChronAm 1887.0671232559614 35.149022 -90.051628 The Coahoma, from O.'ceoU.bronght\n14 ba…	tt)	from:0.4748 to:0.4745 the:0.0120 at:0.0068 by:0.0025 trom:0.0023 in:0.0022 via:0.0018 with:0.0018 :0.0044 for:0.0014 through:0.0012 toward:0…	232657.45
20	18d0629f0a95483eb4dadbaf50f124f8 EVENING CAPITAL ChronAm 1884.7964480558085 38.97864 -76.492786 use he bones, so that all in ail the crea-\n…	out,	to:0.5158 into:0.1333 over:0.1192 through:0.0325 on:0.0212 around:0.0200 Into:0.0179 in:0.0171 down:0.0138 out:0.0131 with:0.0127 up:0.0092 …	227487.29
21	b4188d0ad7ed014e24e185d57c9a8ed2 RICHMOND ENQUIRER ChronAm 1835.2260273655504 37.538509 -77.43428 It was found, by observation, that the wor…	nil	the:0.8741 a:0.0609 tbe:0.0178 tho:0.0162 final:0.0045 ths:0.0014 he:0.0013 in:0.0011 th:0.0011 :0.0054 this:0.0009 tlie:0.0009 their:0.0008…	189515.85
22	851768ce6f1e04724f2c28c9dfe84887 THE NEW NORTH-WEST ChronAm 1871.1684931189752 46.395761 -112.730038 PUBLIC NOTICE is hereby given that on t…	A.	A:0.9659 J:0.0032 S:0.0024 N:0.0019 U:0.0017 :0.0055 M:0.0016 and:0.0015 D:0.0014 I:0.0014 W:0.0009 th:0.0009 L:0.0008 X:0.0008 H:0.0007 IS:…	186125.96
23	c954306d673d88d08987736c007f2dd6 THE WYANDOT PIONEER ChronAm 1868.5396174547157 40.827279 -83.281309 warrant in the Constitution, and if\nsa…	of.	of:0.7486 in:0.1094 to:0.0366 by:0.0245 for:0.0148 In:0.0122 that:0.0096 on:0.0069 ot:0.0063 than:0.0043 ol:0.0030 :0.0055 and:0.0024 from:0…	186051.49
24	2b31aa78f8a9a9d39e17a4cbad1cef13 ELK CITY MINING NEWS ChronAm 1911.5301369545916 45.78769 -115.200118 To William P. Boyle, your heirs, execu…	2-,	No:0.9654 page:0.0075 on:0.0058 :0.0057 Range:0.0014 towit:0.0013 survey:0.0010 On:0.0009 and:0.0007 Page:0.0007 folio:0.0007 at:0.0006 one:…	179685.05
25	675d0cb7f5540feead9c31d8a9f616f6 THE ELKO INDEPENDENT ChronAm 1869.732876680619 40.832421 -115.763123 New Cocxty Pno posed..The people of\nT…	dis¬	dis:0.9855 :0.0063 time:0.0016 pro:0.0007 con:0.0006 better:0.0004 short:0.0003 re:0.0003 crop:0.0002 clear:0.0002 new:0.0002 period:0.0002 …	162344.63
26	3e9eb2473cebd9f0e4f87b791c40ccca THE DICKINSON PRESS ChronAm 1917.2835616121258 46.879176 -102.789624 NOTICE IS HEREBY GIVEN That\nunder aut…	Quar­	quar:0.9742 cen:0.0068 :0.0068 Section:0.0014 Lot:0.0013 Sec:0.0011 section:0.0009 sec:0.0009 Range:0.0005 Northeast:0.0004 quarter:0.0004 t…	150467.76
27	14b8cb9a6a47bd51d7434da5e1f0ac2d ARIZONA REPUBLICAN ChronAm 1907.9712328450025 33.448587 -112.077346 Washington, Dec. 20. Telegrams on\nwhic…	forthwith	no:0.7523 still:0.0765 any:0.0584 a:0.0306 not:0.0195 hereby:0.0071 therefore:0.0060 some:0.0054 the:0.0042 as:0.0026 :0.0071 nothing:0.0017…	144340.73
28	103fd7a0ef11be26bd809719e86692a7 THE DICKINSON PRESS ChronAm 1913.1246575025368 46.879176 -102.789624 Notice is hereby given that that certa…	sale.	sale:0.8363 August:0.0229 May:0.0216 July:0.0202 June:0.0139 January:0.0127 April:0.0126 November:0.0080 October:0.0072 March:0.0059 :0.0076…	134682.95
29	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m:0.8585 M:0.0803 ni:0.0407 :0.0076 in:0.0015 t:0.0010 i:0.0010 A:0.0008 I:0.0008 U:0.0006 In:0.0006 r:0.0006 recorded:0.0004 Angeles:0.0004…	134615.58
30	15f6fcb64c1f5c84e2cae7fb04792769 SOUTHERN LIVE-STOCK JOURNAL ChronAm 1888.7964480558085 33.4504 -88.818387 The Garden.—Under this heading to…	impor-	impor:0.9635 dis:0.0222 :0.0076 a:0.0010 the:0.0007 sub:0.0004 com:0.0002 pro:0.0002 re:0.0002 in:0.0001 new:0.0001 n:0.0001 A:0.0001 The:0.…	134561.68
31	1b41f6cc7caeec7338317b8203e2cc1a ARIZONA REPUBLICAN ChronAm 1893.8452054477423 33.448587 -112.077346 Recently a gentleman was traveling\nove…	suffi-	an:0.5629 suffi:0.3554 his:0.0161 a:0.0156 the:0.0082 au:0.0053 her:0.0036 :0.0088 its:0.0028 An:0.0027 nn:0.0019 this:0.0017 one:0.0014 him…	116375.27
32	7aac0927f266779069307deb1da7afde RAFTSMAN'S JOURNAL ChronAm 1867.4835616121259 41.02728 -78.439188 In school rooms which are not properly\nv…	proper	the:0.4828 a:0.2564 this:0.0903 that:0.0508 his:0.0265 their:0.0096 tho:0.0083 every:0.0081 in:0.0071 The:0.0066 her:0.0063 :0.0103 what:0.0…	99477.13
33	36757a12c376d999c6af2726c1118cea RAFTSMAN'S JOURNAL ChronAm 1864.1871584383223 41.02728 -78.439188 "The undersigned, who, by original ap-\np…	inthe	to:0.9185 on:0.0108 :0.0108 The:0.0063 and:0.0062 the:0.0057 thereto:0.0048 An:0.0039 by:0.0035 in:0.0032 lo:0.0022 with:0.0022 for:0.0017 a…	94805.33
34	607b99895f3593172d93044ff219c248 RICHMOND ENQUIRER ChronAm 1817.1904109271943 37.538509 -77.43428 The power to regulate commerce a-\nmongthe…	“common	of:0.8597 and:0.0260 ot:0.0257 ol:0.0181 prescribed:0.0089 in:0.0080 f:0.0037 or:0.0032 with:0.0032 oi:0.0030 for:0.0028 :0.0112 which:0.002…	91520.00
35	a8ff5ec194533f00737e94e8b450efa4 THE WICHITA CITY EAGLE ChronAm 1872.9467212798522 37.692236 -97.337545 iu developing the diamond mines. Ar-…	.New	New:0.9368 the:0.0246 :0.0114 Xew:0.0059 Now:0.0041 Santa:0.0029 St:0.0012 Mr:0.0011 an:0.0008 Gen:0.0008 tho:0.0006 N:0.0005 that:0.0005 Ca…	89770.67
36	a6c673941053ba5fc006050f0d22ffb9 RICHMOND ENQUIRER ChronAm 1830.760273940893 37.538509 -77.43428 MEETING OK THE LEGISLATURE\nIt will be seen…	coo-	con:0.8681 sub:0.0341 sur:0.0146 com:0.0106 re:0.0079 de:0.0069 now:0.0051 pre:0.0036 :0.0119 directly:0.0028 dis:0.0025 well:0.0022 not:0.0…	86059.03
37	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.8687 a:0.0636 oclock:0.0478 :0.0119 i:0.0008 am:0.0007 m:0.0006 the:0.0006 n:0.0004 c:0.0003 par:0.0003 A:0.0003 M:0.0003 u:0.0002 noon:…	85912.74
38	04ce38b5c98ba8fd87d85459089bba02 COURIER DEMOCRAT ChronAm 1913.2342465436327 48.76059 -98.367824 record m the office of the Register of Deed…	Per	per:0.9511 :0.0122 one:0.0089 ner:0.0039 a:0.0028 i:0.0016 each:0.0015 par:0.0012 re:0.0011 ten:0.0011 tier:0.0010 ier:0.0008 six:0.0008 is:…	83900.85
39	0e826a9041caededa070fb4c285bf8cf THE WICHITA CITY EAGLE ChronAm 1882.9136985984271 37.692236 -97.337545 alter ease of Kulield rillcs with sw…	o'clock	oclock:0.9723 :0.0122 feet:0.0017 midnight:0.0017 noon:0.0012 p:0.0012 mo:0.0008 clock:0.0008 it:0.0008 yards:0.0007 time:0.0004 one:0.0003 …	83875.67
40	0f14831caf4b3f8a36fafbfdc25bda04 THE BEAVER HERALD ChronAm 1915.919178050482 36.816137 -100.519871 SCHOOL teacher way out on tho\nA Pncillc …	fam-	fam:0.9832 :0.0125 few:0.0007 man:0.0004 wo:0.0003 fow:0.0002 world:0.0001 child:0.0001 It:0.0001 I:0.0001 lifo:0.0001 family:0.0001 it:0.00…	81764.35