Metric	Score
PerplexityHashed	934.09

Metric	Score
PerplexityHashed	787.58

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	0e78370512f1256b187f248215d2f434 GREAT FALLS DAILY TRIBUNE ChronAm 1919.0945205162354 47.504885 -111.291891 * "The closed shop was secured i…	always	by:0.73955619 the:0.03439013 and:0.01745483 to:0.01603938 in:0.01450390 ,:0.01441528 .:0.00994345 bv:0.00943358 her:0.00728203 tho:0.0057852…	226575.95
2	02e25922b083a8046b8e43e93d0d306c THE JASPER WEEKLY COURIER ChronAm 1908.8866119902348 38.391448 -86.930874 Close Inspection of tho election …	en	to:0.68983501 the:0.09295137 by:0.03977574 .:0.01269770 it:0.01159945 ,:0.00924681 in:0.00651737 their:0.00595406 his:0.00569773 tho:0.00451…	219688.73
3	c954306d673d88d08987736c007f2dd6 THE WYANDOT PIONEER ChronAm 1868.5396174547157 40.827279 -83.281309 warrant in the Constitution, and if\nsa…	of.	of:0.64780807 to:0.17990918 ,:0.03272567 ot:0.01426842 .:0.01012131 ol:0.00816426 and:0.00805645 toward:0.00620971 towards:0.00462648 t:0.00…	193981.18
4	1c4bd4984043ea81cef0695fdd80fee4 CARSON DAILY APPEAL ChronAm 1873.2534246258244 39.78373 -100.445882 we donbt if it is any worse than the\nc…	facts	that:0.57888365 the:0.11555656 when:0.03496900 what:0.03191296 ,:0.01279174 whether:0.01171063 tbe:0.00992468 their:0.00966400 tho:0.0094726…	193066.51
5	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	to:0.84776103 .:0.03306789 ,:0.01935799 the:0.01612326 by:0.00455024 in:0.00372574 lo:0.00347894 ;:0.00224838 back:0.00223958 t:0.00218697 f…	184304.92
6	11a618922a619ac74b505d8e1e13f9c2 COURIER DEMOCRAT ChronAm 1911.5876712011668 48.76059 -98.367824 Order Hearing Petition for Sale of Land\nUp…	to.	to:0.84776103 .:0.03306789 ,:0.01935799 the:0.01612326 by:0.00455024 in:0.00372574 lo:0.00347894 ;:0.00224838 back:0.00223958 t:0.00218697 f…	184304.92
7	814553b95dd2aeb642b6e0722be8d6f8 RICHMOND ENQUIRER ChronAm 1818.6671232559615 37.538509 -77.43428 MELANCHOLY DiSASTEL.\nNoufoi.k, August 20.…	>f	of:0.48789290 and:0.10026667 ,:0.09297003 .:0.06509135 which:0.03601769 to:0.01405302 were:0.00893106 in:0.00799155 that:0.00763112 ;:0.0065…	163914.34
8	58c1bbd2c277e2d1ab2bdf8b4efd8c22 THE NEW NORTH-WEST ChronAm 1874.7164383244547 46.395761 -112.730038 Notice is hereby published that JOHN •.…	6	.:0.86416024 ,:0.03603354 ;:0.01085626 ):0.00622057 .,:0.00606544 w:0.00413117 ':0.00370184 -:0.00320530 west:0.00297264 c:0.00231472 ..:0.0…	154332.08
9	e0d861a8e33ffd3bd0ede66fd4b5dad2 RICHMOND ENQUIRER ChronAm 1830.9575342148655 37.538509 -77.43428 Mr. Wilron ren-twtd the motion to t*ko the…	it	and:0.16385150 for:0.15770824 to:0.15262468 of:0.13044761 ,:0.08635174 .:0.02523119 that:0.01888173 are:0.01040523 nothing:0.00992335 or:0.0…	153004.94
10	0651c4f5c7788f83510b2a8976e58e3e BRADFORD OPINION ChronAm 1877.3986301052764 43.994599 -72.127742 1 have got to say something about\nthe Car…	ments.	themselves:0.38295993 -:0.09188037 himself:0.07823588 him:0.04801145 them:0.04278426 ,:0.02946785 the:0.02766871 herself:0.02538573 ourselve…	147591.86
11	f19d6c8f0f32f2992a4b095851dbf57a THE STAR OF THE NORTH ChronAm 1864.5122950503442 41.004121 -76.453816 "Sec. 8 . No Bill shall be passed by …	fb	of:0.31244287 to:0.19892965 .:0.14136398 ,:0.06231323 and:0.02340397 or:0.02270667 which:0.01630509 the:0.01555352 by:0.01379418 ;:0.0088980…	146816.59
12	0758337ce52d9c452a8906e590e0687a ARIZONA REPUBLICAN ChronAm 1905.7849314751395 33.448587 -112.077346 would be unfair to be committed to a\nf…	It.	that:0.30836901 ,:0.17840581 to:0.09053599 .:0.06070510 and:0.03400315 by:0.03223576 the:0.01901634 as:0.01700496 what:0.01233408 thnt:0.008…	134541.10
13	2bcecac3982dcdcce8877554a04cfed6 RICHMOND ENQUIRER ChronAm 1826.064383529934 37.538509 -77.43428 quire, the immense expense of yearly repair…	on	by:0.38421920 to:0.34049934 ,:0.03846597 in:0.01964048 .:0.01375342 and:0.01049514 at:0.01040286 the:0.00998853 from:0.00912246 into:0.00528…	130860.68
14	612f3a2de6ce5ed26720b4a4b4905b80 RICHMOND ENQUIRER ChronAm 1820.8975409519835 37.538509 -77.43428 lint then hii object in the diminish'd val…	a	the:0.42925259 them:0.08471033 what:0.06640505 and:0.04139552 -:0.01991975 whether:0.01940490 ,:0.01880615 tho:0.01873710 if:0.01660381 its:…	124478.77
15	7793f6e60af0c6a6510e86bed26ab3d0 THE SOUTHERN AEGIS ChronAm 1863.4260273655505 39.535506 -76.34904 It is no new and untried article, but one…	he	of:0.45599288 to:0.11525491 .:0.05515120 ,:0.04125646 the:0.03109105 from:0.02749755 and:0.02083452 in:0.00994465 by:0.00967357 ol:0.0082431…	123489.68
16	06043e23de6c08fdbf4f48241bcd1ea8 WATERBURY EVENING DEMOCRAT ChronAm 1908.943989039415 41.558153 -73.051497 Rldgewood street, and on Benedict…	that	of:0.38376230 .:0.11813048 ,:0.08524624 and:0.04246719 to:0.04061932 on:0.03754021 upon:0.02758594 is:0.01524364 which:0.01301529 -:0.010696…	120207.14
17	f1479cb9a6256b326867f7c18fb195e5 EVENING CAPITAL ChronAm 1923.3849314751394 38.97864 -76.492786 room dwelling. Numbered . ".5 and 37. wltl\n…	o	in:0.55444139 ,:0.10452880 near:0.06695766 and:0.05603736 on:0.05158436 at:0.01292694 iu:0.01020496 about:0.00959286 within:0.00701782 there…	115805.69
18	95883947af6faa14105d7714b0658920 RICHMOND ENQUIRER ChronAm 1824.7308742853168 37.538509 -77.43428 I left Gibraltar at six o’clock on the eve…	mi	of:0.32838026 ,:0.09569876 .:0.09112217 for:0.04731715 in:0.03469826 which:0.02970827 to:0.02643377 and:0.02515045 the:0.02251071 are:0.0218…	115707.88
19	0119fa50aa441e4b1dac76aa61e769b5 GREAT FALLS DAILY TRIBUNE ChronAm 1920.6079234656447 47.504885 -111.291891 Now it happens that the differen…	below	of:0.40473101 ,:0.13856988 and:0.11188242 ':0.05358147 .:0.03873597 or:0.01435286 ’:0.01213666 who:0.01170230 ;:0.00910870 in:0.00869653 to:…	114892.17
20	39c705cf07381ee0e5703e69bc1b6594 RICHMOND ENQUIRER ChronAm 1852.9030054328578 37.538509 -77.43428 The foil >wing is the message from the Pre…	guarantees	of:0.41161999 ,:0.09280866 and:0.06935616 in:0.06751513 .:0.05767283 was:0.02917960 on:0.02272691 is:0.01343716 for:0.01223625 with:0.010258…	113704.38
21	054d3ae2d462f8f99310816383fbf6f7 RICHMOND ENQUIRER ChronAm 1835.7246575025367 37.538509 -77.43428 aged about 23 years, of light complexion, …	chicily	in:0.16614968 by:0.15280406 of:0.11290465 on:0.06240065 that:0.04916720 the:0.04903508 all:0.04262857 upon:0.03234624 and:0.03145629 ,:0.029…	113144.71
22	3d2ff78c606567b750f806145da3f1c9 RICHMOND ENQUIRER ChronAm 1844.252732208814 37.538509 -77.43428 I'NIO.V LEVEL FOR SALE.By virtue of a Deed …	ciibs,	,:0.26991841 .:0.15931302 and:0.13978206 of:0.05674040 are:0.02335495 to:0.02220457 ;:0.01988545 in:0.01730856 where:0.01548880 at:0.0149006…	113089.57
23	3f44f8a84e14472e1c4596c040ee4fb1 RICHMOND ENQUIRER ChronAm 1824.8073770175572 37.538509 -77.43428 10 establish. Little did you think when in…	supported	of:0.30327684 and:0.19228525 ,:0.14492199 .:0.04312880 to:0.02940669 in:0.01989423 are:0.01433071 ;:0.01188752 or:0.01177073 as:0.01000761 w…	113047.94
24	8113cbf39c2919feb7858263e4e47fda RICHMOND ENQUIRER ChronAm 1826.5246575025367 37.538509 -77.43428 already known that must lead to a remedy. …	yet	of:0.26941165 .:0.11114923 ,:0.09958702 and:0.09453406 in:0.03654052 with:0.02450134 at:0.01947045 was:0.01889069 on:0.01871153 is:0.0167250…	108513.34
25	2bf5eba98640487ae95fb1e2de1f9866 THE REVIEW ChronAm 1921.0342465436327 35.955692 -80.005318 officer would be fortunate if he could\nfind a c…	inherent	of:0.40667245 ,:0.09239496 .:0.06482307 and:0.04710858 are:0.02763076 for:0.01736123 in:0.01733923 were:0.01549262 to:0.01523872 will:0.0084…	105311.05
26	bcf3898847dc8339f8065c76d8b59817 RICHMOND ENQUIRER ChronAm 1830.9931506532216 37.538509 -77.43428 -uuaen witiuirawal ol one created for an l…	be	of:0.27190933 in:0.08619741 .:0.07381707 was:0.05855725 ,:0.05077668 is:0.04566059 will:0.03720913 the:0.03334295 to:0.02076975 that:0.01776…	97853.16
27	0ac8e36199fcab718e53b45013239b66 WATERBURY EVENING DEMOCRAT ChronAm 1906.0589040778793 41.558153 -73.051497 At last it seems that some of th…	like	of:0.24111356 ,:0.14850327 .:0.13104516 for:0.03144643 is:0.03013590 and:0.02680674 at:0.02523117 was:0.02036650 in:0.01572774 by:0.01559038…	92881.95
28	39d72465e66cb5286ac3fd2e58dbec34 THE WICHITA CITY EAGLE ChronAm 1877.1821917491122 37.692236 -97.337545 past summer broken 2,500 acrss, and\…	wc	of:0.35768428 ,:0.08841394 .:0.07543626 for:0.06997950 to:0.04963757 and:0.04860161 in:0.02189407 as:0.02138194 ;:0.01643695 is:0.01548289 o…	90308.79
29	17ab1ecafebd3f45e93914c8d977cc6c RICHMOND ENQUIRER ChronAm 1851.6315068176052 37.538509 -77.43428 DIRECT TRADE .We publish with pleasure the…	per	of:0.60661089 ,:0.03828296 in:0.03684948 .:0.02611174 and:0.01912611 annually:0.01624363 to:0.01241695 ol:0.01197617 ot:0.01074621 are:0.009…	90073.46
30	1f18e0ab9780a3575af428d63588c306 COURIER DEMOCRAT ChronAm 1912.8510928645517 48.76059 -98.367824 anchorage of the Atlantic Yacht club?"\n"Ye…	mingled	of:0.31849268 ,:0.20132880 and:0.09514348 .:0.05671211 are:0.03163060 to:0.01946750 were:0.01682281 in:0.01563226 ;:0.01305095 or:0.01121766…	88110.57
31	fc882459176e3b3d1a3a457ddcc1de45 RAFTSMAN'S JOURNAL ChronAm 1865.1246575025368 41.02728 -78.439188 struck the left Hank of the Fifth Corps,\…	iu	of:0.15586302 ,:0.14433172 contained:0.09649623 .:0.07955953 and:0.04096686 ::0.03878770 will:0.03280748 applicable:0.03025539 at:0.02803672…	88054.43
32	aa6a905a22a41ca82fae5f1d1646b049 RICHMOND ENQUIRER ChronAm 1824.5696720995245 37.538509 -77.43428 lo clear a '.arge proportion of firs; rate…	w	of:0.15586302 ,:0.14433172 contained:0.09649623 .:0.07955953 and:0.04096686 ::0.03878770 will:0.03280748 applicable:0.03025539 at:0.02803672…	88054.43
33	3920cfbe6ae4d5a949077fa23f6169d6 THE NASHVILLE UNION ChronAm 1853.17397257103 36.16223 -86.774353 tinguished, or to fear lest they should wa…	under	,:0.25815895 of:0.08927527 .:0.08569816 are:0.04943938 the:0.02931995 were:0.02820950 have:0.02537348 and:0.02061380 to:0.01989673 is:0.0171…	83625.55
34	100ab9ca2c428d0aeead281b70ded88b RICHMOND ENQUIRER ChronAm 1843.9383561326738 37.538509 -77.43428 . ions of lite contempt iteil new Reservoi…	belonging	,:0.31675369 of:0.20136642 .:0.14497450 ':0.02333443 ;:0.01721190 ::0.01363723 made:0.01227649 was:0.01003716 and:0.00974994 in:0.00665716 o…	83522.41
35	27cd62b1fdae153e36b67ae1b72993bc COURIER DEMOCRAT ChronAm 1913.4068492833587 48.76059 -98.367824 I pulled up tbe fugs from the door\nand sea…	bad	,:0.14376801 .:0.13110836 was:0.13011065 and:0.10882763 of:0.04913549 is:0.03578309 in:0.02307717 that:0.01524673 which:0.01194682 or:0.0110…	81741.57
36	d0c4de6104ea55e015a0a8044ccc105f RICHMOND ENQUIRER ChronAm 1848.7827868536228 37.538509 -77.43428 In East Florida, Columbia, Alachua, St.\nJ…	at	of:0.31773555 .:0.08762362 is:0.07266477 was:0.06938563 in:0.05400623 ,:0.03372783 will:0.02853455 from:0.02842707 that:0.01943151 has:0.016…	81651.05
37	001ef5d0be696bbaef13cbc4bae74927 PULLMAN HERALD ChronAm 1895.683561612126 46.730427 -117.173895 for several years how some :rra;n\nbuyers on…	willbe	of:0.31773555 .:0.08762362 is:0.07266477 was:0.06938563 in:0.05400623 ,:0.03372783 will:0.02853455 from:0.02842707 that:0.01943151 has:0.016…	81651.05
38	0ca84db43aeca9850304de5d3e30eadc WATERBURY EVENING DEMOCRAT ChronAm 1892.5259562525298 41.558153 -73.051497 attribute the success in life of…	showing	and:0.23892960 ,:0.22939791 .:0.09140752 of:0.08508089 in:0.04183036 to:0.02602033 ;:0.02382236 is:0.01826147 or:0.01752608 that:0.01309475 …	81144.63
39	a2709da05172e17802dbb1e47d667b8d RICHMOND ENQUIRER ChronAm 1829.5520547628107 37.538509 -77.43428 ular hobby; but tending to check the reign…	view	of:0.45365524 ,:0.08122769 the:0.07194182 .:0.05052084 a:0.03121231 and:0.02014492 to:0.01339071 in:0.00961818 ot:0.00775754 ;:0.00716129 fo…	80484.42
40	464a17e138277807a7c637b23dca52c8 THE CHARLOTTE DEMOCRAT ChronAm 1875.7958903792492 35.227087 -80.843127 it;" or something to that effect. Sh…	near	of:0.13555312 .:0.12521839 ,:0.11237984 to:0.06994562 in:0.06172339 is:0.03654511 and:0.02850376 on:0.02442361 was:0.02197375 that:0.0160723…	78845.87