Metric	Score
PerplexityHashed	312.55

Metric	Score
PerplexityHashed	281.24

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1af0a1f7553e5d8ea5625477c45448e2 THE WEEKLY MESSENGER ChronAm 1917.360273940893 30.125201 -91.83345 by the use of males, and espealelly thos…	select.	select:0.9999999957451029 have:1.6538468649570681e-09 soon:8.578269023546292e-10 and:6.003898285197484e-10 :1.1428335836231542e-09	896018470820.21
2	195aae8ea60f9f583308c4afe7972780 THE DICKINSON PRESS ChronAm 1900.9356164066464 46.879176 -102.789624 'Upon inquiry it was learned with­\nou…	I	i:0.9999878452637619 had:7.807531755845223e-06 he:2.769928329072543e-06 was:8.863144337869737e-07 :6.90961719449743e-07	1481992375.52
3	0c33acb1574482069be379e7234fcc64 THE DICKINSON PRESS ChronAm 1904.8073770175572 46.879176 -102.789624 A CONFIDENTIAL, CHAT .\n"It's perfect …	don't	dont:0.9999921443643756 must:2.38843469515512e-06 will:2.2084644722737924e-06 to:1.9951979171112323e-06 :1.2635385399156672e-06	810422450.64
4	14729bef5ff78c0c92cc5c4c4ddab10c THE DICKINSON PRESS ChronAm 1894.8205479134956 46.879176 -102.789624 Judge Bartholomew, the Republican\nnom…	for	foe:0.9999927735095455 in:2.2136070230969794e-06 over:1.97849958682816e-06 by:1.6359275986393928e-06 :1.3984562459402094e-06	732235994.49
5	06ce85842dde9f4ccb7c089267d082f7 WATERBURY EVENING DEMOCRAT ChronAm 1893.7849314751395 41.558153 -73.051497 empty, but on the top floor some…	I	i:0.9999835902050749 he:1.0959158454277344e-05 and:1.5564280754706866e-06 she:1.4298956187770696e-06 :2.4643127765022148e-06	415531668.61
6	2f690ee230ddd6ce1b262b3c70a10b02 ARIZONA REPUBLICAN ChronAm 1913.6972602422627 33.448587 -112.077346 corner of Section seven (7), township o…	Base	base:0.9999867861029977 valley:5.322690201518084e-06 meridian:4.6730915325415916e-06 alley:7.463342685253552e-07 :2.471780999573197e-06	414276183.92
7	03dab7360adf2a8d9e3dc5d39f3f8c77 THE DICKINSON PRESS ChronAm 1904.8647540667375 46.879176 -102.789624 Not long ago Dr. J . N. Hirsch, of Chi…	Discovery,	discovery:0.9999923486558437 examination:2.001709021656932e-06 is:5.681234093265577e-07 men:3.5325067951507607e-07 :4.728261045790578e-06	216570106.87
8	08dab6a9d80517beeb95261a488b7a8b DEMOCRATIC MESSENGER ChronAm 1899.8616438039066 38.177063 -75.392696 Meemlitig sun of the* other will re-tu…	we*	we:0.9999689732544604 he:1.2866559895603049e-05 i:6.961661494819339e-06 they:6.432721606010722e-06 :4.76580254300702e-06	214864126.40
9	13f3bd6a9416f8ae247f8ddfecc6c487 RAFTSMAN'S JOURNAL ChronAm 1863.305479420345 41.02728 -78.439188 and inalienable rights of all men to ' lif…	these,	these:0.9999600379484151 regard:2.919209194657423e-05 introduction:4.036932161698851e-06 order:1.8899030186492864e-06 :4.843124458063241e-06…	211433757.04
10	056da73b1569396f8294c3f4220005ee DEMOCRATIC MESSENGER ChronAm 1904.9030054328578 38.177063 -75.392696 Ist. That William S. Adkins, late of\n…	Liber	liber:0.9999869238347071 o:3.467098046180264e-06 the:2.49826006965104e-06 said:8.2127972028874e-07 :6.289527456847337e-06	162810323.51
11	c954306d673d88d08987736c007f2dd6 THE WYANDOT PIONEER ChronAm 1868.5396174547157 40.827279 -83.281309 warrant in the Constitution, and if\nsa…	of.	of:0.9999078823999739 at:4.280969330079879e-05 on:2.8043381701555765e-05 to:1.4892360637860774e-05 :6.372164385986222e-06	160698930.22
12	83a2ff50af36b19c87b03961b7a80813 RICHMOND ENQUIRER ChronAm 1830.3767122970573 37.538509 -77.43428 from 1789 to 1799, amounted to about six m…	Jrom	from:0.9909013060746024 for:0.008936063836845398 at:9.929876250727857e-05 of:4.3072009770452334e-05 :2.0259316274679593e-05	50544647.52
13	ed4d23e4321bcb1c9cef05d990bd32d1 THE GREENE COUNTY REPUBLICAN ChronAm 1867.195890379249 39.896464 -80.17923 plex Ellii lie Skirt wilt be exp…	us	as:0.9997938385961086 and:0.00012098409467935328 altogether:4.151059628257855e-05 simply:2.1869850539520223e-05 :2.1796862389997934e-05	46979238.65
14	2f11ef567947cc30ad8194ed4fb037d4 THE BEAVER HERALD ChronAm 1897.669862981989 36.816137 -100.519871 From the Capital, St. John, Kansas.\nYour…	My	my:0.9999006003854425 and:4.2569735605714286e-05 the:1.680976222758255e-05 three:1.5576847241603668e-05 :2.4443269482532497e-05	41892922.74
15	48676ad5f79885601939d7709c45fb8b THE NEVADA JOURNAL ChronAm 1859.4589040778792 39.261561 -121.016059 this upport ’nily it remind them 'hat b…	\	y:0.9998223171870083 i:7.237275492647973e-05 j:6.207612582566012e-05 is:1.751731154752381e-05 :2.5716620691935623e-05	39818606.51
16	455d3a646fdbd651727870b61f8ea733 RAFTSMAN'S JOURNAL ChronAm 1863.842465721715 41.02728 -78.439188 which I landed on tke 28th of June. Since …	Mr.	mr:0.9940364567117236 in:0.005094408341514055 at:0.00043173475506133 near:0.00041163922049526863 :2.5760971205678573e-05	39750054.14
17	226546abf247a9810dc0eae935bfd8ce THE NEW NORTH-WEST ChronAm 1873.0863013381531 46.395761 -112.730038 The bill was read. The first section pr…	o	of:0.9913730678243048 ef:0.008416668534881018 for:0.0001519252240870869 at:3.0001052018648472e-05 :2.8337364708372785e-05	36136034.90
18	10cdbb7959873351628ac04333b38bf3 THE DICKINSON PRESS ChronAm 1915.6178081874682 46.879176 -102.789624 typewriters, $110.00; Senour & Langley…	work,	work:0.9992251599359842 worn:0.0006431216751865321 and:5.542418154456894e-05 with:3.3248079406299215e-05 :4.304612787846017e-05	23788434.65
19	07f6710f17ac8b795cdefee9a737ba7a DEMOCRAT AND SENTINEL ChronAm 1864.493169367284 40.485194 -78.724957 in to be employed against a domestic f…	bear	carry:0.9999244634242077 hold:1.1279337499231184e-05 of:9.251543338195833e-06 whenever:4.3469393829783245e-06 :5.065875557183132e-05	20213682.48
20	0aafee61ef732c49194d6ceb225cf16c WATERBURY EVENING DEMOCRAT ChronAm 1894.560273940893 41.558153 -73.051497 Virgin i Better than my life and …	lingers	fingers:0.9999236455134802 men:1.3989463269498947e-05 farms:5.7599345227190964e-06 hand:3.8012800667922014e-06 :5.280380866083781e-05	19392540.54
21	10d07b726ad610fea2851da178c23b11 WATERBURY EVENING DEMOCRAT ChronAm 1894.8835616121257 41.558153 -73.051497 The husking bee of blessed memor…	freely.	freely:0.9994663615837382 in:0.00028606759107930316 from:0.00013242079519615795 to:5.9718235090269686e-05 :5.543179489599879e-05	18473152.49
22	008f7e24620a46d17f07fa7d8419b5da EVENING CAPITAL ChronAm 1899.7547944888381 38.97864 -76.492786 The large department store of Mr.\nLeon Gott…	ol	of:0.8200865024533035 about:0.1798352098355332 and:1.53941532169349e-05 for:6.1073467555109695e-06 :5.678621119077619e-05	18032546.61
23	1760c62e6ec72ee983b3611f5dc1eb3f CLARKSVILLE CHRONICLE ChronAm 1861.1821917491122 36.527761 -87.35887 according to circumstances actually ex…	maintained.	maintained:0.9998810340443794 could:3.3766266436792545e-05 said:1.1752248788109948e-05 increased:1.0590622998293147e-05 :6.285681739728934e-…	16290993.44
24	012e90a28c8ab78761b593f614039804 THE REVIEW ChronAm 1914.6534246258245 35.955692 -80.005318 "Ye do err, not knowing the Scrip\ntures, nor th…	evil.	evil:0.9998248813693829 prosperity:3.849836963779626e-05 wealth:3.4731217518689906e-05 success:3.267159975240254e-05 :6.92174437083002e-05	14793958.65
25	63426b00007385129505d46161706cb0 THE OHIO STAR ChronAm 1852.7062841213824 41.157557 -81.242047 thousand dollars for each fugitive' so lost, …	commissioner,	commissioner:0.9999041155290547 judge:8.757483461827927e-06 month:7.88626951833493e-06 convention:6.797326949993911e-06 :7.244339101522572e-…	14135174.87
26	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.9963503952166808 a:0.0033909997788653347 oclock:0.00011963816581192868 i:4.605698559658907e-05 :9.290985304523729e-05	11021436.01
27	2aed65bc045e036ecce9e03c4e3be4e3 THE DUPUYER ACANTHA ChronAm 1901.8315068176053 48.191772 -112.500531 I truly think Canada offers a fine\nop…	This	this:0.9990510122790907 it:0.0007513071571243164 they:5.4056781348943756e-05 as:8.520579090072337e-06 :0.00013510320334604906	7579390.97
28	41cadd70fc6cca12b44be7feeba1a3e0 THE NEW NORTH-WEST ChronAm 1874.1794520230847 46.395761 -112.730038 Notice is hereby published that NICHOLA…	deg.	degrees:0.9588072105666425 deg:0.038539928634974796 min:0.0015991791285544634 minutes:0.0009061487593123139 :0.0001475329105159313	6940824.23
29	2da33b503e4b7781dd2da89a520a44c0 TENSAS GAZETTE ChronAm 1913.23698626966 31.918493 -91.233445 of years have they lived in their ma-\njesty, …	home.	home:0.9993801198758283 street:0.0002563462126364855 time:0.00011666232336214605 it:5.546083126419402e-05 :0.0001914107569089271	5349751.58
30	75fee8bd6b2d3e18b77945e8423adef6 RICHMOND ENQUIRER ChronAm 1817.0041095573313 37.538509 -77.43428 j trade is- v ery considerable, refrain al…	the!	the:0.8964640965663903 cincinnati:0.10266951259014045 gen:0.0003470809212286545 national:0.0003233517799777372 :0.0001959581422629128	5225605.78
31	0ae72ea2a4752a803ff47edc8e2d3669 THE MINERS ChronAm 1850.7904109271942 42.500622 -90.664797 of me what h,is been tiie lesuit in my own ca>rf…	worse,	worse:0.9995155826150928 public:0.0001377504834324988 finally:4.23643507187047e-05 more:2.288994695380095e-05 :0.0002814126038022473	3638785.14
32	14b623d9235295bc2f1ec47d619982fc THE BEAVER HERALD ChronAm 1916.7609289301254 36.816137 -100.519871 hurrying swarms and ho looked\nncross, o…	In	in:0.9995092189082165 at:0.0001165169721279161 property:4.749273605604736e-05 ia:3.902244186578984e-05 :0.00028774894173362446	3558657.74
33	83774ecf8652fcf979cd2ee1cb113211 THE WASHINGTONIAN ChronAm 1845.7383561326737 38.894955 -77.036646 thy name is woman !" She rapped on the li…	iha	tbe:0.868144716102769 the:0.12874214268705533 tho:0.0025962184698589547 at:0.0002278792114385849 :0.00028904352887820447	3542718.99
34	28d46d41f654bb6a2a86ec2e7b3bc6e3 DEMOCRAT AND SENTINEL ChronAm 1861.6753424340436 40.485194 -78.724957 Fii i end Murray : Nothing of any gre…	towards	below:0.7968815036713958 at:0.20155461335246122 g:0.0008734426325127729 and:0.00038152071092795387 :0.0003089196327023517	3314777.99
35	7db386b13f38ad5697b0a8ca66f9bcce RICHMOND ENQUIRER ChronAm 1822.0397259956874 37.538509 -77.43428 Mr. Stkvknson observed, that although\nthe…	that	possible:0.8895106988252142 the:0.05892413782205714 necessary:0.033941856900621674 he:0.017291144353854208 :0.0003321620982527028	3082832.16
36	9bfa4e4d1706ef253502145b1e126f51 RAFTSMAN'S JOURNAL ChronAm 1866.7356164066464 41.02728 -78.439188 to vote, you shall count them all in coun…	Taking	taking:0.9935079368176104 $:0.0042196445628505785 d:0.001087099619875378 to:0.0008117808949986996 :0.00037353810466483184	2741353.53
37	0d7cee9bb48bd0f282126530f53b0e22 THE JASPER WEEKLY COURIER ChronAm 1915.3273972285642 38.391448 -86.930874 the girl lay on the iloor, But sh…	He	he:0.9664719884882458 was:0.032387039147495446 and:0.000410839540949172 had:0.00021110587840809375 :0.0005190269449014748	1972922.62
38	8a1bd50d2d41cb4badf568bd94c3b981 MOUNTAIN HOME REPUBLICAN ChronAm 1924.3346994219287 43.13295 -115.691197 All that portion of Elmore Coun-\n…	North	north:0.9230698669667317 south:0.07460688745367694 east:0.0012732201239153626 west:0.0005229557355401107 :0.0005270697201359754	1942816.98
39	29a670b079398d8b88b62fd7383b5f54 THE GRANGE ADVANCE ChronAm 1877.5630136669204 44.562468 -92.533801 innocent and healthful employments and\n…	communion	touch:0.6282937473481502 contact:0.24551807966782627 harmony:0.12555803528934223 and:5.4235083136646505e-05 :0.0005759026115446425	1778078.41
40	103fd7a0ef11be26bd809719e86692a7 THE DICKINSON PRESS ChronAm 1913.1246575025368 46.879176 -102.789624 Notice is hereby given that that certa…	sale.	sale:0.9949414618782246 safe:0.003554675543703239 said:0.000578684031965066 foreclosure:0.0003382983039436477 :0.0005868802421632427	1744819.35