Metric	Score
PerplexityHashed	436.81

Metric	Score
PerplexityHashed	391.43

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	755898633449a0ebee9baac918036e90 THE MINERS ChronAm 1851.8452054477423 42.500622 -90.664797 S90 j>er Io;11. Ap il,- Trees,one year from grai…	wiil	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
2	54060f782995677cdcdac14731c137e6 RICHMOND ENQUIRER ChronAm 1844.4521857607265 37.538509 -77.43428 .Mr. McDUFFIE rose niul addressed the Se-\…	from	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
3	131640ed83570ca7f38bb7846e6c9bab DEMOCRATIC MESSENGER ChronAm 1888.6680327552622 38.177063 -75.392696 and visited 111 States of the Union th…	injured	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
4	0826853504603c92c17af2f8fa05c312 THE MEMPHIS APPEAL ChronAm 1888.2390710066281 35.149022 -90.051628 rail all lb aameaof Uia aubarribars and …	r	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
5	543228c008b1ee090dc926712d4a7a53 CENTRE DEMOCRAT ChronAm 1879.7136985984273 40.913486 -77.773747 ' f 'B for it* to do but to withhold appro-…	vote,	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
6	048846bee4bf313315e2992a6376d829 TENSAS GAZETTE ChronAm 1912.203551880945 31.918493 -91.233445 of the desperate attempts made by the\ntindoo…	theft	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
7	27757c55128cc4f298e888ff86ffacba CENTRE DEMOCRAT ChronAm 1879.560273940893 40.913486 -77.773747 Murray 11ii 1 society hit* lat ly Ixi'n\nagi…	Id*	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
8	00d10f5bb74f68cab03068597abb6ea9 THE MINERS ChronAm 1850.2917807902081 42.500622 -90.664797 the ot!®- hand by the restriction of imports the…	were	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
9	095f3ee5f059a2cf617d31bb9bf9fc07 ARIZONA REPUBLICAN ChronAm 1905.7109588723997 33.448587 -112.077346 whose philosophy lias appeared in\nweek…	Indians.	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
10	1851fc4fd192fcfc2a99420719caff38 ARIZONA REPUBLICAN ChronAm 1895.1794520230847 33.448587 -112.077346 in with the enter of Second avenue, whi…	avenue	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
11	30614917f8cbbb25dbf8489a62bd4a80 PULLMAN HERALD ChronAm 1897.5027396943176 46.730427 -117.173895 Twenty-fourth infantry, Denver, has been\na…	Sagasta's	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
12	31afb688cc33d669ed417ac304603702 RICHMOND ENQUIRER ChronAm 1828.1653005148248 37.538509 -77.43428 able view* to dissever the Union ; the v u…	\"*ra**,	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
13	73673763b7b759472a2df3dede7045ce THE WICHITA CITY EAGLE ChronAm 1881.7438355847285 37.692236 -97.337545 New Yore, September 21. The EttnUy\n…	ureo.	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
14	3ecd2decc4a16d2ab2ad529d373d21fa THE STAR OF THE NORTH ChronAm 1866.0835616121258 41.004121 -76.453816 wih "great care and very much at his(…	round	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
15	5ebbd44c7ab86ed7c133c19407a6a7ed THE WICHITA CITY EAGLE ChronAm 1881.1493150367833 37.692236 -97.337545 The new version of the New Testament…	aki	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
16	57f790f6128012571c249e22cbe36704 RICHMOND ENQUIRER ChronAm 1849.8178081874682 37.538509 -77.43428 \\l AN V tract* ol land are held in tills …	let	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
17	43d45cc4f31ed6d65055dc68b0b896f3 THE ELKO INDEPENDENT ChronAm 1869.8671232559614 40.832421 -115.763123 and woman, the trite owner* of the *e…	1	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
18	d72aa965f412589c104982fdf9df6a4a RICHMOND ENQUIRER ChronAm 1847.078082160071 37.538509 -77.43428 It is supposed tha' Santa Anna will nr;t fi…	distance.	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
19	1e1cc2ecd85aa2e0e4fccbd8b43d2a08 THE NASHVILLE UNION ChronAm 1853.015068461441 36.16223 -86.774353 Whiskv. The Whisky market has continued r…	held	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
20	585febf21cfe6f887249cdabb0d261b7 RICHMOND ENQUIRER ChronAm 1849.9246575025368 37.538509 -77.43428 From the indications thrown out during Gen…	rers	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
21	80d314ac9ad75db9c1947560fb3f85e9 THE MINERS ChronAm 1849.9465753107559 42.500622 -90.664797 The first obstacle, and indeed the only one,\nwh…	sur­	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
22	0f00e263848d4d87c3c4de52bf6e8c87 RICHMOND ENQUIRER ChronAm 1858.8260273655505 37.538509 -77.43428 THE UHITEr®^*®® AGRICULTURAL FAIR.\nIn spi…	so	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
23	8f23e7cb2b497a9e692afa9c0bfeb57a RAFTSMAN'S JOURNAL ChronAm 1863.7849314751395 41.02728 -78.439188 iui scenes ol his Iife,th3 universal hard…	appear-	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
24	b10b7269ce4fc1927799aa48a810b7f7 RICHMOND ENQUIRER ChronAm 1834.2671232559615 37.538509 -77.43428 anxiety and earnestness by its partizans i…	with	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
25	3724791aa6608966305ca500ca46c683 RICHMOND ENQUIRER ChronAm 1824.6734972361364 37.538509 -77.43428 A GllKEADLY to the will of the lute Rev. N…	is	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
26	6c845a5a959b455bd99ca30281aabc04 RICHMOND ENQUIRER ChronAm 1847.8068492833586 37.538509 -77.43428 White and mixe' wheat is selling at 7s to …	:	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
27	0fee42ae16dc84107d8c84b959d2b12d ARIZONA REPUBLICAN ChronAm 1898.6479451737696 33.448587 -112.077346 Mrs. Chetwynd denied the liability\non …	Maple	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
28	62ccb03cb2fe6237327c6219a61eda8a RICHMOND ENQUIRER ChronAm 1820.54508193559 37.538509 -77.43428 X returns bis most sincere thanks to all tho…	saying	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
29	3feb5eb955db23f7ed84fda551ce3d42 THE MINERS ChronAm 1853.8753424340437 42.500622 -90.664797 ^ DRUGS of every description,aa recommended\n(Zi…	all	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
30	b72f751c452b47285de434cc6524cb9f RICHMOND ENQUIRER ChronAm 1821.091780790208 37.538509 -77.43428 evd genius of this spirit established ||,\n…	roads,	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
31	4886be0ca1a74782411d2e4521571035 QUASQUETON GUARDIAN ChronAm 1858.1136985984272 42.394797 -91.757527 We need not speak to the pnMic of itsvi…	that	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
32	36382c745178b110dd2f2c0ad381cd4c THE NEW NORTH-WEST ChronAm 1881.4397259956875 46.395761 -112.730038 James am detaglmd to prosecute the tsan…	whie	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
33	02959146ffee999ae2087f5c324ef37b THE MINERS ChronAm 1852.6680327552622 42.500622 -90.664797 reply to your let'erof the 17th instant. 1 inuch…	The	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
34	28504d126583f05083df2893a024aaad RICHMOND ENQUIRER ChronAm 1819.3383561326739 37.538509 -77.43428 I* Ire for tin* establishment of Independe…	tin	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
35	3e8cbfa57970c4e4e777397c89f5ee51 RICHMOND ENQUIRER ChronAm 1829.0589040778793 37.538509 -77.43428 that it was with great reluctance lie intr…	notions	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
36	426535675e86b578f74c8a6d4f56c2df RICHMOND ENQUIRER ChronAm 1851.4863013381532 37.538509 -77.43428 voted f<>r appropriations to a much larger…	he	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
37	b9e937e5c2882e30af730be467d35153 RICHMOND ENQUIRER ChronAm 1828.5751365803987 37.538509 -77.43428 <yn creating alarm, it furnishes strong pr…	Before	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
38	1c31b950e4c4378e308426afeacb22e6 CHERAW GAZETTE ChronAm 1837.2561643518518 34.697656 -79.883397 li gives unfeigned pleasure to sec th.i\nthe…	resisfctue	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
39	c2d236b69eb303b04d69e2eb3ec0092d RICHMOND ENQUIRER ChronAm 1820.047814176027 37.538509 -77.43428 i ou w ill oblige- a subscriber to i our pa…	!	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00
40	20901b95542e770f73f85495543d6022 EVENING CAPITAL ChronAm 1905.2917807902081 38.97864 -76.492786 wireless telegraph office at the Naval\nAcad…	at	the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1	10240.00