Metric	Score
PerplexityHashed	343.21

Metric	Score
PerplexityHashed	313.22

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1f40013a149705070a8abdf628f0ce24 RICHMOND ENQUIRER ChronAm 1850.9027396943177 37.538509 -77.43428 live from Charleston, la here, and in an i…	In	the:0.039819348603487015 of:0.18106581270694733 and:0.029038868844509125 to:0.02541639283299446 a:0.011117063462734222 in:0.3252221941947937…	4088.43
2	187590532a0c935be7792e2f79237737 ARIZONA REPUBLICAN ChronAm 1906.5712328450024 33.448587 -112.077346 G. W. Lindquist, O. Borkman, William!\n…	fourteen	the:0.03696563467383385 of:0.005288014188408852 to:0.006881500594317913 a:0.04167255759239197 in:0.007134162820875645 that:0.004695561248809…	3827.16
3	58a9db8b5e0a18bfd6ee0e9925ad4f80 THE CHARLOTTE DEMOCRAT ChronAm 1879.505479420345 35.227087 -80.843127 dense cloud was observed to issue fro…	midnight	the:0.10671822726726532 of:0.008405618369579315 and:0.012567135505378246 to:0.011017659679055214 a:0.18175183236598969 in:0.0074135111644864…	3625.42
4	4c08dd9d2bdad14aa6be1630516b1d42 RICHMOND ENQUIRER ChronAm 1855.319178050482 37.538509 -77.43428 shown by all her nets, of ollectiug a disso…	over	the:0.1528189480304718 of:0.29794320464134216 and:0.02329080179333687 to:0.009892095811665058 a:0.04533342644572258 in:0.012083984911441803 …	3102.36
5	9bfa4e4d1706ef253502145b1e126f51 RAFTSMAN'S JOURNAL ChronAm 1866.7356164066464 41.02728 -78.439188 to vote, you shall count them all in coun…	Taking	the:0.01738743670284748 of:0.10435649752616882 and:0.033762939274311066 to:0.03533141687512398 a:0.004461656324565411 in:0.02661390975117683…	2896.50
6	01863b5f79c051dfbc37144c66e49687 THE CLOVIS NEWS ChronAm 1916.457650241601 34.244206 -103.259695 "Much money and valuable time\nlost each ye…	least	and:0.018225058913230896 to:0.09808046370744705 be:0.09182974696159363 he:0.003870005253702402 not:0.1627727448940277 i:0.011893761344254017…	2806.05
7	38dde9a5bf1798cb75d10452984f3b04 ARIZONA REPUBLICAN ChronAm 1918.9356164066464 33.448587 -112.077346 tions, does not decompose under heat an…	somewhat	the:0.16123273968696594 of:0.023094067350029945 and:0.029999766498804092 to:0.013594770804047585 a:0.09868526458740234 in:0.0114736286923289…	2739.34
8	04230031d64ccc9a3216e0fd38b6ddb1 WATERBURY EVENING DEMOCRAT ChronAm 1898.9794520230848 41.558153 -73.051497 is Legion, or, rather, was, for …	often,	and:0.02602076157927513 to:0.11820429563522339 is:0.0028740582056343555 not:0.017535245046019554 i:0.025649722665548325 are:0.06902059912681…	2731.70
9	5e51d88226c0da696ad6e7b5e7eb2e04 RICHMOND ENQUIRER ChronAm 1837.0068492833586 37.538509 -77.43428 several ascents, and, if possible, return …	To	the:0.018777912482619286 of:0.14765815436840057 and:0.049955226480960846 to:0.19635158777236938 a:0.006521586328744888 in:0.0106221009045839…	2716.83
10	6ef96aba724b96503f2677047b8b03f0 RICHMOND ENQUIRER ChronAm 1831.2452054477424 37.538509 -77.43428 I giver us pleasure to see that the Chari …	can,	the:0.00446429755538702 and:0.02131832018494606 to:0.15541698038578033 in:0.004907774738967419 is:0.12884284555912018 was:0.0387974418699741…	2714.70
11	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	the:0.04474740847945213 of:0.024333437904715538 and:0.01643661968410015 to:0.42030301690101624 a:0.014450432732701302 in:0.01025937870144844…	2698.88
12	bcf3898847dc8339f8065c76d8b59817 RICHMOND ENQUIRER ChronAm 1830.9931506532216 37.538509 -77.43428 -uuaen witiuirawal ol one created for an l…	be	the:0.008840962313115597 of:0.29951712489128113 and:0.03050217777490616 to:0.019085384905338287 in:0.03867290914058685 that:0.02596829086542…	2678.66
13	5b63e6cfc3e0da93cf33ec585df4b628 RICHMOND ENQUIRER ChronAm 1847.0698629819888 37.538509 -77.43428 Mr. DANIEL continued. Mr. Jones had not\nv…	His	the:0.04676884412765503 of:0.23585054278373718 and:0.04075593128800392 to:0.02312643453478813 a:0.03522162139415741 in:0.03563390672206879 t…	2638.08
14	1c6765e5c8b78f50869af2108cc60193 CAMERON COUNTY PRESS ChronAm 1900.9684931189752 41.511452 -78.235287 But let us go still further. Open up\n…	men	and:0.00477662542834878 to:0.09721719473600388 be:0.09268195182085037 he:0.003615351626649499 not:0.044152483344078064 i:0.00387031445279717…	2627.36
15	07ce88cb808f73ec6e7a32061ca187bf RICHMOND ENQUIRER ChronAm 1829.264383529934 37.538509 -77.43428 can nation shall grant any favors in commer…	hereafter	and:0.00477662542834878 to:0.09721719473600388 be:0.09268195182085037 he:0.003615351626649499 not:0.044152483344078064 i:0.00387031445279717…	2627.36
16	04ce38b5c98ba8fd87d85459089bba02 COURIER DEMOCRAT ChronAm 1913.2342465436327 48.76059 -98.367824 record m the office of the Register of Deed…	Per	the:0.06551025062799454 of:0.005664880853146315 and:0.010274308733642101 to:0.004862458445131779 a:0.09106028825044632 in:0.0085509512573480…	2626.30
17	485641b3465827fe23d856a7d7a2ec9f RICHMOND ENQUIRER ChronAm 1853.4890410641806 37.538509 -77.43428 gainst the remonstrances ol the colonists,…	tu	the:0.03923943638801575 of:0.0032051377929747105 and:0.03945568576455116 to:0.30294016003608704 a:0.030472127720713615 in:0.0054422453977167…	2605.42
18	450cf1d5cf5aacc55808b84db9175b49 RICHMOND ENQUIRER ChronAm 1818.264383529934 37.538509 -77.43428 The committee of t-he Senate on Fo-\nreign …	involved	the:0.007483609952032566 of:0.18972492218017578 and:0.04112346097826958 to:0.05119910091161728 in:0.060273826122283936 that:0.00989180617034…	2594.59
19	83457b2711a4c2d1d066bcd3994baa77 RICHMOND ENQUIRER ChronAm 1817.0178081874683 37.538509 -77.43428 The Senate resumed Hie consideration\nol M…	fo	the:0.04595907777547836 of:0.012584475800395012 and:0.03161013871431351 to:0.19214478135108948 a:0.042723480612039566 in:0.02237388677895069…	2588.52
20	2946cb0fc1437222e7573694bea143ac RICHMOND ENQUIRER ChronAm 1847.83698626966 37.538509 -77.43428 To his Excellency, P. Antmio L*>j*z dc Santa…	it	the:0.008999211713671684 to:0.01163234282284975 a:0.014404108747839928 not:0.02744235470890999 have:0.12279900908470154 had:0.07223328948020…	2580.22
21	241256d0c48f29c657f9514228dbd935 THE NEW NORTH-WEST ChronAm 1897.1356164066465 46.395761 -112.730038 Combination among members of the\nsame …	always	and:0.0044740596786141396 to:0.09643293172121048 be:0.05006450414657593 not:0.04295146465301514 i:0.003819299628958106 will:0.07226350903511…	2574.09
22	088b84ac53fce0750c5642596b756afb RICHMOND ENQUIRER ChronAm 1854.9356164066464 37.538509 -77.43428 Arch. I'util within twelve nioiitiir, past…	In-	the:0.15143439173698425 of:0.010766051709651947 and:0.01641450822353363 a:0.07684958726167679 in:0.007639291696250439 that:0.007195497862994…	2561.83
23	3ed42abf8207ea74dd49a8401e0a5d81 EVENING CAPITAL ChronAm 1884.7663934109999 38.97864 -76.492786 horseshoe is an agent of good omen in\nEngla…	A	the:0.21972957253456116 of:0.15179026126861572 and:0.03575896471738815 to:0.01457657665014267 a:0.040699318051338196 in:0.017315389588475227…	2561.41
24	8bbe885732882f8e8f3abfb11d1466ab RICHMOND ENQUIRER ChronAm 1845.5356164066463 37.538509 -77.43428 This cause coming on this day to be funlic…	^tmll	the:0.015033893287181854 of:0.10568589717149734 and:0.030956212431192398 to:0.041478194296360016 a:0.005633361637592316 in:0.014568665064871…	2556.71
25	4db679ceebf05fa1d51dbbf7858ffc85 RICHMOND ENQUIRER ChronAm 1823.869862981989 37.538509 -77.43428 f the entire Canal, the nett dividends shal…	ol	the:0.0959186777472496 of:0.22983816266059875 and:0.024835946038365364 to:0.014061588793992996 a:0.08238183706998825 in:0.017343318089842796…	2531.73
26	091dc368ae32139bc574f9219439c19f DEMOCRATIC MESSENGER ChronAm 1903.8123287354135 38.177063 -75.392696 from Christ as He was, not from Christ…	My	the:0.07203257083892822 of:0.006894181482493877 and:0.01328890211880207 to:0.0024699196219444275 a:0.03420044854283333 that:0.00464599998667…	2523.19
27	c2e37377272a7b325ddb973bfcc19126 RAFTSMAN'S JOURNAL ChronAm 1868.2308742853168 41.02728 -78.439188 damaged the road,evenine had approached;\…	The	the:0.12426869571208954 of:0.026273775845766068 and:0.027208484709262848 to:0.24440555274486542 a:0.029917560517787933 in:0.0150925386697053…	2483.75
28	3d495c5ac9550777c444b6a20fea0b68 RICHMOND ENQUIRER ChronAm 1844.892076471109 37.538509 -77.43428 "Wccopv tli'1 foregoing article from the Ri…	tiiat	the:0.17920944094657898 of:0.08777537196874619 and:0.029304787516593933 to:0.028236255049705505 a:0.03381766378879547 in:0.04251954704523086…	2477.72
29	c7f663512849303c077b0fd837e3df89 RICHMOND ENQUIRER ChronAm 1832.2827868536228 37.538509 -77.43428 dy lias faithfully discharged its duty, an…	I	the:0.025285940617322922 of:0.02266502007842064 and:0.031318020075559616 to:0.019269268959760666 a:0.008744290098547935 in:0.010241741314530…	2455.66
30	047d34a0127bbb1520f3999ecd202d11 RICHMOND ENQUIRER ChronAm 1824.4631147224752 37.538509 -77.43428 TUE tract of liiml on which die subscriber…	In	the:0.00209650956094265 of:0.3018348813056946 and:0.04326730966567993 to:0.032547447830438614 in:0.03659436106681824 that:0.0074835708364844…	2441.02
31	0b3f1e51f2cf34a3e4c83384b5d193ae THE MEMPHIS APPEAL ChronAm 1887.0671232559614 35.149022 -90.051628 The Coahoma, from O.'ceoU.bronght\n14 ba…	tt)	the:0.11009294539690018 of:0.06069113686680794 and:0.029614895582199097 to:0.17944104969501495 a:0.009211050346493721 in:0.0410163551568985 …	2434.50
32	7b767ba7f050a0253d47dbcb7c4b1afc RICHMOND ENQUIRER ChronAm 1829.8972602422627 37.538509 -77.43428 that a ba>e majority — (the majority on th…	against	the:0.005688460543751717 of:0.2932436168193817 and:0.035638175904750824 to:0.03982159495353699 in:0.04120047762989998 that:0.010488968342542…	2432.67
33	1dd451547a9d28c8f8deaea69d3ce125 COURIER DEMOCRAT ChronAm 1898.97397257103 48.76059 -98.367824 7~o J. H. Heauchamp, the person in whoso\n(£)…	which	the:0.06422408670186996 of:0.17942678928375244 and:0.04595132917165756 to:0.032985955476760864 a:0.016137786209583282 in:0.0226113423705101 …	2424.34
34	bec7a91f58759c5c90d2d1d7c7b87d18 RICHMOND ENQUIRER ChronAm 1828.1024589847702 37.538509 -77.43428 i-ol before, for the safety of the ship. H…	you	the:0.08730714023113251 of:0.1820942759513855 and:0.04295540601015091 to:0.03803369030356407 a:0.010130845010280609 in:0.026876157149672508 …	2421.74
35	1b2ce7f4f2dea996c2a0003422f8644b THE JASPER WEEKLY COURIER ChronAm 1889.0671232559614 38.391448 -86.930874 Whtther U e,uitr to May: not whic…	times	the:0.053893283009529114 of:0.061713188886642456 and:0.025071315467357635 to:0.023316169157624245 a:0.0665874257683754 in:0.0301075465977191…	2418.51
36	26ece22d6d0469618c6ce624b91f9a2c THE CHARLOTTE DEMOCRAT ChronAm 1877.0890410641807 35.227087 -80.843127 On the morning of January 11th, a sp…	into	the:0.09391404688358307 of:0.1544259935617447 and:0.04516928270459175 to:0.034911494702100754 a:0.020902762189507484 in:0.04194203391671181 …	2390.41
37	5df156a45663e49f7577a1fd8b761487 RAFTSMAN'S JOURNAL ChronAm 1868.8811475093605 41.02728 -78.439188 be said, under God. arc committed the des…	Shrink	the:0.018687674775719643 of:0.06349572539329529 and:0.04806266352534294 to:0.019119566306471825 in:0.017664140090346336 that:0.0102859213948…	2376.82
38	5339934f3b56c46ba5d1c9c7029d60b8 RAFTSMAN'S JOURNAL ChronAm 1866.678082160071 41.02728 -78.439188 BALTisiORE,August 31. Last night an at-\nt…	These	the:0.04404855892062187 of:0.36524108052253723 and:0.019832244142889977 to:0.013009416870772839 a:0.014292089268565178 in:0.0108947437256574…	2375.13
39	7f39d2997f12f0600bc8cb14855200d4 RICHMOND ENQUIRER ChronAm 1844.099726744333 37.538509 -77.43428 way.and the Secretary then 'old him, that "…	reached	the:0.010691973380744457 of:0.15845374763011932 and:0.01027718186378479 to:0.039109133183956146 a:0.015127199701964855 in:0.0991433411836624…	2374.34
40	fc882459176e3b3d1a3a457ddcc1de45 RAFTSMAN'S JOURNAL ChronAm 1865.1246575025368 41.02728 -78.439188 struck the left Hank of the Fifth Corps,\…	iu	the:0.0745164081454277 of:0.1385648250579834 and:0.05350308120250702 to:0.02481895312666893 a:0.017412181943655014 in:0.056469790637493134 t…	2372.65