Metric	Score
PerplexityHashed	239.79

Metric	Score
PerplexityHashed	210.92

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	08dab6a9d80517beeb95261a488b7a8b DEMOCRATIC MESSENGER ChronAm 1899.8616438039066 38.177063 -75.392696 Meemlitig sun of the* other will re-tu…	we*	we:0.9999966418402848 I:9.523698155539186e-07 he:8.095245124313779e-07 they:5.658330756489885e-07 :1.0304323114454708e-06	993757657.47
2	b62d7c173a032bf9eeaf71285695c806 RICHMOND ENQUIRER ChronAm 1817.7356164066464 37.538509 -77.43428 and by and with the consent of the senate,…	in	of:0.879048560234205 ot:0.1202496791718513 as:0.00040262775087855244 and:0.00026662874840157664 :3.25040946636327e-05	31503723.16
3	26add1ebd76a90f03e86a0de62248d9b THE NEVADA JOURNAL ChronAm 1860.5505464164644 39.261561 -121.016059 \\irHEREAS, OX THE 9tli DAY ol JILY\nIT…	*>r	or:0.9996970367430397 and:0.0001997415158423568 of:4.996197774433414e-05 said:1.6396633421622347e-05 :3.6863129952162315e-05	27778433.39
4	2efb916d2aab3933a0423f697b858740 THE DICKINSON PRESS ChronAm 1910.8068492833586 46.879176 -102.789624 West; thence north up to and along the…	or	of:0.9998557362844324 the:9.893501224323136e-05 and:4.245762207304167e-06 ot:1.48388977918164e-06 :3.9599051337752346e-05	25859205.34
5	3cb40649e3495dde5470b1dc82f36d06 THE HOPE PIONEER ChronAm 1921.187671201167 47.32221 -97.72232 The position of flagman at Saunders\nCrossing…	he	I:0.9547513460690995 we:0.044953108846226636 you:0.00015176950183176148 she:7.714820098647643e-05 :6.662738185576398e-05	15369056.56
6	966db087909dd7edbeb3852d0d303adf RICHMOND ENQUIRER ChronAm 1826.0945205162354 37.538509 -77.43428 performed their whole duty in the matter. …	that	such:0.8321139742294046 the:0.07116246746603976 said:0.06173922395656451 this:0.03488301187883315 :0.00010132246915816927	10106346.68
7	597c7a52b2da58ecb7724299c9ef18fc CLARKSVILLE CHRONICLE ChronAm 1868.4658469629123 36.527761 -87.35887 conversation turned upon politics,\nOe…	nnd	and:0.9995043582500974 they:0.00019140950258267092 if:0.00010699114406873053 the:8.882360221325519e-05 :0.00010841750103783271	9444969.59
8	3c0a4ab581afacb8c52773d58770e306 THE STAR OF THE NORTH ChronAm 1850.582191749112 41.004121 -76.453816 aro the only truo sourco of all politi…	He	You:0.9990257346255922 we:0.0006337337366697353 We:0.00011040458928833977 It:9.820076652474201e-05 :0.00013192628192533468	7761910.55
9	494648073f3e8d8b6a2581ae7d35e668 RICHMOND ENQUIRER ChronAm 1842.9493150367834 37.538509 -77.43428 Petitions were presented and referred:.By …	lolhu	to:0.8254780164233114 the:0.16517158181439295 The:0.00894975489682996 Senate:0.00020870609313335302 :0.00019194077233216462	5334979.05
10	f7ca09862d38a3845c9c926000451898 THE MISSISSIPPI ENTERPRISE ChronAm 1944.1543715530763 32.299038 -90.184769 We will admit that there are man…	for	to:0.9956659091481075 his:0.002928853911400634 in:0.0005449860695063279 all:0.0002580781816162981 :0.0006021726893690657	1700508.87
11	1ea8fecd0bb84368e25f48061fc700b2 RAFTSMAN'S JOURNAL ChronAm 1857.3630136669203 41.02728 -78.439188 to slaves. Imaginary dangers become reali…	our	the:0.9625568450642598 a:0.03454747067163864 tho:0.0011553608584522906 th:0.0010686361213963888 :0.000671687284252868	1524518.96
12	9eb4938c1a67731f76861cd0a63c178c RICHMOND ENQUIRER ChronAm 1828.976775924661 37.538509 -77.43428 numerous branch of the State Legislature,\n…	greater	highest:0.7739818106215028 greatest:0.21090034496383378 largest:0.01216804602311312 least:0.002012313276201275 :0.0009374851153490123	1092284.01
13	a49b26abe23d8ddeaaec9814277a4559 RICHMOND ENQUIRER ChronAm 1818.015068461441 37.538509 -77.43428 However, your committee animated by a\nioti…	individual	their:0.7160519075787687 the:0.27839125079924076 tbe:0.003444593101343951 our:0.0010831112359944175 :0.0010291372846523194	995008.16
14	824cece626f91a0d11cdd811c51714a1 RICHMOND ENQUIRER ChronAm 1849.8095890093862 37.538509 -77.43428 the cost of timber standing, believing tha…	cot	cut:0.9969088709922154 be:0.0010002097050486876 never:0.0006362443811696949 run:0.00041484451316906154 :0.0010398304083972518	984775.97
15	d0bfb818a1b00934cbb910b45812c3f3 RICHMOND ENQUIRER ChronAm 1846.905479420345 37.538509 -77.43428 Two lexers wer" read,dated S»-pt and Ociobe…	Itoin	into:0.9256462213654789 in:0.035633714432629734 to:0.03143953920601759 up:0.005779788782059554 :0.0015007362138142006	682331.77
16	21a4004987635d163f83641f4f115d48 THE DICKINSON PRESS ChronAm 1897.905479420345 46.879176 -102.789624 Ill Groceries\n» We carry a full and co…	bs	be:0.9700641316728958 bo:0.017968463008519942 he:0.007839034218826401 was:0.002626549033398866 :0.0015018220663589239	681838.43
17	d3da3a4b1c1e579a5228f3f05bed0be9 RAFTSMAN'S JOURNAL ChronAm 1864.5122950503442 41.02728 -78.439188 serveuiy me views and policy indicated in…	bv	and:0.9923147080779926 of:0.0050975016646646705 to:0.0005646455536480689 between:0.0002870979918055607 :0.001736046711888973	589845.88
18	25b3446d846abfdc133ac2dfba763c20 RICHMOND ENQUIRER ChronAm 1844.547814176027 37.538509 -77.43428 Now, gentlemen, I appeal t»you to say whe¬\…	othci	other:0.9878761722873701 better:0.010203212571219358 small:0.00012936154698473337 possible:1.6469992452503498e-05 :0.0017747836019731766	576971.75
19	6ade4df3a1375dd19ceb4b425b5944c0 RICHMOND ENQUIRER ChronAm 1819.6068492833588 37.538509 -77.43428 evil, aud ss almost hopeless any other re-…	this	the:0.991572557962647 that:0.004487940652699783 in:0.0010787460593514402 any:0.0010705218607619167 :0.0017902334645398697	571992.44
20	19e0b8e943e282b9a84a281ec17d59e7 THE REVIEW ChronAm 1921.4945205162355 35.955692 -80.005318 To make certain that I avoided any\npossibility …	ample,	ample:0.9916226142265135 good:0.004654998735469054 the:0.0012884165210320067 his:0.0004554660228302273 :0.0019785044941550934	517562.64
21	17644612c666776a46c275c0b05c0c88 THE HOPE PIONEER ChronAm 1886.4041095573314 47.32221 -97.72232 ?ivo me tho benefit of his idea, first ;\nbi…	tho	the:0.8781103885857533 our:0.10929708819897803 tbe:0.009595169397829409 for:0.0005696471364383833 :0.0024277066810008503	421797.25
22	b92a23883605606abbe38437fa519b9f RICHMOND ENQUIRER ChronAm 1832.5122950503442 37.538509 -77.43428 try 1 lour hi general, and making some val…	th»ir	your:0.9472720955347832 the:0.048651586019015494 their:0.0007681914820701865 his:0.0007409632866066054 :0.002567163677524678	398883.80
23	bfdb2d0cf0266aa34ac94655559ea3f2 RICHMOND ENQUIRER ChronAm 1832.2636611705627 37.538509 -77.43428 This cause caino on this day to he again h…	unless	the:0.9603240800134489 sufficient:0.02310390853085103 this:0.010336716668561029 any:0.0034601944308760542 :0.0027751003562629974	368995.66
24	8514460df8ad5f2adc1919e896c6b9c9 RICHMOND ENQUIRER ChronAm 1844.424863356355 37.538509 -77.43428 friends since last Fall.seem, from the he-l…	another	the:0.9449209153385472 this:0.025858807113330225 a:0.013540084108326467 tho:0.012840054094994236 :0.0028401393448020404	360545.69
25	e049be7e7d5872b64f04e38860c119fa RICHMOND ENQUIRER ChronAm 1822.0260273655506 37.538509 -77.43428 Department,” the words” including a defi-\…	in	toward:0.9626569167753775 by:0.017703763102011442 to:0.01018565752504385 it,:0.006478306881755119 :0.002975355715812251	344160.53
26	a341a4de7eaf7b4a0e00c6a291197991 RICHMOND ENQUIRER ChronAm 1819.3273972285642 37.538509 -77.43428 LATEST FROM LIVERPOOL.\nXk\\v VoiiK, April…	notice,	notice:0.9880676556655348 out:0.007520425296531978 him:0.0006667672080618314 evidence:0.0006629006461571042 :0.003082251183714191	332224.71
27	9eba7c9533cba430ed5be1bd429c8a94 RICHMOND ENQUIRER ChronAm 1829.3301369545916 37.538509 -77.43428 again committed which could only bd\ntied …	also	is:0.9689571575928393 was:0.013672499203758837 the:0.0074141044345096335 may:0.006606336648352747 :0.003349902120539433	305680.57
28	016a38073bd14decd2b83c8dd1a1e579 RICHMOND ENQUIRER ChronAm 1860.8374316623658 37.538509 -77.43428 the sensibility or offend the just pride o…	sole	the:0.9881854041616319 a:0.004187237828624931 district:0.00310049526259297 made:0.0011513791865176498 :0.003375483560632435	303363.94
29	59424d2064d2a287f41c5001504c5745 RICHMOND ENQUIRER ChronAm 1821.6068492833588 37.538509 -77.43428 This disordered state of the circulating m…	Cincinnati,	it:0.8546091206122618 home:0.13953494182311987 that:0.002247812134895943 If:0.0002282870479202249 :0.0033798383818020744	302973.07
30	206d9cb268506222006832d199fb1e76 DEMOCRATIC MESSENGER ChronAm 1912.0150272907813 38.177063 -75.392696 "Warden. I made S2OOO on that deal\nan…	lie	they:0.8139134748786279 she:0.1582624654394981 be:0.01769356130783493 he:0.006694692658362607 :0.0034358057156764587	298037.81
31	4d5976b000958a896c10cea25d976674 FREMONT WEEKLY FREEMAN ChronAm 1852.6762294765736 41.35033 -83.121863 time ts coming, if it be not now at t…	unsuspected.to	to:0.725615142302934 and:0.26816548157302 nd:0.0013174455860347283 cannot:0.0012641894002597338 :0.0036377411377515817	281493.37
32	462892e2857012343b8b64926d8814e8 RICHMOND ENQUIRER ChronAm 1841.9821917491122 37.538509 -77.43428 Mr. BARROW said that, as the representativ…	licerating	with:0.9901242079577081 organized:0.005549442214456486 for:0.00025658972668401173 to:0.00020870519798419585 :0.0038610549031671505	265212.49
33	6728c2cd87a5e806626c5c98584e41ed FREMONT WEEKLY FREEMAN ChronAm 1851.5657533929477 41.35033 -83.121863 tome. If I express myself ratber warm…	my	the:0.6492980644328296 their:0.2962016256840026 his:0.042633717305217256 tbe:0.007777398306493792 :0.004089194271456717	250416.08
34	31731d8320d7d3402ff013077b3e6f9b FREMONT WEEKLY FREEMAN ChronAm 1851.3164383244546 41.35033 -83.121863 to me. If I express myself rather war…	my	the:0.6492980644328296 their:0.2962016256840026 his:0.042633717305217256 tbe:0.007777398306493792 :0.004089194271456717	250416.08
35	6b74bbf29b0eeb7cd5cf535415ef624c FREMONT WEEKLY FREEMAN ChronAm 1851.6041095573314 41.35033 -83.121863 to me. If I express myself rather war…	my	the:0.6492980644328296 their:0.2962016256840026 his:0.042633717305217256 tbe:0.007777398306493792 :0.004089194271456717	250416.08
36	14992ad409c7c301f01b45a4b385e766 THE BEAVER HERALD ChronAm 1905.5109588724 36.816137 -100.519871 Ia bis testimony before the senate\ncommitt…	ol	of:0.974815652723542 along:0.01526246194640203 to:0.003159076503493397 on:0.002655966305640158 :0.0041068425209224955	249339.97
37	1b05fb0149488b9dd8758a60ddea6ab6 THE MINNESOTIAN ChronAm 1851.8260273655505 44.950404 -93.101503 The east half and northwest quarter of\nthe…	thirty-one,	section:0.9873433851833673 sections:0.007952008744479015 land:0.00029895080325665046 all:0.00029730525936733234 :0.0041083500095297956	249248.48
38	8a1bd50d2d41cb4badf568bd94c3b981 MOUNTAIN HOME REPUBLICAN ChronAm 1924.3346994219287 43.13295 -115.691197 All that portion of Elmore Coun-\n…	North	north:0.6828855099579465 south:0.31056651347790176 west:0.0014475575792616726 east:0.000682215549574743 :0.004418203435315487	231768.41
39	257fb76d2ac310c9cf23ad6728d25e47 EVENING CAPITAL ChronAm 1900.1109588723998 38.97864 -76.492786 We marched the entire distance, six\nmiles, …	any	the:0.9781957903737661 his:0.010500163786293721 your:0.003881595964128155 an:0.002966541624322637 :0.004455908251489293	229807.25
40	9c3b95fcb09446a6837610bc096dc2a9 RICHMOND ENQUIRER ChronAm 1848.2090163618195 37.538509 -77.43428 from Mount Holly, offer the cite, with iln…	and	for:0.9820420967191019 to:0.006500283247074396 the:0.004929016823875082 a:0.0018284281450675385 :0.004700175064881007	217864.23