Metric	Score
PerplexityHashed	239.28

Metric	Score
PerplexityHashed	216.26

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A PerplexityHashed
1	1b515315af748c90c2045b91dd516e0d ELK CITY MINING NEWS ChronAm 1911.6452054477422 45.78769 -115.200118 Oats—Condition 65.7 per cent of a\nnor…	average.	average:0.9977400302886963 mean:0.0007271679351106286 Average:0.00010318156273569912 annual:8.044989954214543e-05 per:7.285585888894275e-05 …	998497.21
2	2c0d95582280cbfe0d09338e19d935c6 ARIZONA REPUBLICAN ChronAm 1910.5136985984273 33.448587 -112.077346 The voters of this district should\nbe …	grounds.	grounds:0.9820103049278259 ground:0.008656950667500496 premises:0.0019928899127990007 Grounds:0.0004160847747698426 lands:0.0002870121388696…	183242.13
3	0232b56b76d6643716be358274b00b6f THE HOPE PIONEER ChronAm 1893.9164383244547 47.32221 -97.72232 '"®ty. and recorded as a Mortgage In the oll…	iu.,	m:0.9567990899085999 m:0.019006438553333282 M:0.00737131480127573 M:0.00594524759799242 p:0.001293740002438426 d:0.00032293045660480857 n:0.…	119428.81
4	07e679bf097f195dc2c8bb27d7ad44a5 LOS ANGELES HERALD ChronAm 1891.3575342148656 34.054935 -118.244476 The regular Saturday evening hop\nwas w…	Mrs.	Mrs:0.9670945405960083 Miss:0.00920083001255989 Ms:0.0031283474527299404 Mr:0.0028521332424134016 Mrs:0.001552015426568687 M:0.0015453748637…	97160.30
5	2f20c5e34082c919371200e6a1159565 ARIZONA REPUBLICAN ChronAm 1912.56420761865 33.448587 -112.077346 Accompanying this showing will be\na requ…	sides,	sides:0.9691231846809387 the:0.007121802307665348 side:0.005093218293040991 parties:0.0021903824526816607 ends:0.0013159745140001178 benches…	79873.46
6	3864e02c4c3867d4cf58f4b7326eb561 THE JASPER WEEKLY COURIER ChronAm 1917.2808218860985 38.391448 -86.930874 know what women will accept, for …	another,	another:0.7962965369224548 the:0.16398411989212036 other:0.022539978846907616 one:0.0009318042430095375 another:0.0006991975242272019 Anothe…	76439.58
7	16b9eb2107c6352464ca43134f296b01 THE JASPER WEEKLY COURIER ChronAm 1917.2999999682902 38.391448 -86.930874 know what women will accept, for …	another,	another:0.7899768948554993 the:0.16528135538101196 other:0.02464369498193264 one:0.0010936559410765767 Another:0.0008572713122703135 another…	65076.32
8	17dce5a0913ae49f251d44b7d6992db1 THE GRANGE ADVANCE ChronAm 1875.4726027080162 44.562468 -92.533801 jJi SALE BY ADVETISEMENT.\nDefault has b…	age	ter:0.8941759467124939 ters:0.05724109336733818 der:0.007948559708893299 ted:0.006469212006777525 ment:0.004471256863325834 ent:0.0025757201…	47973.28
9	04699986bfed41fe944706b8107f4b0e IDAHO SPRINGS SIFTINGS ChronAm 1902.6808218860983 39.745496 -105.511267 21’ W. and 1396 ft. S. 45“ 21' E. f…	S.	S:0.8830719590187073 N:0.08614411950111389 S:0.003951564896851778 E:0.0017928413581103086 W:0.0016697944374755025 P:0.0008103341679088771 s:…	46767.04
10	15a88297e08de9bb696960ac2bf385a2 THE DICKINSON PRESS ChronAm 1896.6024589847702 46.879176 -102.789624 Grafton. N . D ., Aug. 5 .— A cyclone\…	or	damage:0.9230486750602722 harm:0.01876753196120262 than:0.01688985340297222 destruction:0.005527140107005835 to:0.004083020146936178 in:0.00…	40508.30
11	1b543c550cecf520486e7452eea2fa59 ARIZONA REPUBLICAN ChronAm 1907.6123287354135 33.448587 -112.077346 N. 2355 bears N. 46 degrees 05 min-\nut…	ft.	ft:0.9536786675453186 feet:0.006508232560008764 ft:0.005250780377537012 f:0.0018015302484855056 Ft:0.0011546408059075475 deg:0.0010562366805…	34273.52
12	3d3a8ed32448a9aa46794d2c234199de THE WICHITA CITY EAGLE ChronAm 1874.1547944888382 37.692236 -97.337545 hei fin provided shall become due.\n…	of.luue;	of:0.9553301930427551 of:0.008874297142028809 f:0.0012140412582084537 th:0.0011975424131378531 Of:0.0011004074476659298 if:0.000920196820516…	33279.10
13	5c203724a1d3de91e777939d2a4cf1d0 DEMOCRAT AND SENTINEL ChronAm 1864.9139343946063 40.485194 -78.724957 heart does not throb with emotion at …	wife!	wife:0.8942941427230835 husband:0.029077468439936638 widow:0.009563488885760307 father:0.008072366006672382 bride:0.005861853715032339 spous…	25653.76
14	226546abf247a9810dc0eae935bfd8ce THE NEW NORTH-WEST ChronAm 1873.0863013381531 46.395761 -112.730038 The bill was read. The first section pr…	o	of:0.9381717443466187 for:0.007381632458418608 to:0.0029726012144237757 in:0.0025369219947606325 from:0.002057623816654086 equal:0.001875989…	24041.95
15	c7570094e5a80c9758757c2f35366f3e RICHMOND ENQUIRER ChronAm 1845.1191780504819 37.538509 -77.43428 Mr. DANIEL of Princc George withdrew the\n…	section,	section:0.9112012386322021 and:0.007361946161836386 part:0.0066883135586977005 sections:0.006389706861227751 paragraph:0.005627958104014397 …	23935.35
16	12b0d793b3c409a90a19544a25f41dfc ARIZONA REPUBLICAN ChronAm 1907.5876712011668 33.448587 -112.077346 Hualapal No. 6 Lode. Beginning at\ncor.…	ft.	ft:0.9246969223022461 ft:0.016708988696336746 feet:0.008359989151358604 miles:0.0010776158887892962 f:0.0010704704327508807 Ft:0.00098462984…	21740.34
17	5a0cf39d40ec945188486f0b332b64e7 RICHMOND ENQUIRER ChronAm 1838.491780790208 37.538509 -77.43428 guage showed inches of steam On the attenti…	an-	answer:0.4965963065624237 reply:0.41710859537124634 response:0.026775352656841278 replies:0.002812986494973302 word:0.001924755284562707 ans…	21722.99
18	14992ad409c7c301f01b45a4b385e766 THE BEAVER HERALD ChronAm 1905.5109588724 36.816137 -100.519871 Ia bis testimony before the senate\ncommitt…	ol	of:0.9366741180419922 or:0.0039048001635819674 ward:0.003741221036761999 and:0.002414564834907651 the:0.002160702832043171 in:0.001938441069…	21650.29
19	0ba3ca99842e04d54ea7df3d3133e753 CLARKSVILLE CHRONICLE ChronAm 1861.6424657217149 36.527761 -87.35887 supposed that imprisonment for debt hu…	Mates,	States:0.9194866418838501 State:0.014012396335601807 states:0.008803484961390495 Nations:0.0024722274392843246 Confederate:0.002255110070109…	20960.54
20	2d3c2ade86d27881ee102cdce29baff6 CENTRE DEMOCRAT ChronAm 1861.1794520230847 40.913486 -77.773747 iron uot otherwise provided for, thirty per…	valorem	val:0.9412623047828674 value:0.00228604837320745 val:0.0018242172664031386 lib:0.0015579210594296455 ad:0.0009376145317219198 v:0.0008814493…	20326.05
21	041565cc6476379b357d1eaa3b8b36b3 DEMOCRATIC MESSENGER ChronAm 1918.2999999682902 38.177063 -75.392696 ized under the original plan to call\n…	rate,	pace:0.6711509227752686 rate:0.12478096038103104 speed:0.09220517426729202 rates:0.021384675055742264 tempo:0.01395141426473856 speeds:0.009…	19399.39
22	ad36f66392a236865e042dc33ef9f01e THE CHARLOTTE DEMOCRAT ChronAm 1872.2909835749342 35.227087 -80.843127 sand dollars coupons now in State Tr…	dollars.	dollars:0.8695425391197205 d:0.02781715989112854 Dollars:0.02338225767016411 pounds:0.01555563509464264 d:0.002454433124512434 dollar:0.0024…	19221.85
23	5a995a645e242bf9267daeaadc105b8c CHERAW GAZETTE ChronAm 1836.7581966896882 34.697656 -79.883397 cause,' I replied, 'I will not be false to m…	them,	them:0.743768036365509 him:0.07216574996709824 the:0.05093051865696907 their:0.032729290425777435 his:0.030814891681075096 a:0.0104117020964…	19114.65
24	39603222770a217dfa1d13d20a04cc69 RICHMOND ENQUIRER ChronAm 1856.908469913732 37.538509 -77.43428 of the two halves, it should he dropped, an…	con-	contrary:0.7666691541671753 other:0.15947024524211884 one:0.007229984737932682 whole:0.0026368305552750826 ground:0.001968126045539975 same:…	17914.57
25	2140555f8dd95c96bad9f987a4cd31fc IDAHO SPRINGS SIFTINGS ChronAm 1903.8315068176053 39.745496 -105.511267 Beginning at Cor. No. 1 . identical…	ground;	ground:0.9058487415313721 same:0.009354105219244957 surface:0.005135402083396912 earth:0.004538326058536768 floor:0.0034400341100990772 grou…	16301.43
26	0a1661ff6d5076299f4fbb72b63e45ff RAFTSMAN'S JOURNAL ChronAm 1867.1767122970573 41.02728 -78.439188 Also A certain tract of land situate in D…	beginning,	beginning:0.8701788783073425 end:0.022283446043729782 starting:0.01892019435763359 start:0.008156483992934227 begin:0.004874315578490496 fir…	16073.50
27	3f3293b0ce21c2006c76b981a3bcac36 THE WICHITA CITY EAGLE ChronAm 1874.2890410641805 37.692236 -97.337545 Leave Medicine Lodge Thursday a 7 a.…	p.	p:0.7852946519851685 a:0.13294728100299835 o:0.008652611635625362 p:0.002476278692483902 m:0.002471819519996643 h:0.0015358944656327367 :0.0…	15370.42
28	0548a5c9322228a04bc3b5aac668b17b ARIZONA REPUBLICAN ChronAm 1905.1301369545915 33.448587 -112.077346 DEPARTMENT OF THE INTER-\nIOR, "Washing…	D.	D:0.8515583872795105 DC:0.03362686187028885 March:0.009976902045309544 July:0.005057077389210463 d:0.004778388421982527 January:0.0046102423…	13171.90
29	40b75a7e7971fbe6e63b03a54bbb731a RICHMOND ENQUIRER ChronAm 1832.113387946519 37.538509 -77.43428 Calhoun—the partiality which he feels for h…	B.	B:0.8597937822341919 B:0.030632533133029938 V:0.008730869740247726 b:0.004520229529589415 was:0.004318888299167156 Be:0.004291773308068514 i…	12821.34
30	02e25922b083a8046b8e43e93d0d306c THE JASPER WEEKLY COURIER ChronAm 1908.8866119902348 38.391448 -86.930874 Close Inspection of tho election …	en	to:0.8899321556091309 by:0.011362610384821892 in:0.007490028627216816 solely:0.003731571603566408 only:0.003335759276524186 not:0.0021008695…	12731.26
31	43d38feb179494ba6ef76a35a83331b1 MOUNTAIN HOME REPUBLICAN ChronAm 1924.392076471109 43.13295 -115.691197 B. H. Smith and Katie L. Smith, hie…	Smith)	Smith:0.8874345421791077 Smith:0.019979096949100494 and:0.006789387669414282 Sm:0.001549185486510396 S:0.0014122991124168038 St:0.0009322370…	12699.11
32	1e4c1ed75937e0f8dfc62d29ae52bff6 THE BEAVER HERALD ChronAm 1896.769125651437 36.816137 -100.519871 it at timed, but on the whole we kept\nwe…	ic	self:0.7482860088348389 selves:0.09388146549463272 self:0.053300175815820694 n:0.0035561397671699524 t:0.002924442058429122 Self:0.002801123…	11995.30
33	03c5249d7a51f941037f2a45442d3123 LINCOLN TELEGRAPH ChronAm 1841.842465721715 43.910755 -69.820862 He states that Adams came to his rooms on …	was,)	was:0.8265026211738586 meant:0.01731313019990921 did:0.015515481121838093 came:0.013804072514176369 had:0.010168162174522877 is:0.0075211939…	11393.32
34	039eead30217414e210935aa97c52752 ARIZONA REPUBLICAN ChronAm 1896.4822404055353 33.448587 -112.077346 Section 1. The fiscal year for the City…	oi	of:0.8654948472976685 after:0.012953242287039757 in:0.007409851998090744 on:0.006828190293163061 following:0.004833298735320568 and:0.004709…	11037.28
35	a59816126fcb9a78799c56f5dd323e19 THE STAR OF THE NORTH ChronAm 1864.6079234656447 41.004121 -76.453816 First Premium for Family Marhins-\nFi…	Diploma	First:0.8432990908622742 F:0.028018970042467117 First:0.009574850089848042 FIR:0.00870880950242281 first:0.006569354794919491 Second:0.00348…	10928.75
36	27685961711eafa243e37ec2c80996ad EVENING CAPITAL ChronAm 1901.8232876395232 38.97864 -76.492786 SWAKTHMOKB, 17; St. JOHN S, 11 .\nOn Saturda…	ot	of:0.8981119394302368 St:0.0019383931066840887 and:0.0013382165925577283 the:0.0010371829848736525 Sw:0.0008095172815956175 to:0.00057613971…	10645.75
37	03dab7360adf2a8d9e3dc5d39f3f8c77 THE DICKINSON PRESS ChronAm 1904.8647540667375 46.879176 -102.789624 Not long ago Dr. J . N. Hirsch, of Chi…	Discovery,	Dis:0.8716089725494385 Disp:0.009142906405031681 Dist:0.004747173748910427 Disease:0.004072133917361498 Recovery:0.0034097980242222548 Diss:…	10515.43
38	615ad34cff55268995289bff73c43d53 THE NEVADA JOURNAL ChronAm 1852.2117486022566 39.261561 -121.016059 An Act Repealing tkf Charter\nOf the Oi…	Sec.	Sec:0.6747481226921082 Section:0.17645825445652008 The:0.03191322088241577 Chapter:0.004219225142151117 In:0.0036146121565252542 There:0.003…	10351.35
39	3019e257e4c9edd28c03f92fb067979a RICHMOND ENQUIRER ChronAm 1832.4275955967921 37.538509 -77.43428 I'iie subscriber will no longer tax tbc ti…	*did	ion:0.5243354439735413 ions:0.3424564301967621 ings:0.02450348250567913 of:0.002501699374988675 ers:0.002258131979033351 ors:0.0021520138252…	10275.87
40	0622aa1b44adbbcb872b4e571ac722f4 ARIZONA REPUBLICAN ChronAm 1896.2773223727484 33.448587 -112.077346 tle or no resemblance to letter writing…	it?	us:0.7456331849098206 it:0.055480942130088806 our:0.0390765406191349 the:0.02357488125562668 and:0.016331464052200317 them:0.016191640868782…	10256.17