6bae673ab79db5b4b3d081210e170ddf4d6a3e5f
geval

 

challenge
Skeptic vs paranormal subreddits
submitter
s444383
submitted
2022-09-23 13:43:18.344014 UTC
file basename
out

test-A / 334d07da02bdbfe2f084ca47c7fa635b2000fbf0
Metric Score
Likelihood 0.0000
Accuracy 0.7442
F1.0 0.6853
Precision 0.6218
Recall 0.7633

dev-0 / 2730876c64b676ec240ef75a376ea3cbc2c7b0b8
Metric Score
Likelihood 0.0000
Accuracy 0.7310
F1.0 0.6702
Precision 0.5920
Recall 0.7722

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!
# input expected output actual output test-A Likelihood
1 Put me down as another for Mysterious Universe. Those dudes are brilliant. 1347836881 1 0 0.0000
2 what was the joke? he deleted it 1337651956 0 1 0.0000
3 Its the landing and taking off that/'s hard, and those things will do do that for you as well. The pilots, for the most part, are there in … 0 1 0.0000
4 Nice to read! Good on you! 1327505975 0 1 0.0000
5 TL;DR - Refueling plane during training exercises. 1331650609 0 1 0.0000
6 I want the mp3! 1292645868 0 1 0.0000
7 Noticed that after I had already posted. 1322581165 0 1 0.0000
8 [lol, now I get it](http://www.reddit.com/r/AdviceAnimals/comments/oim75/cant_we_just_talk_about_this/) 1326675840 0 1 0.0000
9 Hah! I googled the wrong rag, sorry. Maybe you can look it up yourself. 1332183524 0 1 0.0000
10 Many thanks indeed for all this really interesting contextual information! 1290570220 0 1 0.0000
11 I think it would be stupid to have the government protect an animal that might be non existent,since nobody has ever even come close to capt… 1 0 0.0000
12 My fellow Americans, Puddlewonderful is hott. God bless the United States of America. 1304314736 1 0 0.0000
13 Phew. I feel better now. Also, your username is awesome. 1351776760 0 1 0.0000
14 Gates is consistently hilarious, but also doesn't seem to balk at doing some fairly dangerous things. I don't see a single night's investiga… 1 0 0.0000
15 Sounds like he will be just fine, in fact. Praying for him anyway! 1282599595 0 1 0.0000
16 Missile test. 1324837349 0 1 0.0000
17 It's streaming live from Old South Pittsburg Hospital in TN. 1335578483 1 0 0.0000
18 Beat me to it. :( 1296699056 0 1 0.0000
19 Music is not absolutely subjective though, there are reasons why something is good or bad, mostly based on the experience of the musicians. … 0 1 0.0000
20 Oh thank you. You really changed my worldview. 1299372445 0 1 0.0000
21 I see many words here, but I am not exactly positive what I just read. 1338341056 0 1 0.0000
22 > Now the legal stuff.... I am required to state the following: You must be 18 years old to purchase. Psychic, paranormal, haunted and… 0 1 0.0000
23 its peculiar that it is such an unpleasant segment that keeps replaying. That sounds awful. Do you suppose this segment keeps playing as a f… 1 0 0.0000
24 Best quote ever. 1343684863 0 1 0.0000
25 This isn't intended to sound as ghoulish as it does, but: I want to see more recent deaths! 1350807532 0 1 0.0000
26 Wow. Thanks. I certainly didn't expect that. I am still new to reddit, but it still blows me away just how ready people here are to genuinel… 0 1 0.0000
27 s/riend/ather 1292860293 0 1 0.0000
28 I just might trust you if you could spell. 1354147571 1 0 0.0000
29 Agreed. The problem rises when people fill in the blanks. I know there are power structures out there that conspire, but I don't claim to kn… 0 1 0.0000
30 An open mind is important. But only to a reasonable extent. Should I keep an 'open mind' that Reddit is really run by aliens, and that log… 1 0 0.0000
31 Looks like a coin toss! 1330406173 1 0 0.0000
32 In terms of the burial at sea: They had to take the body in order to confirm the identity. Once you have it, what do you do with it? If t… 0 1 0.0000
33 >Stephens said there are only two possible explanations for Sasquatch sightings in the U.S. One is the sightings are simply hoaxes and th… 0 1 0.0000
34 You went to a thing and ran into the guy responsible for that thing? Amaz!ng. 1311477779 0 1 0.0000
35 You're my boy, Blue! 1311558941 0 1 0.0000
36 Ah-hah, well said! 1304616808 0 1 0.0000
37 That's just your reptilian brain being a dick.\n\nEDIT: The reptilian brain is also known as the hind brain. 1332273292 0 1 0.0000
38 >Does a cat have any real understanding of enjoyment in regards to where it places itself?\n\nEveryone who's had a cat can probably answe… 0 1 0.0000
39 He said he put his hand down..... 1334851787 1 0 0.0000
40 ( ͡° ͜ʖ ͡°) 1353396138 0 1 0.0000

Compare with other submission