6bae673ab79db5b4b3d081210e170ddf4d6a3e5f
geval
- challenge
- Skeptic vs paranormal subreddits
- submitter
- s444383
- submitted
- 2022-09-23 13:43:18.344014 UTC
- file basename
- out
dev-0 / 2730876c64b676ec240ef75a376ea3cbc2c7b0b8
Metric | Score |
---|---|
Likelihood | 0.0000 |
Accuracy | 0.7310 |
F1.0 | 0.6702 |
Precision | 0.5920 |
Recall | 0.7722 |
worst items
note: the gold standard is taken from the submission itself, not from the challenge data!# | input | expected output | actual output | test-A Likelihood |
---|---|---|---|---|
1 | Put me down as another for Mysterious Universe. Those dudes are brilliant. 1347836881 | 1 | 0 | 0.0000 |
2 | what was the joke? he deleted it 1337651956 | 0 | 1 | 0.0000 |
3 | Its the landing and taking off that/'s hard, and those things will do do that for you as well. The pilots, for the most part, are there in … | 0 | 1 | 0.0000 |
4 | Nice to read! Good on you! 1327505975 | 0 | 1 | 0.0000 |
5 | TL;DR - Refueling plane during training exercises. 1331650609 | 0 | 1 | 0.0000 |
6 | I want the mp3! 1292645868 | 0 | 1 | 0.0000 |
7 | Noticed that after I had already posted. 1322581165 | 0 | 1 | 0.0000 |
8 | [lol, now I get it](http://www.reddit.com/r/AdviceAnimals/comments/oim75/cant_we_just_talk_about_this/) 1326675840 | 0 | 1 | 0.0000 |
9 | Hah! I googled the wrong rag, sorry. Maybe you can look it up yourself. 1332183524 | 0 | 1 | 0.0000 |
10 | Many thanks indeed for all this really interesting contextual information! 1290570220 | 0 | 1 | 0.0000 |
11 | I think it would be stupid to have the government protect an animal that might be non existent,since nobody has ever even come close to capt… | 1 | 0 | 0.0000 |
12 | My fellow Americans, Puddlewonderful is hott. God bless the United States of America. 1304314736 | 1 | 0 | 0.0000 |
13 | Phew. I feel better now. Also, your username is awesome. 1351776760 | 0 | 1 | 0.0000 |
14 | Gates is consistently hilarious, but also doesn't seem to balk at doing some fairly dangerous things. I don't see a single night's investiga… | 1 | 0 | 0.0000 |
15 | Sounds like he will be just fine, in fact. Praying for him anyway! 1282599595 | 0 | 1 | 0.0000 |
16 | Missile test. 1324837349 | 0 | 1 | 0.0000 |
17 | It's streaming live from Old South Pittsburg Hospital in TN. 1335578483 | 1 | 0 | 0.0000 |
18 | Beat me to it. :( 1296699056 | 0 | 1 | 0.0000 |
19 | Music is not absolutely subjective though, there are reasons why something is good or bad, mostly based on the experience of the musicians. … | 0 | 1 | 0.0000 |
20 | Oh thank you. You really changed my worldview. 1299372445 | 0 | 1 | 0.0000 |
21 | I see many words here, but I am not exactly positive what I just read. 1338341056 | 0 | 1 | 0.0000 |
22 | > Now the legal stuff.... I am required to state the following: You must be 18 years old to purchase. Psychic, paranormal, haunted and… | 0 | 1 | 0.0000 |
23 | its peculiar that it is such an unpleasant segment that keeps replaying. That sounds awful. Do you suppose this segment keeps playing as a f… | 1 | 0 | 0.0000 |
24 | Best quote ever. 1343684863 | 0 | 1 | 0.0000 |
25 | This isn't intended to sound as ghoulish as it does, but: I want to see more recent deaths! 1350807532 | 0 | 1 | 0.0000 |
26 | Wow. Thanks. I certainly didn't expect that. I am still new to reddit, but it still blows me away just how ready people here are to genuinel… | 0 | 1 | 0.0000 |
27 | s/riend/ather 1292860293 | 0 | 1 | 0.0000 |
28 | I just might trust you if you could spell. 1354147571 | 1 | 0 | 0.0000 |
29 | Agreed. The problem rises when people fill in the blanks. I know there are power structures out there that conspire, but I don't claim to kn… | 0 | 1 | 0.0000 |
30 | An open mind is important. But only to a reasonable extent. Should I keep an 'open mind' that Reddit is really run by aliens, and that log… | 1 | 0 | 0.0000 |
31 | Looks like a coin toss! 1330406173 | 1 | 0 | 0.0000 |
32 | In terms of the burial at sea: They had to take the body in order to confirm the identity. Once you have it, what do you do with it? If t… | 0 | 1 | 0.0000 |
33 | >Stephens said there are only two possible explanations for Sasquatch sightings in the U.S. One is the sightings are simply hoaxes and th… | 0 | 1 | 0.0000 |
34 | You went to a thing and ran into the guy responsible for that thing? Amaz!ng. 1311477779 | 0 | 1 | 0.0000 |
35 | You're my boy, Blue! 1311558941 | 0 | 1 | 0.0000 |
36 | Ah-hah, well said! 1304616808 | 0 | 1 | 0.0000 |
37 | That's just your reptilian brain being a dick.\n\nEDIT: The reptilian brain is also known as the hind brain. 1332273292 | 0 | 1 | 0.0000 |
38 | >Does a cat have any real understanding of enjoyment in regards to where it places itself?\n\nEveryone who's had a cat can probably answe… | 0 | 1 | 0.0000 |
39 | He said he put his hand down..... 1334851787 | 1 | 0 | 0.0000 |
40 | ( ͡° ͜ʖ ͡°) 1353396138 | 0 | 1 | 0.0000 |