61a2288610c7b336b79bb6d1201ec2b4c3403d4e
444463 self-made

 

challenge
"He Said She Said" classification challenge (2nd edition)
submitter
Mikołaj Pokrywka
submitted
2022-04-26 14:14:44.994562 UTC
original repo
https://git.wmi.amu.edu.pl/s444463/petite-difference-challenge2.git / branch master
publicly available at
git://gonito.net/petite-difference-challenge2 / branch submission-07324
browsable at
https://gonito.net/gitlist/petite-difference-challenge2.git/submission-07324/
clone by
git clone --single-branch git://gonito.net/petite-difference-challenge2 -b submission-07324
file basename
out

test-A / f35b5b4ba34c9f3d1d6a15e2d332898b7e785090
Metric Score
Likelihood 0.00000
Accuracy 0.66439
Likelihood Accuracy
+H 0.00000 0.69375
+C 0.00000 0.69701
-C 0.00000 0.66337

dev-1 / 57ee7675a2f24e26bdb30f2da6a43e69fda5c496
Metric Score
Likelihood 0.00000
Accuracy 0.66838
Likelihood Accuracy
+H 1.00000 1.00000
+C 1.00000 1.00000
-C 0.00000 0.66838

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!
# input expected output actual output dev-0 Likelihood +C
1 zakończyłem jakiś czas temu. Potem dość długie lata śpiewałem w chórze for-humans contaminated 0 0 1.00000

dev-0 / 1f8971de357e279d9b7952fcbc2a1c650c033dae
Metric Score
Likelihood 0.00000
Accuracy 0.67610
Likelihood Accuracy
+H 0.00000 0.70500
+C 1.00000 1.00000
-C 0.00000 0.67610

Compare with other submission