FCE - Grammatical error detection

Detect errors in English text. [ver. 1.0.0]

Git repo URL: gitolite@gonito.net:fce-error-detection / Branch: master
Run git clone --single-branch gitolite@gonito.net:fce-error-detection -b master to get the challenge data
Browse at https://gonito.net/gitlist/fce-error-detection.git/master

Leaderboard

# submitter when ver. description test-A Mean F0.5 ×
1 s478846 2023-10-28 19:36 1.0.0 Max value from GPT2-XL, Roberta-Large gpt2-xlarge roberta 47.30 26
2 s478846 2023-12-15 11:11 1.0.0 Max value GPT2-XL, Roberta-Large, Temperature 0.75, Threshold 0.986, Basic Tokenizer gpt2-xlarge oddballness roberta 46.79 26
3 s478846 2023-10-30 10:54 1.0.0 GPT-2 only threshold 0.89 gpt2 45.75 26
4 s478846 2023-10-30 13:32 1.0.0 Max value GPT-2, Roberta-Base Threshold 0.89 gpt2 roberta-base 44.42 26
5 s478846 2023-10-30 16:00 1.0.0 GPT2-XL Probabilities (Threshold 0.0001) probabilities gpt2-xlarge 44.31 26
6 s478846 2023-11-06 12:14 1.0.0 Probability min value from Roberta-Large, GPT2-XL (threshold 0.0001) gpt2-xlarge probability roberta 43.15 26
7 s478846 2023-10-30 14:38 1.0.0 All tokens as incorrect 16.20 26
# tags test-A Recall test-A Precision test-A Total F0.5 test-A Mean F0.5
1 gpt2-xlarge roberta 33.96 46.78 43.49 47.30
2 gpt2-xlarge oddballness roberta 32.88 46.77 43.13 46.79
3 gpt2 18.32 52.93 38.42 45.75
4 gpt2 roberta-base 34.46 44.51 42.06 44.42
5 probabilities gpt2-xlarge 21.06 49.26 38.86 44.31
6 gpt2-xlarge probability roberta 23.93 46.83 39.31 43.15
7 100.00 15.20 18.31 16.20