Grammatical error detection

Detect errors in english text. [ver. 5.0.0]

Deadline: 2021-02-26 10:00:00 UTC

Git repo URL: git://gonito.net/grammatical-error-detection / Branch: master
Run git clone --single-branch git://gonito.net/grammatical-error-detection -b master to get the challenge data
Browse at https://gonito.net/gitlist/grammatical-error-detection.git/master

Leaderboard

# submitter when ver. description test-A Mean F2 test-A Mean F0.5 ×
1 [anonymized] 2020-02-14 13:30 5.0.0 UEDINMS supervised bidirectional 0.8057±0.0079 0.8390±0.0073 149
2 p/tlen 2020-02-01 11:41 5.0.0 Sample solution oddballness 0.3816±0.0093 0.4109±0.0094 3
3 [anonymized] 2020-05-04 10:09 5.0.0 kenlm kenlm 0.3806±0.0092 0.4053±0.0093 6
4 [anonymized] 2020-05-12 19:14 5.0.0 2nd with test A included - i am dumb kenlm 0.354±0.010 0.354±0.010 3
# tags test-A AccAnyError test-A AccFstError test-A Total F2 test-A Total F0.5 test-A Mean F2 test-A Mean F0.5
1 supervised bidirectional 0.8928±0.0075 0.8160±0.0088 0.758±0.010 0.8733±0.0065 0.8057±0.0079 0.8390±0.0073
2 left-to-right gpt2-xlarge oddballness 0.632±0.011 0.377±0.011 0.1469±0.0062 0.288±0.010 0.3869±0.0093 0.4221±0.0094
3 left-to-right gpt2-large oddballness 0.611±0.011 0.373±0.011 0.1351±0.0059 0.2762±0.0098 0.3809±0.0096 0.4140±0.0092
4 0.5151±0.0096 0.3724±0.0096 0.0964±0.0058 0.241±0.012 0.3806±0.0092 0.4053±0.0093
5 kenlm 0.5151±0.0096 0.3724±0.0096 0.0964±0.0058 0.241±0.012 0.3806±0.0092 0.4053±0.0093
6 rule-based 0.599±0.011 0.3775±0.0090 0.1434±0.0065 0.260±0.012 0.3726±0.0081 0.3986±0.0088
7 baseline left-to-right gpt2-large 0.3559±0.0098 0.3559±0.0098 0±0 0±0 0.3559±0.0098 0.3559±0.0098

Graphs by parameters

alpha

[direct link]
[direct link]

threshold

[direct link]
[direct link]