Grammatical error detection

Detect errors in english text. [ver. 5.0.0]

Deadline: 2021-02-26 10:00:00 UTC

Git repo URL: git://gonito.net/grammatical-error-detection / Branch: master
Run git clone --single-branch git://gonito.net/grammatical-error-detection -b master to get the challenge data
Browse at https://gonito.net/gitlist/grammatical-error-detection.git/master

Leaderboard

#	submitter	when	ver.	description	test-A Mean F2	test-A Mean F0.5	×
1	[anonymized]	2020-02-14 13:30	5.0.0	UEDINMS supervised bidirectional	0.8057±0.0079	0.8390±0.0073	149
2	p/tlen	2020-02-01 11:41	5.0.0	Sample solution oddballness	0.3816±0.0093	0.4109±0.0094	3
3	Mikolaj Bachorz	2020-05-04 10:09	5.0.0	kenlm kenlm	0.3806±0.0092	0.4053±0.0093	6
4	Jakub Stefko	2020-05-12 19:14	5.0.0	2nd with test A included - i am dumb kenlm	0.354±0.010	0.354±0.010	3

#	tags	test-A AccAnyError	test-A AccFstError	test-A Total F2	test-A Total F0.5	test-A Mean F2	test-A Mean F0.5
1	supervised bidirectional	0.8928±0.0075	0.8160±0.0088	0.758±0.010	0.8733±0.0065	0.8057±0.0079	0.8390±0.0073
2	left-to-right gpt2-xlarge oddballness	0.632±0.011	0.377±0.011	0.1469±0.0062	0.288±0.010	0.3869±0.0093	0.4221±0.0094
3	left-to-right gpt2-large oddballness	0.611±0.011	0.373±0.011	0.1351±0.0059	0.2762±0.0098	0.3809±0.0096	0.4140±0.0092
4		0.5151±0.0096	0.3724±0.0096	0.0964±0.0058	0.241±0.012	0.3806±0.0092	0.4053±0.0093
5	kenlm	0.5151±0.0096	0.3724±0.0096	0.0964±0.0058	0.241±0.012	0.3806±0.0092	0.4053±0.0093
6	rule-based	0.599±0.011	0.3775±0.0090	0.1434±0.0065	0.260±0.012	0.3726±0.0081	0.3986±0.0088
7	baseline left-to-right gpt2-large	0.3559±0.0098	0.3559±0.0098	0±0	0±0	0.3559±0.0098	0.3559±0.0098

Graphs by parameters

alpha

[direct link] [direct link]

n_alternative_tokens

[direct link] [direct link]

power_for_first_token

[direct link] [direct link]

threshold

[direct link] [direct link]