Eur-lex-documents

Eur-lex-documents multilabel long documents classification. Assign one, more than one or none labels to each doc. [ver. 2.0.2]

Git repo URL: git://gonito.net/eur-lex-documents / Branch: master
Run git clone --single-branch git://gonito.net/eur-lex-documents -b master to get the challenge data
Browse at https://gonito.net/gitlist/eur-lex-documents.git/master

Leaderboard

# submitter when ver. description test-A Likelihood test-A F1 ×
1 [anonymized] 2022-07-15 06:57 2.0.2 RoBERTa classifier - full dataset neural-network roberta 15.97 87.04 86
2 [anonymized] 2022-03-22 06:40 2.0.2 Fast Text fasttext 0.00 81.81 86
3 [anonymized] 2022-09-13 22:56 2.0.2 Fast text classifier - full dataset python fasttext 21.75 81.80 86
4 [anonymized] 2022-09-22 09:09 2.0.2 PetraRQ Classifier neural-network pytorch-nn roberta 5.33 75.32 86
5 [anonymized] 2022-09-13 22:55 2.0.2 XGBoost classifier - full dataset scikit-learn xgboost 0.05 49.81 86
6 [anonymized] 2022-03-15 01:33 2.0.2 Logistic Regression logistic-regression 0.00 39.24 86
7 [anonymized] 2022-08-24 20:07 2.0.2 SVM classifier - full dataset scikit-learn svm 0.00 34.08 86
8 [anonymized] 2022-08-24 20:08 2.0.2 Random forest classifier - 1k samples scikit-learn random-forest 0.04 33.96 86
9 [anonymized] 2022-08-24 20:01 2.0.2 Naive bayes classifier - 100 samples naive-bayes scikit-learn 0.00 32.88 86
# tags test-A F2 test-A Accuracy test-A Likelihood test-A F1
1 neural-network roberta 86.75 40.64 15.97 87.04
2 fasttext 78.63 40.17 0.00 81.81
3 python fasttext 78.56 40.14 21.75 81.80
4 neural-network pytorch-nn roberta 77.59 39.47 5.33 75.32
5 scikit-learn xgboost 67.22 26.70 0.05 49.81
6 logistic-regression 59.55 2.48 0.00 39.24
7 scikit-learn svm 55.31 0.40 0.00 34.08
8 scikit-learn random-forest 37.39 7.29 0.04 33.96
9 naive-bayes scikit-learn 45.46 1.14 0.00 32.88