GLUE-LM-GAP
GLUE-LM-GAP is LM-GAP challenge base on GLUE benchmark. [ver. 2.0.6]
Git repo URL: git://gonito.net/glue-lm-gap / Branch: master
Run git clone --single-branch git://gonito.net/glue-lm-gap -b master to get the challenge data
Browse at https://gonito.net/gitlist/glue-lm-gap.git/master
Leaderboard
# | submitter | when | ver. | description | test-A PerplexityHashed | × | |
---|---|---|---|---|---|---|---|
1 | kaczla | 2023-02-25 16:30 | 2.0.6 | Transformer encoder models (MLM) method=simple model_name=RoBERTa-large token_length=1 top_k=15 transformer huggingface-transformers transformer-encoder mlm | 69.393009 | 10 | |
2 | kaczla | 2023-03-06 15:48 | 2.0.6 | Transformer encoder-decoder models (seq2seq) depth=1 model_name=T5-large top_k=15 transformer huggingface-transformers transformer-encoder-decoder seq2seq | 192.323406 | 10 | |
3 | kaczla | 2023-02-13 09:07 | 2.0.6 | Transformer decoder models (CLM) depth=1 model_name=OPT-350M top_k=15 transformer huggingface-transformers transformer-decoder clm | 1767.228754 | 10 |