GLUE-LM-GAP

GLUE-LM-GAP is LM-GAP challenge base on GLUE benchmark. [ver. 2.0.4]

Git repo URL: git://gonito.net/glue-lm-gap / Branch: master
Run git clone --single-branch git://gonito.net/glue-lm-gap -b master to get the challenge data
Browse at https://gonito.net/gitlist/glue-lm-gap.git/master

Leaderboard

#	submitter	when	ver.	description	test-A PerplexityHashed	×
1	kaczla	2023-02-06 13:06	2.0.4	Transformer encoder models (MLM) method=simple model_name=RoBERTa-large token_length=1 top_k=15 transformer huggingface-transformers transformer-encoder mlm	69.393009	3
2	kaczla	2023-02-06 14:35	2.0.4	Transformer decoder models (CLM) depth=1 model_name=OPT-350M top_k=15 transformer huggingface-transformers transformer-encoder clm	1767.228754	3