Ireland news headlines — word gap prediction
Predict the masked word given text and year. [ver. 1.0.3]
This is a long list of all submissions, if you want to see only the best, click leaderboard.
| # | submitter | when | ver. | description | dev-0 PerplexityHashed | test-A PerplexityHashed | |
|---|---|---|---|---|---|---|---|
| 7 | p/tlen | 2021-11-11 08:42 | 1.0.2 | RoBERTa base trained from scratch (with year) temporal roberta roberta-base no-pretrained | 46.6 | 46.0 | |
| 9 | p/tlen | 2021-11-09 06:04 | 1.0.2 | RoBERTa base trained from scratch (without year) roberta roberta-base no-temporal no-pretrained | 91.7 | 90.8 | |
| 2 | p/tlen | 2021-11-09 06:02 | 1.0.2 | RoBERTa base finetuned (with year) temporal roberta fine-tuned roberta-base | 22.2 | 21.6 | |
| 1 | p/tlen | 2021-11-08 08:16 | 1.0.2 | RoBERTa base finetuned (with year) temporal roberta fine-tuned roberta-base | 22.2 | 21.6 | |
| 3 | p/tlen | 2021-11-08 08:00 | 1.0.2 | RoBERTa base finetuned (without year) roberta fine-tuned roberta-base | 23.1 | 22.6 | |
| 4 | kubapok | 2021-11-04 10:18 | 1.0.2 | roberta_ft | 23.7 | 23.3 | |
| 5 | kubapok | 2021-11-02 09:54 | 1.0.1 | roberta_with_year_from_scratch | 33.5 | 33.3 | |
| 6 | kubapok | 2021-10-29 13:25 | 1.0.1 | regular_roberta_from_scratch | 35.1 | 34.7 | |
| 8 | kubapok | 2021-10-29 11:17 | 1.0.2 | roberta base no ft | 52.3 | 51.0 | |
| 10 | kubapok | 2021-10-27 12:55 | 1.0.2 | same probability baseline | 1024.0 | 1024.0 |