Arxiv tables challange
Key information extraction for scientific tables. Guess the <mask> token in texts based on tables images and context from text. [ver. 3.0.4]
This is a long list of all submissions, if you want to see only the best, click leaderboard.
| # | submitter | when | ver. | description | dev-0 Acc-Degree | dev-0 Acc-Extractive | dev-0 Accuracy | test-A Acc-Degree | test-A Acc-Extractive | test-A Accuracy | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 14 | [anonymized] | 2023-01-12 10:00 | 3.0.4 | layoutlm v3 seed 4 | N/A | N/A | N/A | 0.0 | 0.5012371134020619 | 0.3796657816648446 | |
| 13 | [anonymized] | 2023-01-12 09:58 | 3.0.4 | layoutlm v3 seed 3 | N/A | N/A | N/A | 0.0 | 0.5035051546391752 | 0.3813837263782602 | |
| 15 | [anonymized] | 2023-01-12 09:56 | 3.0.4 | layoutlm v3 seed 2 | N/A | N/A | N/A | 0.0 | 0.4793814432989691 | 0.3631110416992035 | |
| 2 | [anonymized] | 2023-01-09 16:21 | 3.0.4 | T5 1D pretrained seed 3 | 0.845442536327609 | 0.625414364640884 | 0.6805762543467462 | 0.8647778493238892 | 0.6327835051546392 | 0.6890520068717788 | |
| 3 | [anonymized] | 2023-01-09 16:19 | 3.0.4 | T5 2D pretrained seed 3 | 0.8434610303830912 | 0.6311602209944751 | 0.6843848319258156 | 0.8480360592401803 | 0.6342268041237114 | 0.6860846478213337 | |
| 11 | [anonymized] | 2023-01-09 16:13 | 3.0.4 | T5 2D seed 3 | 0.8599735799207398 | 0.5845303867403315 | 0.6535850306342109 | 0.8557630392788153 | 0.5921649484536082 | 0.6560987037326254 | |
| 8 | [anonymized] | 2023-01-09 16:10 | 3.0.4 | T5 1D seed 3 | 0.8546895640686922 | 0.6048618784530386 | 0.6674946183142905 | 0.8673535093367676 | 0.6076288659793815 | 0.6706231454005934 | |
| 10 | [anonymized] | 2023-01-07 13:21 | 3.0.4 | T5 1D seed 2 | 0.8566710700132101 | 0.6041988950276244 | 0.6674946183142905 | 0.8570508692852543 | 0.6020618556701031 | 0.6639075433390598 | |
| 9 | [anonymized] | 2023-01-07 13:19 | 3.0.4 | T5 2D seed 2 | 0.8593130779392338 | 0.594475138121547 | 0.6608710051333002 | 0.8634900193174501 | 0.6039175257731959 | 0.6668749023895049 | |
| 5 | [anonymized] | 2023-01-07 08:09 | 3.0.4 | T5 2D pretrained seed 2 | 0.8335535006605019 | 0.6300552486187845 | 0.6810730253353204 | 0.8518995492594977 | 0.6315463917525773 | 0.684991410276433 | |
| 4 | [anonymized] | 2023-01-07 08:06 | 3.0.4 | T5 1D pretrained seed 2 | 0.8533685601056803 | 0.6232044198895028 | 0.6809074350057956 | 0.8576947842884739 | 0.6309278350515464 | 0.6859284710292051 | |
| 1 | [anonymized] | 2023-01-06 10:54 | 3.0.4 | T5 2D pretrained seed 1 | 0.8520475561426685 | 0.634475138121547 | 0.6890213611525087 | 0.8531873792659369 | 0.6395876288659794 | 0.6913946587537092 | |
| 6 | [anonymized] | 2023-01-06 10:51 | 3.0.4 | T5 1D pretrained seed 1 | 0.857331571994716 | 0.6097237569060774 | 0.6717999668819341 | 0.8570508692852543 | 0.6142268041237113 | 0.6731219740746525 | |
| 7 | [anonymized] | 2023-01-05 15:11 | 3.0.4 | T5 1D seed 1 | 0.8579920739762219 | 0.596243093922652 | 0.6618645471104487 | 0.8673535093367676 | 0.6105154639175258 | 0.6728096204903952 | |
| 12 | [anonymized] | 2023-01-05 09:48 | 3.0.4 | T5 2D seed 1 | 0.8527080581241744 | 0.5756906077348066 | 0.6451399238284484 | 0.8596265292981327 | 0.5764948453608247 | 0.6451663282836171 | |
| 27 | [anonymized] | 2022-12-28 12:30 | 2.0.0 | dev out | N/A | N/A | N/A | N/A | N/A | N/A | |
| 26 | [anonymized] | 2022-12-28 12:25 | 2.0.0 | T5-1D-v0-seed_1 | N/A | N/A | N/A | N/A | N/A | N/A | |
| 25 | [anonymized] | 2022-09-26 18:23 | 2.0.0 | Donut - 4 epochs | N/A | N/A | N/A | N/A | N/A | 0.24254255817585507 | |
| 24 | [anonymized] | 2022-09-26 15:06 | 2.0.0 | Donut - 3 epochs | N/A | N/A | N/A | N/A | N/A | 0.2253631110416992 | |
| 23 | [anonymized] | 2022-09-26 05:33 | 2.0.0 | LayoutLMv3 - 3 epochs | N/A | N/A | N/A | N/A | N/A | 0.1888177416835858 | |
| 22 | [anonymized] | 2022-09-26 05:25 | 2.0.0 | LayoutLMv3 - 6 epochs | N/A | N/A | N/A | N/A | N/A | 0.19303451507106045 | |
| 21 | [anonymized] | 2022-09-20 22:00 | 2.0.0 | RobertaBase v2 | N/A | N/A | 0.1972180824639841 | N/A | N/A | 0.20396689052006872 | |
| 20 | [anonymized] | 2022-08-29 22:37 | 1.0.0 | Try without last line | N/A | N/A | N/A | N/A | N/A | N/A | |
| 19 | [anonymized] | 2022-08-29 22:36 | 1.0.0 | Add out.tsv for dev | N/A | N/A | N/A | N/A | N/A | N/A | |
| 18 | [anonymized] | 2022-08-29 22:20 | 1.0.0 | Add roberta base out.tsv | N/A | N/A | N/A | N/A | N/A | N/A | |
| 17 | [anonymized] | 2022-08-14 20:25 | 1.0.0 | Remove bottom line | N/A | N/A | N/A | N/A | N/A | N/A | |
| 16 | [anonymized] | 2022-08-14 20:22 | 1.0.0 | Random test v1 | N/A | N/A | N/A | N/A | N/A | N/A |