Passage Retrieval

Passage Retrieval is a crucial part of modern open-domain question-answering systems that rely on precise and efficient retrieval components to find passages containing correct answers. [ver. 1.0.0]

# submitter when ver. description dev-0 NDCG@100 dev-0 NDCG@10 test-A NDCG@100 test-A NDCG@10 test-A-allegro NDCG@100 test-A-allegro NDCG@10 test-A-legal NDCG@100 test-A-legal NDCG@10 test-A-wiki NDCG@100 test-A-wiki NDCG@10 test-B NDCG@100 test-B NDCG@10 test-B-allegro NDCG@100 test-B-allegro NDCG@10 test-B-legal NDCG@100 test-B-legal NDCG@10 test-B-wiki NDCG@100 test-B-wiki NDCG@10
10 s478846 2024-02-06 15:22 1.0.0 BAAI/bge-m3 allegro and legal output N/A N/A N/A N/A 81.60 80.79 81.47 78.69 N/A N/A N/A N/A 80.34 78.95 84.15 81.64 N/A N/A
9 s478846 2024-02-06 14:32 1.0.0 BAAI/bge-m3 allegro output with test B N/A N/A N/A N/A 81.60 80.79 N/A N/A N/A N/A N/A N/A 80.34 78.95 N/A N/A N/A N/A
8 s478846 2024-02-06 14:29 1.0.0 BAAI/bge-m3 allegro output corrected N/A N/A N/A N/A 81.60 80.79 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
7 s478846 2024-02-06 14:25 1.0.0 BAAI/bge-m3 allegro output N/A N/A N/A N/A 15.23 0.16 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
1 s478846 2023-10-11 07:38 1.0.0 fastbm25-all-data-stemmed stemming 22.68 17.17 58.77 54.31 63.08 59.46 82.29 79.61 30.93 23.88 49.63 44.16 61.14 57.38 82.98 80.52 31.26 23.76
5 s478846 2023-10-11 07:31 1.0.0 fastbm25-test-A-test-B-with-stemming 22.68 17.17 58.77 54.31 63.08 59.46 82.29 79.61 23.82 18.72 49.63 44.16 61.14 57.38 82.98 80.52 22.48 17.18
4 s478846 2023-10-10 13:47 1.0.0 fastbm25-allegro-and-legal-stemmed 22.68 17.17 53.13 49.24 63.08 59.46 82.29 79.61 23.82 18.72 42.07 37.58 61.14 57.38 82.98 80.52 22.48 17.18
3 s478846 2023-10-10 13:19 1.0.0 fastbm25-all-data-proper-test-A-wiki-out 22.68 17.17 53.13 49.24 52.30 47.36 83.26 81.64 23.82 18.72 42.07 37.58 51.03 46.12 82.84 81.31 22.48 17.18
2 s478846 2023-10-10 12:57 1.0.0 fastbm25-all-data 22.68 17.17 53.13 49.24 52.30 47.36 83.26 81.64 0.16 0.16 42.07 37.58 51.03 46.12 82.84 81.31 22.48 17.18
6 s478846 2023-10-10 12:21 1.0.0 fastbm25-dev-only 22.68 17.17 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A