014e89b028ec09b852493f6451f6341c406ba02c
Official baseline prepared by task authors. See task description for details. baseline roberta-xlm
- challenge
- CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness
- submitter
- Tomasz Ziętkiewicz
- submitted
- 2023-04-25 09:35:10.773749 UTC
- file basename
- out
test-A / d64f13f57378da06a443305f94bced15b6650eb2
| Metric | Score |
|---|---|
| Exact Match Accuracy | 0.682371114114694 |
| Domain accuracy | 0.9803050782004248 |
| Intent accuracy | 0.9453562463796099 |
| Slot WRR | 0.7521927089828324 |
| en-US | es-ES | pl-PL | |
|---|---|---|---|
| Exact Match Accuracy | 0.6860047846889952 | 0.5948863636363636 | 0.7670291929021179 |
| Domain accuracy | 0.9545454545454546 | 0.9954545454545455 | 0.9896966227819118 |
| Intent accuracy | 0.9040071770334929 | 0.9707386363636363 | 0.9593589009730967 |
| Slot WRR | 0.733477508650519 | 0.7232690021037227 | 0.8099809368191722 |