ae15017d8715ee1597c33750ccb6e1c2942ed557
Official baseline prepared by organizers
- challenge
- CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness
- submitter
- [anonymized]
- submitted
- 2023-04-24 14:35:06.308606 UTC
- file basename
- out
test-A / 521eb2c3a8954a54ea97a1ff1129ef56be5628f4
| Metric | Score |
|---|---|
| Exact Match Accuracy | 0.6822745703803823 |
| Domain accuracy | 0.9803050782004248 |
| Intent accuracy | 0.9453562463796099 |
| Slot WRR | 0.7521511410400299 |
| en-US | es-ES | pl-PL | |
|---|---|---|---|
| Exact Match Accuracy | 0.6857057416267942 | 0.5948863636363636 | 0.7670291929021179 |
| Domain accuracy | 0.9545454545454546 | 0.9954545454545455 | 0.9896966227819118 |
| Intent accuracy | 0.9040071770334929 | 0.9707386363636363 | 0.9593589009730967 |
| Slot WRR | 0.7333044982698962 | 0.7232690021037227 | 0.8099809368191722 |