f5c3f0ff66ede4dbe37455512085c476f05abb49
dfd
- challenge
- CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness
- submitter
- Martyna Druminska
- submitted
- 2023-06-12 21:47:03.988019 UTC
- original repo
https://git.wmi.amu.edu.pl/s444519/cnlps-caiccaic.git/ branchmaster- publicly available at
git://gonito.net/cnlps-caiccaic/ branchsubmission-08869- browsable at
- https://gonito.net/gitlist/cnlps-caiccaic.git/submission-08869/
- clone by
git clone --single-branch git://gonito.net/cnlps-caiccaic -b submission-08869- file basename
- out
test-A / ba98ecb4dd889a0db67608b6d37dc772ef7d5d21
| Metric | Score |
|---|---|
| Exact Match Accuracy | 0.44622513998841473 |
| Domain accuracy | 0.9590654566518633 |
| Intent accuracy | 0.6748407028383858 |
| Slot WRR | 0.6267406576048551 |
| en-US | es-ES | pl-PL | |
|---|---|---|---|
| Exact Match Accuracy | 0.41088516746411485 | 0.45681818181818185 | 0.4693760732684602 |
| Domain accuracy | 0.9084928229665071 | 0.9894886363636364 | 0.9768174012593016 |
| Intent accuracy | 0.59688995215311 | 0.6821022727272728 | 0.7421293646250715 |
| Slot WRR | 0.4185121107266436 | 0.6935882191530229 | 0.6911083877995643 |