faa0d57464873c3bf7eb7536bc8bba4ac2f8a60e
s478873 transformer t5
- challenge
- CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness
- submitter
- s478873
- submitted
- 2023-06-11 17:18:47.226821 UTC
- file basename
- out
test-A / 0356902a1cd64c19ebe9dc34ebca5033869cf1bb
| Metric | Score |
|---|---|
| Exact Match Accuracy | 0.4614790500096544 |
| Domain accuracy | 0.9488318208148291 |
| Intent accuracy | 0.8661903842440626 |
| Slot WRR | 0.626241842291225 |
| en-US | es-ES | pl-PL | |
|---|---|---|---|
| Exact Match Accuracy | 0.4805622009569378 | 0.38920454545454547 | 0.5160274756725816 |
| Domain accuracy | 0.9210526315789473 | 0.9443181818181818 | 0.979965655409273 |
| Intent accuracy | 0.8343301435406698 | 0.834659090909091 | 0.9284487693188322 |
| Slot WRR | 0.446280276816609 | 0.6329918595079118 | 0.7578295206971677 |