CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness

Develop Natural Language Understanding models that are robust to speech recognition errors. [ver. 1.0.13]

Deadline: 2023-06-22 12:01:00 UTC

Git repo URL: git@github.com:kubapok/cnlps-caiccaic.git / Branch: master
Run git clone --single-branch git@github.com:kubapok/cnlps-caiccaic.git -b master to get the challenge data
Browse at https://github.com/kubapok/cnlps-caiccaic/tree/master

Leaderboard

#	submitter	when	ver.	description	test-A pl-PL Slot WRR	test-A pl-PL Intent accuracy	test-A pl-PL Domain accuracy	test-A pl-PL Exact Match Accuracy	test-A es-ES Slot WRR	test-A es-ES Intent accuracy	test-A es-ES Domain accuracy	test-A es-ES Exact Match Accuracy	test-A en-US Slot WRR	test-A en-US Intent accuracy	test-A en-US Domain accuracy	test-A en-US Exact Match Accuracy	test-A Slot WRR	test-A Intent accuracy	test-A Domain accuracy	test-A Exact Match Accuracy	test-B pl-PL Slot WRR	test-B pl-PL Intent accuracy	test-B pl-PL Domain accuracy	test-B pl-PL Exact Match Accuracy	test-B es-ES Slot WRR	test-B es-ES Intent accuracy	test-B es-ES Domain accuracy	test-B es-ES Exact Match Accuracy	test-B en-US Slot WRR	test-B en-US Intent accuracy	test-B en-US Domain accuracy	test-B en-US Exact Match Accuracy	test-B Slot WRR	test-B Intent accuracy	test-B Domain accuracy	test-B Exact Match Accuracy	×