HWR challenge for index cards (only recognition, no detection)

Handwriting Recognition for Polish index cards. [ver. 2.0.0]

Git repo URL: git://gonito.net/fiszki-bare-hwr / Branch: master
Run git clone --single-branch git://gonito.net/fiszki-bare-hwr -b master to get the challenge data
Browse at https://gonito.net/gitlist/fiszki-bare-hwr.git/master

Leaderboard

#	submitter	when	ver.	description	test-A CER	test-A WER	×
1	p/tlen	2022-05-17 05:04	2.0.0	TrOCR large finetune out-fixed batch-size=16 beam=10 fine-tuning=true lr=2.0e-5 max-epochs=300 model=trocr-large-handwritten patience=20 prediction-batch-size=16 [...] fine-tuned large	16.2±1.6	50.7±4.4	14
2	p/tlen	2022-09-05 07:47	2.0.0	Donut donut	18.7±1.7	53.0±3.9	14
3	p/tlen	2022-09-06 05:02	2.0.0	Donut + MBart-50 large donut mbart mbart-large-50	19.3±2.0	54.9±4.2	14
4	p/tlen	2022-05-17 04:51	2.0.0	TrOCR fine-tuned batch-size=24 beam=10 fine-tuning=true lr=2.0e-5 max-epochs=300 model=trocr-base-handwritten patience=20 prediction-batch-size=16 [...] fine-tuned base	20.9±2.0	55.4±4.8	14
5	p/tlen	2022-05-16 17:19	2.0.0	TrOCR fine-tuned batch-size=8 beam=10 fine-tuning=true lr=2.0e-5 max-epochs=10 model=trocr-small-handwritten patience=2 prediction-batch-size=16 [...] fine-tuned small	75.0±2.9	141.9±6.1	14
6	p/tlen	2022-05-16 17:04	2.0.0	TrOCR fine-tuned beam=10 fine-tuning=false model=trocr-small-handwritten prediction-batch-size=16 small no-fine-tuning	118.0±9.3	160±11	14

Graphs by parameters

batch-size

[direct link] [direct link]