a227084cc6409d16d1a18d6224b6b8407a50be74
nn, trigram, predict from next two tokens neural-network trigram

 

challenge
Challenging America word-gap prediction
submitter
Kamil Guttmann
submitted
2023-05-09 17:59:41.622007 UTC
original repo
https://git.wmi.amu.edu.pl/s444380/challenging-america-word-gap-prediction / branch master
publicly available at
git://gonito.net/challenging-america-word-gap-prediction / branch submission-08478
browsable at
https://gonito.net/gitlist/challenging-america-word-gap-prediction.git/submission-08478/
clone by
git clone --single-branch git://gonito.net/challenging-america-word-gap-prediction -b submission-08478
# hidden_size embed_size dev-0 PerplexityHashed test-A PerplexityHashed
137 500 287.54 307.65
113 1024 265.70 287.08
112 2048 259.62 286.56
104 2048 256 250.85 275.80
Parameter Value
batch-size 5000
embed-size 100
epochs 1
topk 150
vocab-size 20000