Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hyperparameter optimization for fastText backend #433

Open
osma opened this issue Jul 28, 2020 · 0 comments
Open

Hyperparameter optimization for fastText backend #433

osma opened this issue Jul 28, 2020 · 0 comments
Milestone

Comments

@osma
Copy link
Member

osma commented Jul 28, 2020

Implement support for the hyperopt command for the fastText backend. Part of #240.

It's probably a bit tricky to come up with a search space that is general enough for different purposes, yet narrow enough that good solutions can be found in reasonable time. There are also pitfalls like the choice of loss function - softmax is good but extremely slow on large vocabularies, so it should be possible to force the use of another loss function such as hs. Perhaps there should be a way to narrow down the search space already during the hyperopt operation, e.g.

annif hyperopt -b fasttext-en.loss=hs fasttext-en validation-corpus/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant