Skip to content
This repository has been archived by the owner on Dec 11, 2023. It is now read-only.

Model does not learn when using pretrained embeddings #443

Closed
luna1991 opened this issue May 28, 2019 · 0 comments
Closed

Model does not learn when using pretrained embeddings #443

luna1991 opened this issue May 28, 2019 · 0 comments

Comments

@luna1991
Copy link

Hi,
I am trying to using pretrained word embeddings as input for my model.
I made sure that the embeddings are loaded correctly.
However the model cannot learn anything when using these embeddings! Which is totally strange.
For the very first evaluation before the training starts, the model chooses random words, which is ok. Afterwords, all the model chooses is basically and sometimes some words like "the", "is", "to". Therefore the bleu score is always zero.
Any suggestions what the reason could be?
Thanks

@luna1991 luna1991 closed this as completed Jun 9, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant