Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

repeat the output content until the maximum output length is set #209

Open
zestaken opened this issue Mar 24, 2024 · 2 comments
Open

repeat the output content until the maximum output length is set #209

zestaken opened this issue Mar 24, 2024 · 2 comments

Comments

@zestaken
Copy link

Using Openchat-3.5-0106 locally will repeat the output content until the maximum output length is set. In other words, the output of the model does not stop automatically.
And the model is loaded with the following warning:
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
May I ask how to solve this kind of problem?

@imoneoi
Copy link
Owner

imoneoi commented Mar 27, 2024

Hi @zestaken, can you provide more information about your local model setup?

@Cancerxy
Copy link

Cancerxy commented Apr 8, 2024

I also encountered this problem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants