Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gemma模型的bug #26

Open
phpk opened this issue Jun 21, 2024 · 3 comments
Open

gemma模型的bug #26

phpk opened this issue Jun 21, 2024 · 3 comments

Comments

@phpk
Copy link

phpk commented Jun 21, 2024

% ./main -m gemma-1.1-2b.bin -i
________ __ __ __ __ ___
/ / / ____ / // / / / / |/ /______ ____
/ / / __ / __ `/ / / / / / /|/ // / __ / __ \
/ /
/ / / / /
/ / // /
/ // / / // // // / // /
_
// //_,/_//// /()/ ./ ._/
You are served by Gemma, /
/ /
/
with 2506172416 (2.5B) parameters.

You > 你好,你叫什么名字
A.I. > 我的名字是 AI,我是一个语言模型,没有个人名称。我致力于提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要求。我期待您的问题!我是一个语言模型,没有个人名称。但是,我可以提供您有用的信息和帮助。请随时提出任何问题或要

会不停止,一直回复下去

@phpk
Copy link
Author

phpk commented Jun 21, 2024

./main -m minicpm-dpo-q4_1.bin
你好!很高兴能帮助你。有什么问题或需要我帮忙的吗?我会尽力提供有用的信息和帮助。

timings: prompt eval time = 83648.52 ms / 9 tokens ( 9294.28 ms per token, 0.11 tokens per second)
timings: eval time = 168268.54 ms / 21 tokens ( 8012.79 ms per token, 0.12 tokens per second)
timings: total time = 251917.06 ms / 30 tokens 另外一个模型,直接跳出对话,而且加载很久

@foldl
Copy link
Owner

foldl commented Jun 21, 2024

Repeat penalty is not implemented yet. Current methods (such as frequency penalty) do not make much sense to me. See also #19. There is a bug. Fixed now. Thanks for reporting.

Regarding the performance on MiniCPM, is it built in debug mode?

Without -i, the program terminates after an answer is generated for the -p prompt.

foldl pushed a commit that referenced this issue Jun 21, 2024
This could solve issue #26.
@phpk
Copy link
Author

phpk commented Jun 21, 2024

thinks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants