New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update convert-h5-to-ggml.py to match GPT2 expectation #73

Closed

yunfanye wants to merge 2 commits into ggerganov:master from yunfanye:master

yunfanye commented Apr 7, 2023

Transpose additional mlp and attention layers.
Keep wpe as float32.

Yunfan Ye and others added 2 commits

April 7, 2023 12:22


Update convert-h5-to-ggml.py to match GPT2 expectation

fb895b4

1) Transpose additional mlp and attention layers.
2) Keep wpe as float32.


Update convert-h5-to-ggml.py

9816b34

Owner

ggerganov commented Apr 13, 2023

I believe this is outdated

ggerganov closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment