New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Hugging Face Conversion #44

Closed

JACKHAHA363 wants to merge 0 commits into CERC-AAI:magma from JACKHAHA363:hf_convert

JACKHAHA363 commented Aug 18, 2023 •

edited

Loading

Roadmap:

make tools/convert_sequential_to_hf.py works with magma_pythia_410M checkpoint. (current)
Add huggingface Robin class by adding adaptors to GPTNeoX huggingface class.
Modify convert_sequential_to_hf.py accordingly.

Command:

python tools/convert_sequential_to_hf.py \
--input_dir checkpoints/magma_410M_testrun5/global_step1000 \
--config_file checkpoints/magma_410M_testrun5/global_step1000/configs/magma_pythia_410M.yml checkpoints/magma_410M_testrun5/global_step1000/configs/magma_setup.yml \
--output_dir checkpoint/magma_converted

JACKHAHA363 closed this

JACKHAHA363 force-pushed the hf_convert branch from 48ba0bc to bc67dcc Compare

August 21, 2023 18:29

JACKHAHA363 deleted the hf_convert branch

August 21, 2023 18:29

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment