Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

convert_hf_to_module（pipeline_parallel>1） #1092

Closed
liuxinxin123 opened this issue Dec 6, 2023 · 2 comments
Closed

convert_hf_to_module（pipeline_parallel>1） #1092

liuxinxin123 opened this issue Dec 6, 2023 · 2 comments
Labels
feature request New feature or request

Comments

@liuxinxin123
Copy link

hi，
I see that we support to convert a HuggingFace transformers to a NeoX model with pipeline parallelism without pipeline parallelism by 'convert_hf_to_sequential.py'.

Can we support to convert a HuggingFace transformers to a NeoX model with pipeline parallelism without pipeline parallelism greater than 1, or how to do now?
@liuxinxin123 liuxinxin123 added the feature request New feature or request label Dec 6, 2023
@StellaAthena
Copy link
Member

Thank you for the issue. The language you're using is a little confusing to me. Am I correct in thinking you want to go HF -> NeoX w/ PP = 1? That is, you can do PP > 1 and no PP but not PP = 1?

@StellaAthena
Copy link
Member

@liuxinxin123 Hey, I wanted to follow up on this. Can you elaborate on what your issue is?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Quentin-Anthony @liuxinxin123 @StellaAthena