HF Equivalent Pretrained Models

[sameeravithana]

Is your feature request related to a problem? Please describe.
To load gpt-neox models using HF AutoModel.from_pretrained functionality. This will broaden the usage of gpt-neox models within the HF eco-system.

Describe the solution you'd like
Load gpt-neox models equivalent to HF pretrained models.