Considering incorporate into huggingface

[gordonhu608]

Thank you for your excellent work. Do you consider incorporating the new optimizer into huggingface so that the whole community can train LLM using it? I just checked their implementation and find it very straightforward, it's basically naming a new class and incorporating some names into the init function.

Upvote & Fund

• We're using Polar.sh so you can upvote and help fund this issue.
• We receive the funding once the issue is completed & confirmed by you.
• Thank you in advance for helping prioritize & fund our backlog.