Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(model): add patched orthogonal init #323

Merged
merged 5 commits into from
May 12, 2021
Merged

Conversation

ClashLuke
Copy link
Contributor

In the tradition introduced by kindiana, I named this patch after myself.

In the tradition introduced by kindiana, I named this patch after myself.
@ClashLuke ClashLuke requested a review from a team as a code owner May 12, 2021 06:07
@ClashLuke ClashLuke requested review from joshlk and sdtblck May 12, 2021 06:07
@sdtblck
Copy link
Contributor

sdtblck commented May 12, 2021

I've changed the name to scaled orthogonal since it's more informative 😆 Wang Init would have been scaled init if it wasn't already taken

@sdtblck sdtblck merged commit 079a307 into EleutherAI:main May 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants