You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Last night I uncovered some inconsistencies in our tests that might explain why ZeRO-3 was clocking at 1/3rd the speed of ZeRO-1 or without ZeRO. It probably won’t make up all the difference, but it’s worth seeing how much of the difference it makes up.
The text was updated successfully, but these errors were encountered:
Last night I uncovered some inconsistencies in our tests that might explain why ZeRO-3 was clocking at 1/3rd the speed of ZeRO-1 or without ZeRO. It probably won’t make up all the difference, but it’s worth seeing how much of the difference it makes up.
The text was updated successfully, but these errors were encountered: