You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have been mystified by the fact that we haven’t seen any speed-up from 1-bit Adam, but we recently discovered that it requires OpenMPI to function. This explains the lack of improvement (we do not currently have a working OpenMPI implementation) but does not explain why the code acts like it runs without a problem. There are two tasks here:
[ ] figure out the code is currently doing
[ ] figure out how to get 1-bit Adam to work (once OpenMPI exists)
The text was updated successfully, but these errors were encountered:
We have been mystified by the fact that we haven’t seen any speed-up from 1-bit Adam, but we recently discovered that it requires OpenMPI to function. This explains the lack of improvement (we do not currently have a working OpenMPI implementation) but does not explain why the code acts like it runs without a problem. There are two tasks here:
[ ] figure out the code is currently doing
[ ] figure out how to get 1-bit Adam to work (once OpenMPI exists)
The text was updated successfully, but these errors were encountered: