[Refactor] Cleanup the codes

[kozistr]

Problem (Why?)

refactor the codes

Solution (What/How?)

• change to in-place operations
• remove casting to fp16 or bf16

Other changes (bug fixes, small refactors)

• fix exp_avg_var when amsgrad is True.

Notes

nope

[codecov-commenter]

Codecov Report

Merging #96 (c155279) into main (ce56167) will increase coverage by 0.07%.
The diff coverage is 99.09%.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@            Coverage Diff             @@
##             main      #96      +/-   ##
==========================================
+ Coverage   97.76%   97.84%   +0.07%     
==========================================
  Files          37       37              
  Lines        2551     2502      -49     
==========================================
- Hits         2494     2448      -46     
+ Misses         57       54       -3     

Impacted Files	Coverage Δ
pytorch_optimizer/optimizer/ranger21.py	98.88% <75.00%> (-0.02%)	⬇️
pytorch_optimizer/optimizer/adabelief.py	100.00% <100.00%> (+2.70%)	⬆️
pytorch_optimizer/optimizer/adabound.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/adamp.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/adan.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/adapnm.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/diffgrad.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/diffrgrad.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/lars.py	100.00% <100.00%> (ø)
pytorch_optimizer/optimizer/madgrad.py	100.00% <100.00%> (ø)
... and 5 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.