Skip to content

Commit

Permalink
Merge pull request #28 from kozistr/refactor/ranger21-optimizer
Browse files Browse the repository at this point in the history
[Refactor] Ranger21 optimizer
  • Loading branch information
kozistr committed Sep 23, 2021
2 parents bc22b00 + cece79d commit 14a00c7
Show file tree
Hide file tree
Showing 3 changed files with 154 additions and 398 deletions.
4 changes: 2 additions & 2 deletions .pylintrc
Original file line number Diff line number Diff line change
Expand Up @@ -366,10 +366,10 @@ valid-metaclass-classmethod-first-arg=cls
[DESIGN]

# Maximum number of arguments for function / method
max-args=15
max-args=20

# Maximum number of attributes for a class (see R0902).
max-attributes=11
max-attributes=25

# Maximum number of boolean expressions in a if statement
max-bool-expr=5
Expand Down
2 changes: 1 addition & 1 deletion README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ Supported Optimizers
+--------------+----------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+
| RAdam | *On the Variance of the Adaptive Learning Rate and Beyond* | `github <https://github.com/LiyuanLucasLiu/RAdam>`__ | `https://arxiv.org/abs/1908.03265 <https://arxiv.org/abs/1908.03265>`__ |
+--------------+----------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+
| Ranger | *a synergistic optimizer combining RAdam and LookAhead, and now GC in one optimizer* | `github <https://github.com/lessw2020/Ranger-Deep-Learning-Optimizer>`__ | |
| Ranger | *a synergistic optimizer combining RAdam and LookAhead, and now GC in one optimizer* | `github <https://github.com/lessw2020/Ranger-Deep-Learning-Optimizer>`__ | https://bit.ly/3zyspC3 `<https://bit.ly/3zyspC3>`__ |
+--------------+----------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+
| Ranger21 | *a synergistic deep learning optimizer* | `github <https://github.com/lessw2020/Ranger21>`__ | `https://arxiv.org/abs/2106.13731 <https://arxiv.org/abs/2106.13731>`__ |
+--------------+----------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------+
Expand Down
Loading

0 comments on commit 14a00c7

Please sign in to comment.