Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib] Actually save the optimizer state for tf learners #34252

Merged
merged 3 commits into from
Apr 12, 2023
Merged

[RLlib] Actually save the optimizer state for tf learners #34252

merged 3 commits into from
Apr 12, 2023

Commits on Apr 11, 2023

  1. [RLlib] Actually save the optimizer state for tf learners 

    It turns out you can get the actual optimizer state by calling optimizer.variables for tf keras.
this pr enables us to save the full optimizer state and restore it. To do this I added a new
file called optimizer_name_state.txt to the checkpoint. This holds a bytestring serialized
representation of the optimizer's state. It looks like the optimizer's variable state doesn't include
things like the learning rate, so I still need to save those as a separate file and
reconstruct the optimizer first before loading the state.

Signed-off-by: Avnish <[email protected]>
    @avnishn
    avnishn committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    240fc43 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/ray-project/ray into actu… 

    …ally_save_tensorflow_state
    @avnishn
    avnishn committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    dc5979a View commit details
    Browse the repository at this point in the history

  3. Small cleanups 

    Signed-off-by: Avnish <[email protected]>
    @avnishn
    avnishn committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    c637002 View commit details
    Browse the repository at this point in the history