Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[train+tune][doc] Remove docs sections recommending RAY_AIR_LOCAL_CACHE_DIR #44284

Merged
merged 8 commits into from
Apr 1, 2024

Conversation

justinvyu
Copy link
Contributor

Why are these changes needed?

The recent local directory refactor (#43369, #43403, #43689) removed usage of the environment variable RAY_AIR_LOCAL_CACHE_DIR for configuring the local staging dir.

The local staging directory is now a subdirectory of the Ray temp session dir (/tmp/ray/session_*), and the customization of this directory location is now offloaded to Ray Core (ray.init(_temp_dir="/tmp/custom")).

This PR updates docs to reflect this new behavior.

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

doc/source/train/user-guides/persistent-storage.rst Outdated Show resolved Hide resolved
doc/source/train/user-guides/persistent-storage.rst Outdated Show resolved Hide resolved
doc/source/train/user-guides/persistent-storage.rst Outdated Show resolved Hide resolved
Comment on lines 398 to 405
Prior to 2.10, the ``RAY_AIR_LOCAL_CACHE_DIR`` environment variable was the way to configure
the local staging directory to be outside of the home directory (``~/ray_results``).

``RunConfig(local_dir)`` was another deprecated alternative to set the local staging directory.

These options are now deprecated, and you should instead set ``storage_path``.
When ``storage_path`` is set, there will no longer be any files written to
``~/ray_results`` starting from Ray 2.10.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a bit confusing since there's a bunch of branching logic based on env var / storage path. Could we maybe simplify this to just focus on the staging directory being set by RAY_AIR_LOCAL_CACHE_DIR or local_dir? And not talk about storage_path?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I kept the mention about switching to storage path as a migration path, because users were setting ONLY the environment variable. But now that the env variable doesn't do anything, they need to switch to setting storage path.

doc/source/tune/tutorials/tune-storage.rst Outdated Show resolved Hide resolved
@justinvyu justinvyu merged commit 731b53d into ray-project:master Apr 1, 2024
5 checks passed
@justinvyu justinvyu deleted the localdir_docs branch April 1, 2024 17:42
justinvyu added a commit to justinvyu/ray that referenced this pull request Apr 2, 2024
…CHE_DIR` (ray-project#44284)

Removes docs that recommend using the `RAY_AIR_LOCAL_CACHE_DIR` env variable.

---------

Signed-off-by: Justin Yu <[email protected]>
khluu added a commit that referenced this pull request Apr 3, 2024
…CHE_DIR` (#44284) (#44422)

This is a docs only cherry-pick of #44284

Removes docs that recommend using the `RAY_AIR_LOCAL_CACHE_DIR` env variable.

---------

Signed-off-by: Justin Yu <[email protected]>
Co-authored-by: Kevin H. Luu <[email protected]>
ryanaoleary pushed a commit to ryanaoleary/ray that referenced this pull request Jun 7, 2024
…CHE_DIR` (ray-project#44284)

Removes docs that recommend using the `RAY_AIR_LOCAL_CACHE_DIR` env variable.

---------

Signed-off-by: Justin Yu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants