Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add option to compilecache so that Pkg precompilation can not skip different versions of loaded modules #40345

Conversation

IanButterworth
Copy link
Sponsor Member

Paired with JuliaLang/Pkg.jl#2484

If I understand correctly, classical code-load precompilation skips precompiling different versions of loaded packages to save time, given they won't be loadable in the current session.

For the new pkg precompilation process this seems less critical.

The compilecache option added in this PR, along with JuliaLang/Pkg.jl#2484 allows Pkg precompilation to precompile the different version of loaded packages, but warn the user that the package is loaded so the new version won't be accessible until after a session restart.

This avoids the ? state in pkg precompilation that delayed precompilation until after session restart, which means the remaining precompilation was likely to happen at slower code-load as the user has to remember to go back to pkg mode and precompile.

The new behavior does all the precompilation in the current session, but reports as yellow 's, with an explanation that a restart is needed to access the new versions.

More details in JuliaLang/Pkg.jl#2484

@vtjnash
Copy link
Sponsor Member

vtjnash commented Apr 6, 2021

Might need a better (more descriptive) name, such as ignore_loaded_modules, but seems good otherwise

@vtjnash
Copy link
Sponsor Member

vtjnash commented Apr 6, 2021

Or could take concrete_deps as an argument itself (eventually, this is supposed to take a single environment, but we currently don't have a good way to reify those across processes)

@IanButterworth
Copy link
Sponsor Member Author

I assume the sockets test failure is unrelated. Can we merge this so the Pkg PR can be tested?

@IanButterworth
Copy link
Sponsor Member Author

IanButterworth commented Apr 6, 2021

Btw, the first suggestion was easier so I went with that. Hope that's ok. Thanks

base/loading.jl Outdated Show resolved Hide resolved
@IanButterworth IanButterworth merged commit 0da808d into JuliaLang:master Apr 8, 2021
@IanButterworth IanButterworth deleted the ib/compilecache_skip_loaded_modules_override branch April 8, 2021 01:11
@IanButterworth IanButterworth added the backport 1.6 Change should be backported to release-1.6 label Apr 12, 2021
@KristofferC KristofferC mentioned this pull request May 4, 2021
45 tasks
ElOceanografo pushed a commit to ElOceanografo/julia that referenced this pull request May 4, 2021
…different versions of loaded modules (JuliaLang#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment
antoine-levitt pushed a commit to antoine-levitt/julia that referenced this pull request May 9, 2021
…different versions of loaded modules (JuliaLang#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment
KristofferC pushed a commit that referenced this pull request May 11, 2021
…different versions of loaded modules (#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment

(cherry picked from commit 0da808d)
KristofferC pushed a commit that referenced this pull request May 12, 2021
…different versions of loaded modules (#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment

(cherry picked from commit 0da808d)
johanmon pushed a commit to johanmon/julia that referenced this pull request Jul 5, 2021
…different versions of loaded modules (JuliaLang#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment
@KristofferC KristofferC removed the backport 1.6 Change should be backported to release-1.6 label Jul 12, 2021
staticfloat pushed a commit that referenced this pull request Dec 23, 2022
…different versions of loaded modules (#40345)

* allow Pkg precomp to not skip loaded modules

* rename to ignore_loaded_modules

* arg alignment

(cherry picked from commit 0da808d)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants