v1.6 Windows permissions problems with tmpdir created dirs #38433

joa-quim · 2020-11-13T15:59:44Z

I can reproduce this with more packages but this one should be enough to show the problem,

] test FFTW

Discrete cosine transform (DCT) tests |  337    337
Test Summary:  | Pass  Total
UNALIGNED flag |   74     74
Test Summary:           | Pass  Total
Base Julia issue #19892 |    3      3
     Testing FFTW tests passed
┌ Error: mktempdir cleanup
│   exception =
│    SystemError (with C:\TMP\jl_Q9AXIp): rmdir: Permission denied
│    Stacktrace:
│      [1] systemerror(p::Symbol, errno::Int32; extrainfo::String)

The problem seems to arise from the lack of Modify permission. When I try to manually remove the C:\TMP\jl_Q9AXIp I get a windows popup asking me to confirm that I have administrator permissions (which I have so it shouldn't ask, but it does). If I manually change the Modify permission to check then I can delete that directory without further questions.
Quite likely that explains why mktempdir cleanup can't do its job silently.

The text was updated successfully, but these errors were encountered:

KristofferC · 2020-11-13T16:12:32Z

Probably the same cause as #38411

bkamins · 2020-11-13T16:36:21Z

Yes - it seems to be related to "Modify" permissions. Yet on my system I have "Modify" set to yes in these folder for "Authenticated Users" and only "Users" it is set to "Read & execute"+"List"+"Read" onyl (without "Modify" and without "Write"). The same set of permissions is for all .julia subfolders.

musm · 2020-11-13T16:43:23Z

@bkamins what does winver say? And do you have admin permission on the machine?

bkamins · 2020-11-13T16:50:55Z

(but in general my system is up to date, just 2020 update is not available for my machine yet)

regarding rights - yes I have them (and that is why I personally do not have a problem - I just run Julia process as an administrator and all works, but many people do not have it)

musm · 2020-11-13T16:52:18Z

Strangely enough, on my copy (fresh 1.5 install) and running Julia without Admin privileges I cannot reproduce this error.

joa-quim · 2020-11-13T16:57:53Z

But I get this also in another computer with an older Windows version. On Julia 1.5.0 it runs fine.

joa-quim · 2020-11-13T16:59:22Z

Probably the same cause as #38411

Maybe but that PR was merged 16 days ago and I still see this problem with the (today's) nightly build.

bkamins · 2020-11-13T17:46:25Z

I am not sure it is related, but recently I started to get in DataFrames.jl errors in CI on nightly on Win and OSx of this kind: https://travis-ci.com/github/JuliaData/DataFrames.jl/jobs/439295303 and https://travis-ci.com/github/JuliaData/DataFrames.jl/jobs/439295302 (such things do not happen on Linux; the error message does not tell me what is the reason of failure but one of them might be permissions).

fredrikekre · 2020-11-13T17:49:01Z

I am not sure it is related, but recently I started to get in DataFrames.jl errors in CI on nightly on Win and OSx of this kind: https://travis-ci.com/github/JuliaData/DataFrames.jl/jobs/439295303 and https://travis-ci.com/github/JuliaData/DataFrames.jl/jobs/439295302 (such things do not happen on Linux; the error message does not tell me what is the reason of failure but one of them might be permissions).

That is #38429

musm · 2020-11-13T18:12:49Z

I tested a couple of configurations:

Locally installed a fresh copy of 1.5.3 in the default installation location, nuked the compile cache folder, attempted test FFTW and using Tables, no errors in both instances.
Fresh VM in Hyper-V with the build information below. Followed the same steps as in 1, and obtained a similar outcome, no errors.

I guess the good news is that the error isn't as widespread as initially thought, but the bad news is I can't reproduce the bug.

musm · 2020-11-13T18:40:54Z

How are you all installing Julia here? Is it directly form the website and then running the installer normally (without admin privileges)?

bkamins · 2020-11-13T18:44:10Z

Yes.

Also I have just checked that if I remove .julia folder then I get again:

julia> using DataFrames
[ Info: Precompiling DataFrames [a93c6f00-e57d-5684-b7b6-d8193f3e46c0]
ERROR: LoadError: IOError: unlink: permission denied (EACCES)

if I not run julia with admin privileges.

joa-quim · 2020-11-13T19:25:15Z

Sorry to cast more confusion but in a Win VM on the same machine were it errors I installed Julia both in the standard location (which I hate because it's a hidden directory) and under c:/programs/julia-DEV and in both cases I had no problems!!

Winver of the VM

musm · 2020-12-18T22:38:04Z

@joa-quim please reopen a new issue if you encounter this problem again. I suspect this is a dupe of #38411

joa-quim · 2020-12-18T23:30:28Z

I still see the problem

julia> mktempdir() do dir
       end
┌ Error: mktempdir cleanup
│   exception =
│    SystemError (with C:\TMP\jl_BrJXnk): rmdir: Permission denied

with

julia> versioninfo()
Julia Version 1.7.0-DEV.54
Commit 6ddc7f1ecc (2020-12-13 23:16 UTC)
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.0 (ORCJIT, skylake)

musm · 2020-12-21T18:58:48Z

@joa-quim do you have a custom JULIA_DEPOT_PATH set? Or any other env variables? I do not get that issue in a plain install of Julia in VM.

joa-quim · 2020-12-21T19:44:35Z

No. I know that's strange but the problem only occurs with v1.6 (and started about 2-3 months ago. Before it was ok). v1.5 in the exact same machine/config has no problems.

vtjnash · 2020-12-21T19:49:28Z

Might be libuv/libuv@509214d (which added the capability of supporting mode): but perhaps _mkdir had undocumented functionality affecting this?

EDIT: should not be different though (https://bugs.python.org/issue9752#msg115862)

musm · 2020-12-21T19:54:57Z

That's probably what I think. MSFT's docs for _mkdir don't specify how or if they set permissions for _mkdir.

CreateDirectoryW permissions with the NULL argument set them to a sensible value, but probably not what we want:

If lpSecurityAttributes is NULL, the directory gets a default security descriptor. The ACLs in the default security descriptor for a directory are inherited from its parent directory.

musm · 2020-12-30T05:45:48Z

Actually, this is fixed by #39038

I noticed that my TMP variable was set to a folder in my user path which is why I couldn't reproduce it initially.
Thus, to reproduce:

ENV["TMP"] = "C:\\TMP"
julia>  mktempdir() do dir
                     end

joa-quim · 2020-12-30T20:47:26Z

I'm sorry but too quick in closing

   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.7.0-DEV.194 (2020-12-30)
 _/ |\__'_|_|_|\__'_|  |  Commit aeb933c10e (0 days old master)
|__/                   |

julia> mktempdir() do dir end
┌ Error: mktempdir cleanup
│   exception =
│    SystemError (with C:\TMP\jl_T6S6rK): rmdir: Permission denied
│    Stacktrace:

But if that may help, I do not have the TMP in the Windows standard place

C:\v
set | grep TMP
TEMP=C:\TMP
TMP=C:\TMP

musm · 2020-12-30T20:53:43Z

Your nightly is a commit behind the one with the fix. Try downloading again.

joa-quim · 2020-12-30T20:58:15Z

OK, I'll try again tomorrow. I just did download the installer 1/4 hour ago.

musm · 2020-12-30T20:59:44Z

Sounds good, yes please confirm it works for you.

musm · 2020-12-30T22:07:07Z

I just did download the installer 1/4 hour ago.

Yeah, I think they take day or so to get updated.

joa-quim · 2020-12-31T14:30:52Z

Confirmed. Problem solved. Thanks
But on the other hand this new version crashes the VSC language server and broke Revise

musm · 2020-12-31T16:55:33Z

That's not surprising, it's a moving target. We will backport the fix for this issue to a stable release.

KristofferC mentioned this issue Nov 13, 2020

Permission errors for precompilation on Windows #38411

Closed

musm closed this as completed Dec 18, 2020

musm reopened this Dec 18, 2020

musm mentioned this issue Dec 30, 2020

[libuv] Bump to include DELETE win ACL patch #39038

Merged

musm linked a pull request Dec 30, 2020 that will close this issue

[libuv] Bump to include DELETE win ACL patch #39038

Merged

musm closed this as completed in #39038 Dec 30, 2020

musm mentioned this issue Jan 2, 2021

Test for Windows delete permissions in system folders #39078

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

v1.6 Windows permissions problems with tmpdir created dirs #38433

v1.6 Windows permissions problems with tmpdir created dirs #38433

joa-quim commented Nov 13, 2020

KristofferC commented Nov 13, 2020 •

edited

Loading

bkamins commented Nov 13, 2020

musm commented Nov 13, 2020

bkamins commented Nov 13, 2020 •

edited

Loading

musm commented Nov 13, 2020

joa-quim commented Nov 13, 2020

joa-quim commented Nov 13, 2020

bkamins commented Nov 13, 2020

fredrikekre commented Nov 13, 2020

musm commented Nov 13, 2020

musm commented Nov 13, 2020

bkamins commented Nov 13, 2020 •

edited

Loading

joa-quim commented Nov 13, 2020

musm commented Dec 18, 2020

joa-quim commented Dec 18, 2020

musm commented Dec 21, 2020

joa-quim commented Dec 21, 2020

vtjnash commented Dec 21, 2020 •

edited

Loading

musm commented Dec 21, 2020 •

edited

Loading

musm commented Dec 30, 2020

joa-quim commented Dec 30, 2020

musm commented Dec 30, 2020

joa-quim commented Dec 30, 2020

musm commented Dec 30, 2020

musm commented Dec 30, 2020

joa-quim commented Dec 31, 2020

musm commented Dec 31, 2020

v1.6 Windows permissions problems with *tmpdir* created dirs #38433

v1.6 Windows permissions problems with *tmpdir* created dirs #38433

Comments

joa-quim commented Nov 13, 2020

KristofferC commented Nov 13, 2020 • edited Loading

bkamins commented Nov 13, 2020

musm commented Nov 13, 2020

bkamins commented Nov 13, 2020 • edited Loading

musm commented Nov 13, 2020

joa-quim commented Nov 13, 2020

joa-quim commented Nov 13, 2020

bkamins commented Nov 13, 2020

fredrikekre commented Nov 13, 2020

musm commented Nov 13, 2020

musm commented Nov 13, 2020

bkamins commented Nov 13, 2020 • edited Loading

joa-quim commented Nov 13, 2020

musm commented Dec 18, 2020

joa-quim commented Dec 18, 2020

musm commented Dec 21, 2020

joa-quim commented Dec 21, 2020

vtjnash commented Dec 21, 2020 • edited Loading

musm commented Dec 21, 2020 • edited Loading

musm commented Dec 30, 2020

joa-quim commented Dec 30, 2020

musm commented Dec 30, 2020

joa-quim commented Dec 30, 2020

musm commented Dec 30, 2020

musm commented Dec 30, 2020

joa-quim commented Dec 31, 2020

musm commented Dec 31, 2020

v1.6 Windows permissions problems with tmpdir created dirs #38433

v1.6 Windows permissions problems with tmpdir created dirs #38433

KristofferC commented Nov 13, 2020 •

edited

Loading

bkamins commented Nov 13, 2020 •

edited

Loading

bkamins commented Nov 13, 2020 •

edited

Loading

vtjnash commented Dec 21, 2020 •

edited

Loading

musm commented Dec 21, 2020 •

edited

Loading