-
Notifications
You must be signed in to change notification settings - Fork 935
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for rapidsai - cudf and cuml packages GPU Data Science #594
Comments
I have a PR ready for review with passing test cases for both cuml and cudf. |
There is a few conflicts that prevent us from adding
We are using pandas 0.25.3 and we have several packages requiring >= 0.25. Any particular reasons for requiring this restriction?
We are using pyarrow 0.15.1 and we also have several packages requiring >= 0.15. Any particular reasons for not allowing pyarrow 0.15.x?
|
The reason we are running pandas < 0.25 rapidsai/cudf#3486 And pyarrow lockdown is because of a conda-forge conflict rapidsai/cudf#3318 |
Hi @jperez999 and @kkraus14 Are you planning on relaxing the constraint on Our image is currently using Thanks |
We are planning on upgrading to Arrow 0.17.1 in cudf 0.15 shortly. Unfortunately there was a bug introduced in 0.15.1 of Arrow that made it incompatible with nvcc which made us unable to upgrade until now. Note that 0.15 won't be released for a few months though as we're currently in progress of the 0.14 release. |
Hi @rosbo, we've upgraded to 0.17.1 in our nightlies but Arrow 1.0.0 has since released that we're considering upgrading to. Would that be a blocker for the kaggle container? |
Hi @kkraus14, It shouldn't be a blocker, arrow 0.17.1 and 1.0.0 both work with our version of the boost library (cause of the cascading changes earlier). Thanks for checking. |
@rosbo Any chance we could give this another shot? The 0.15 release uses Arrow 0.17.1 and boost 1.72 and has been released for a bit now. |
Kicked off a new build with 0.15 and will see if we get any conflicts: https://github.com/Kaggle/docker-python/tree/add-rapids-ai-0.15 |
We are in the process of migrating our GPU image to be based on Hitting conflicts again and I am waiting on conda to give me the list of conflicts... Will report hopefully soon.
|
The conflict resolver did eventually converge after more than 72h and printed a long list of conflict (longer than my bash terminal history limit setting). I will take a look at this more closely once we have migrated to the new base image. |
Thanks @rosbo. We're planning on releasing 0.16 in ~2 weeks and it will upgrade Arrow to 1.0.1 and keep boost at 1.72.0 as the main version pinnings. Let me know if there's anything I can help with. |
@rosbo quick ping here. 0.16 has been out for a while, any chance we could give this another shot? |
Hi @kkraus14, I will try to give it another shot this week. Thanks for the ping about the new release. |
@kkraus14 Great news! I was able to successfully install The original request was about adding Thank you |
I think we should just do |
No description provided.
The text was updated successfully, but these errors were encountered: