Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Install tensorflow-macos dependency conditionally #5124

Merged
merged 1 commit into from
Oct 19, 2022

Conversation

albertvillanova
Copy link
Member

Fix #5118.

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Oct 17, 2022

The documentation is not available anymore as the PR was closed or merged.

@@ -132,7 +132,8 @@
"py7zr",
"rarfile>=4.0",
"s3fs>=2021.11.1", # aligned with fsspec[http]>=2021.11.1
"tensorflow>=2.3,!=2.6.0,!=2.6.1",
"tensorflow>=2.3,!=2.6.0,!=2.6.1; sys_platform != 'darwin' or platform_machine != 'arm64'",
"tensorflow-macos; sys_platform == 'darwin' and platform_machine == 'arm64'",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW I think and platform_machine == 'arm64'" is not needed, as I was able to install tensorflow-macos on my MacOS with an Intel chip

$ sysctl -a | grep Intel
machdep.cpu.vendor: GenuineIntel
machdep.cpu.brand_string: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz

See https://github.com/huggingface/datasets-server/blob/9b346a79c5e3f51719fb2717683c4e5f86291201/services/worker/pyproject.toml#L34-L35

But maybe it's better to limit the exception cases and only use the fork for arm64.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@severo I'm not an expert on this subject. But it appears they recommend tensorflow-macos also for Intel x86-64: https://developer.apple.com/metal/tensorflow-plugin/

So you think I can safely remove and platform_machine == 'arm64'? Or better keeping to reduce the scope?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really don't know, I just wanted to share my recent experience with the same problem, and use the same solution if you opt for a reduced scope.

@albertvillanova albertvillanova merged commit d201a39 into huggingface:main Oct 19, 2022
@albertvillanova albertvillanova deleted the fix-5118 branch October 19, 2022 09:10
severo added a commit to huggingface/dataset-viewer that referenced this pull request Oct 21, 2022
severo added a commit to huggingface/dataset-viewer that referenced this pull request Oct 21, 2022
* refactor: 💡 rename error

to ensure it's clear it's an error.Also remove an unused error

* chore: 🤖 align with the datasets library for mac install

see huggingface/datasets#5124

* feat: 🎸 update docker images
mattstern31 added a commit to mattstern31/datasets-server-storage-admin that referenced this pull request Nov 11, 2023
* refactor: 💡 rename error

to ensure it's clear it's an error.Also remove an unused error

* chore: 🤖 align with the datasets library for mac install

see huggingface/datasets#5124

* feat: 🎸 update docker images
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Installing datasets on M1 computers
3 participants