The operator 'aten::isin.Tensor_Tensor_out' is not currently implemented for the MPS device. while running on macOS

[paulz]

NotImplementedError:
The operator 'aten::isin.Tensor_Tensor_out' is not currently implemented for the MPS device. If you want this op to be added in priority during the prototype phase of this feature, please comment on https://github.com/pytorch/pytorch/issues/77764. As a temporary fix, you can set the environment variable `PYTORCH_ENABLE_MPS_FALLBACK=1` to use the CPU as a fallback for this op. WARNING: this will be slower than running natively on MPS.

and using PYTORCH_ENABLE_MPS_FALLBACK=1
cause very slow performance:

PYTORCH_ENABLE_MPS_FALLBACK=1 insanely-fast-whisper --device-id mps --file-name long-audio.mp3
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
🤗 Transcribing... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0:01:21
Voila!✨ Your file has been transcribed go check it out over here 👉 output.json

[JustinGuese]

same

[mertbozkir]

Same for me, how can I solve this? @Vaibhavs10

[piercecohen1]

+1

[flaviodelgrosso]

Running this: pip install --pre torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/nightly/cpushould solve the issue, but the following error occurs:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. pyannote-audio 3.2.0 requires torchaudio>=2.2.0, but you have torchaudio 2.2.0.dev20240529 which is incompatible.

[Vaibhavs10]

Sorry for the delay in responding to this, given the current constraints of requirements, AFAIK we'll need to wait for the next stable torch version release (which should be soon).

[BaronZack]

On pytorch nightly build 2.4.0, this bug is fixed.
try uninstall torch and reinstall with
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu

[adamjgrant]

I ran

pip uninstall torch torchvision torchaudio
pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu

And reattempted but still encountered this error

[harlantwood]

I got this working within miniconda ( https://docs.anaconda.com/miniconda/miniconda-install/ ) --

conda create -n insane-whisper python=3.12 -y
conda activate insane-whisper
pip3 uninstall torch torchvision torchaudio
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu
pip3 install insanely-fast-whisper

Now it works well within this conda env. Note that even though I also still have it installed outside of conda, within conda the correct version will be run:

$ which -a insanely-fast-whisper                                                                                                                                                                  
~/miniconda3/envs/insane-whisper/bin/insanely-fast-whisper
~/.local/bin/insanely-fast-whisper