Skip to content

Issues: huggingface/accelerate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

108 Open 1,303 Closed
108 Open 1,303 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ValueError: Attempting to unscale FP16 gradients.
#2819 opened Jun 3, 2024 by NimbusLongfei
2 of 4 tasks
[Multi-node] num_processes is configured wrongly by accelerate config
#2818 opened Jun 3, 2024 by jubueche
2 of 4 tasks
cpu_offload with diffusers save_pretrained occurs the error: NotImplementedError: Cannot copy out of meta tensor; no data!
#2817 opened Jun 3, 2024 by zengziru
2 of 4 tasks
[DeepSpeed + Slurm + Accelerate] Rendez vous timeout error, questions about correct setup
#2816 opened Jun 1, 2024 by jubueche
2 of 4 tasks
"Only Tensors of floating point and complex dtype can require gradients", on FSDP, Accelerate, quatization
#2813 opened May 30, 2024 by artkpv
2 of 4 tasks
1
Text generation task otuputs nonsense when using transformers.pipeline with device_map="auto"
#2812 opened May 30, 2024 by cristi-zz
2 of 4 tasks
7
accelerate Inappropriate convert all inputs to specific dtype
#2811 opened May 30, 2024 by rangehow
4
NotImplementedError: Cannot copy out of meta tensor; no data!
#2809 opened May 29, 2024 by CHNRyan
3
save_state removes shared weights but load_state cannot load properly
#2807 opened May 27, 2024 by MiladInk
2 of 4 tasks
2
pdb like breakpoint Multiprocess Debugging with Accelerator
#2803 opened May 26, 2024 by ermu2001
1
Accelerateor .prepare() doubles vRAM usage
#2802 opened May 25, 2024 by marvingabler
2 of 4 tasks
5
Error with Deepspeed and dataloader_drop_last=True when batch size doesn't divide evenly
#2801 opened May 25, 2024 by mrbesher
2 of 4 tasks
RuntimeError: Expected is_sm80 || is_sm90 to be true, but got false.
#2799 opened May 23, 2024 by mostafamdy
4 tasks
7
Saving deepspeed ZERO-3 finetuned model fails sometimes.
#2797 opened May 23, 2024 by xuanyaoming
2 of 4 tasks
2
Loading the model with a higher context length
#2793 opened May 21, 2024 by Mugariya
1
replacing torch.utils.checkpoint with deepspeed.runtime.activation_checkpointing.checkpointing does not work
#2792 opened May 20, 2024 by vkaul11
2 of 4 tasks
2
GPU Memory Imbalance and OOM Errors During Training
#2789 opened May 17, 2024 by DONGRYEOLLEE1
2 of 4 tasks
14
[DeepSpeed] Asking for feedback when training with zero2 with accelerate and diffusers
#2787 opened May 16, 2024 by sayakpaul
2
AcceleratorState object has no attribute distributed_type.
#2786 opened May 16, 2024 by evelinamorim
2 of 4 tasks
2
Script hangs on .gather_for_metrics()
#2785 opened May 15, 2024 by priyammaz
2 of 4 tasks
4
Unable to launch DeepSpeed multinode training with a heterogenous mix of # devices per node.
#2780 opened May 14, 2024 by iantbutler01
2 of 4 tasks
5
Unable to load mistralai/Mixtral-8x7B-Instruct-v0.1 using mps
#2778 opened May 14, 2024 by chimezie
2 of 4 tasks
5
accelerate test does not work when using 3 GPUs
#2769 opened May 13, 2024 by Trojaner
2 of 4 tasks
Accelerate FSDP RuntimeError: Tensors of the same index must be on the same device and the same dtype
#2764 opened May 10, 2024 by yaswanthchittepu
Accelerate 0.30.0 Breaks FSDP QLora
#2761 opened May 10, 2024 by mallorbc
2 of 4 tasks
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.