Skip to content

Issues: pytorch/torchtune

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
113 Open 356 Closed
113 Open 356 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[RFC] Optimizer CPU offload from torchao for single GPU low memory config
#1278 opened Aug 7, 2024 by gau-nernst
7 🚀 5
Remove safetensor restriction from download
#1334 opened Aug 14, 2024 by joecummings
@joecummings
🚀 2
FSDP / multi-GPU compatibility with EAI Eval Harness
#951 opened May 8, 2024 by haileyschoelkopf
🚀 2
expandable_segments with PYTORCH_CUDA_ALLOC_CONF reduces VRAM discussion Start a discussion
#1185 opened Jul 16, 2024 by winglian
9 🚀 1
Support for MPS?
#1215 opened Jul 24, 2024 by blackp2
2 🚀 1
[Feature Request] Support multimodal LLM, e.g., llava enhancement New feature or request
#811 opened Apr 19, 2024 by StarCycle
@pbontrager @felipemello1
2
e2e torchtune tutorial example
#825 opened Apr 20, 2024 by seyeint
@ebsmothers
7
Running LoRA + QLoRA on Colab Notebooks enhancement New feature or request
#828 opened Apr 21, 2024 by kartikayk
@ebsmothers @kartikayk
1
How to save a trained model so it can be loaded with HF from_pretrained()? enhancement New feature or request
#832 opened Apr 22, 2024 by calmitchell617
@joecummings @kartikayk
29
Validate all paths before doing any expensive work better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#861 opened Apr 24, 2024 by rohan-varma
Validation and early stopping during training community help wanted We would love the community's help completing this issue enhancement New feature or request high-priority
#883 opened Apr 26, 2024 by kinggongzilla
@ebsmothers
5
[FR] (Q)DoRA rfc Request for comments
#893 opened Apr 28, 2024 by DreamGenX
@ebsmothers
7
document integration with bitsandbytes? documentation Improvements or additions to documentation
#906 opened Apr 30, 2024 by Titus-von-Koeller
@kartikayk
2
Unify example dataset in configs
#916 opened May 1, 2024 by joecummings
@joecummings
3
lm harness distributed evaluation? enhancement New feature or request
#930 opened May 3, 2024 by monk1337
@joecummings
3
DPO 🤝 FSDP2 community help wanted We would love the community's help completing this issue
#1404 opened Aug 24, 2024 by ebsmothers
Input embeddings directly in TransformerDecoder
#968 opened May 12, 2024 by ghost
@kartikayk
1
Support for Intel GPUs
#999 opened May 17, 2024 by raymondbernard
6
Apply QLoRA to output projections and token embedding enhancement New feature or request
#1000 opened May 17, 2024 by rohan-varma
4
Make objects in notebooks importable in config enhancement New feature or request
#1003 opened May 18, 2024 by RdoubleA
@RdoubleA
how to support huawei Ascend npu device
#1006 opened May 20, 2024 by apachemycat
2
QLoRA Inference high-priority
#1020 opened May 25, 2024 by jeff52415
@ebsmothers
1
Benchmark performance against other implementation such as Llama-factory and Unsloth?
#1023 opened May 27, 2024 by liyucheng09
@ebsmothers @kartikayk
2
Support loading of pre-quantized models
#1041 opened May 31, 2024 by rohan-varma
1
How to serve fine-tuned model with vllm
#945 opened May 7, 2024 by Some-random
@joecummings
2
ProTip! Exclude everything labeled bug with -label:bug.