Skip to content

Issues: b4rtaz/distributed-llama

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 22 Closed
27 Open 22 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Feature Request: iOS Support.
#110 opened Jul 29, 2024 by rahulmehtas
[Feature Suggest] Support for AVX instruction set
#107 opened Jul 28, 2024 by mrlicmi
1
Segmentation Fault
#105 opened Jul 23, 2024 by dot-ammar
5
[Feature request] Kubernetes setup
#101 opened Jul 12, 2024 by kami4ka
dllama: src/commands.cpp:102: MultiHeadAttSlice::MultiHeadAttSlice(unsigned int, unsigned int, unsigned int, slice_index_t): Assertion `nHeads % nSlices == 0' failed.
#98 opened Jul 7, 2024 by EntusiastaIApy
1
[New Feature] Add new route for dllama api for embeding models
#96 opened Jul 1, 2024 by testing0mon21
5
What about mobile phones?
#89 opened Jun 12, 2024 by dcale
6
what(): Cannot create socket
#87 opened Jun 2, 2024 by Slaghton
1
dllama-api hosted on 127.0.0.1
#82 opened Jun 1, 2024 by unclemusclez
2
float-type f32 will not start
#81 opened Jun 1, 2024 by unclemusclez
2
master and worker started but with problems
#80 opened May 31, 2024 by fabgat
8
support multi nvidia jetson agx orin?
#79 opened May 31, 2024 by WangFengtu1996
3
Support nSlices > nKvHeads
#70 opened May 27, 2024 by b4rtaz
[Feature Suggest] From All-Reduce to Ring-All-Reduce
#69 opened May 27, 2024 by zhengpeirong
1
Support for another models (ollama models)
#68 opened May 27, 2024 by testing0mon21
3
[Setup] Multiple Apple Silicon Macs: Questions
#67 opened May 26, 2024 by s04
1
network utilization
#58 opened May 18, 2024 by zhengpeirong
3
How To Add Suppoerted Model
#55 opened May 16, 2024 by hyperbolic-c
2
Vulkan Acceleration
#50 opened May 13, 2024 by DifferentialityDevelopment
35
terminate called after throwing an instance of 'ReadSocketException'
#48 opened May 12, 2024 by unclemusclez
35
JSONDecodeError("Expecting value", s, err.value) from None
#45 opened May 11, 2024 by unclemusclez
10
Unknown header key's while converting llama 3 70b to distributed format
#40 opened May 8, 2024 by DifferentialityDevelopment
1
Will this awesome proj consider supporting GPU acceleration？
#35 opened Apr 29, 2024 by galenyu
2
[Feature Suggest] Tensor Parallellism for Accelerating LLM
#29 opened Apr 26, 2024 by zhengpeirong
22
Need help in set up all the devices
#21 opened Apr 16, 2024 by MarcuXu
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.