Skip to content

Issues: ggerganov/ggml

ggml : unified file format
#220 by philpax was closed Nov 1, 2023
Closed 82
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
212 Open 169 Closed
212 Open 169 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

old GPU on ggml CUDA, CUDA error 209 at ggml-cuda.cu:5284: no kernel image is available for execution on the device
#465 opened Aug 20, 2023 by makao007
1
Asserting over nb[0] as type check causes issue for tensors after permuting
#530 opened Sep 19, 2023 by cndn
1
Why GGML_F16_STEP is 32?
#526 opened Sep 15, 2023 by xshen053
3
Why GPT-J performs better on graviton without using simd than x86 using simd
#520 opened Sep 13, 2023 by xshen053
Converting an arbritrary HF Transformer GPT2 to ggml format
#519 opened Sep 12, 2023 by JellePiepenbrock
1
Directly converted from bfloat16 weights are 20x slower than converted from float32 ones.
#516 opened Sep 11, 2023 by OlegJakushkin
How to easily convert Meta's MMS-ASR models to ggml?
#507 opened Sep 6, 2023 by allandclive
1
ggml : better way to express implicit node dependencies in a graph enhancement New feature or request refactoring Refactoring
#502 opened Sep 4, 2023 by ggerganov
mpt-1b fails with mpt_model_load: unknown tensor 'transformer.blocks.0.attn.k_ln.weight' in model file
#499 opened Sep 1, 2023 by OlegJakushkin
4
[Feature request] Add support/demo implementation for Qwen-VL GGUF model
#497 opened Aug 30, 2023 by CoruNethron
2
Use custom GPT-J checkpoint
#488 opened Aug 28, 2023 by mariecwhite
1
gpt-j, starcoder, gptneox examples cause "not enough space in the context's memory pool" for batches >32
#484 opened Aug 27, 2023 by ravenscroftj
2
Doesnt support for Seq2SeqLM
#473 opened Aug 24, 2023 by Bhuvaneswaran-R
s390x platform support
#425 opened Jul 31, 2023 by writeword
Implementing all operators on CUDA
#463 opened Aug 19, 2023 by leejet
2
Concurrent requests using the CUDA backend
#456 opened Aug 16, 2023 by radu-matei
4
ggml : extend ggml_mul_mat to support non-F32 input for parameter b refactoring Refactoring
#455 opened Aug 16, 2023 by ggerganov
5
Does ggml support OP Fusion?
#451 opened Aug 14, 2023 by bobqianic
[Feature Request] disc/NVMe offloading
#446 opened Aug 12, 2023 by trabbart
Missing option to keep models loaded in RAM / GPU RAM
#444 opened Aug 11, 2023 by jacmkno
1
Support for quantized zero degradation matrix multiplication for Large Language Models
#440 opened Aug 8, 2023 by ThePerfectComputer
4
Do we have plan to support OPT model?
#437 opened Aug 7, 2023 by intellinjun
Cannot load teknium/Replit-v2-CodeInstruct-3B
#436 opened Aug 6, 2023 by shrikrishnaholla
14
Error with llvm-mingw (clang version 16.0.6)
#434 opened Aug 5, 2023 by fire
2
Feature Request: Support Cerebras BTLM
#427 opened Aug 2, 2023 by andersonbcdefg
5
ProTip! Add no:assignee to see everything that’s not assigned.