-
Notifications
You must be signed in to change notification settings - Fork 504
Pull requests: pytorch-labs/gpt-fast
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Integrate Flex Decoding
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#196
opened Aug 21, 2024 by
BoyuanFeng
Loading…
Add Phi-3-mini-4k-instruct bfloat16/int8
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#195
opened Aug 20, 2024 by
makaveli10
Loading…
int4 quantization cpu fix
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#193
opened Aug 1, 2024 by
likholat
Loading…
flex_attention ver.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#192
opened Jul 30, 2024 by
joydddd
Loading…
Update sdpa function with enable_gqa=True
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#191
opened Jul 13, 2024 by
jainapurva
Loading…
Decouple int4 weight with serialized format
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#187
opened Jul 2, 2024 by
yanbing-j
Loading…
[WIP] Use DTensor-based tensor parallel
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#180
opened Jun 12, 2024 by
kwen2501
Loading…
[example] Add support for DBRX
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#174
opened May 7, 2024 by
yanboliang
Loading…
[example] Added (hacky) Grok1 support
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#171
opened May 5, 2024 by
Chillee
Loading…
Making TokenizerInterface more usable for the user's code.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#170
opened Apr 30, 2024 by
Artyom17
Loading…
Remove used empty variable
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#164
opened Apr 26, 2024 by
yncxcw
Loading…
Add download script for tinyllamas
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#163
opened Apr 24, 2024 by
yiliu30
Loading…
Optimize Int8 Woq for CPU
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#161
opened Apr 23, 2024 by
yanbing-j
Loading…
Fixing quantize in int4 mode
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#159
opened Apr 19, 2024 by
Artyom17
Loading…
fix input_pos shape in comment
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#157
opened Apr 18, 2024 by
YassineYousfi
Loading…
testing HQQ [not for land]
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#155
opened Apr 9, 2024 by
HDCharles
Loading…
Fix compile_prefill to prevent CUDA error
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#153
opened Apr 7, 2024 by
PasserBy4
Loading…
fixing GPTQ
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#148
opened Mar 28, 2024 by
HDCharles
Loading…
fixing GPTQ
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#147
opened Mar 26, 2024 by
HDCharles
Loading…
Fixing block size for Mistral-7B.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#141
opened Mar 19, 2024 by
Artyom17
Loading…
GGUF fp32/fp16 conversion to checkpoint
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#134
opened Mar 12, 2024 by
mergennachin
Loading…
Optimized the process of loading PyTorch state dictionaries, merging …
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#133
opened Mar 12, 2024 by
hvaria
Loading…
Update to use torch.nn.attention.sdpa_kernel
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#131
opened Mar 11, 2024 by
yanboliang
Loading…
Updating requirements.txt and .gitignore
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#119
opened Feb 29, 2024 by
Artyom17
Loading…
[example] Added gemma support
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#115
opened Feb 29, 2024 by
Chillee
Loading…
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.