Commits

Commits on Jul 21, 2024

Merge pull request #145 from zzhhjjj/readme
zzhhjjj
committedJul 21, 2024

Commits on Jul 14, 2024

Merge pull request #207 from C-TC/recompute
3outeille
committedJul 14, 2024

Commits on Jul 8, 2024

Merge pull request #206 from huggingface/xrsrke-patch-3
xrsrke
committedJul 8, 2024
Update README.md
xrsrke
committedJul 8, 2024
Merge pull request #205 from huggingface/xrsrke-patch-2
xrsrke
committedJul 8, 2024
Update README.md
xrsrke
committedJul 8, 2024

Commits on Jun 10, 2024

Merge pull request #193 from huggingface/feat/add_trufflehog_ci
xrsrke
committedJun 10, 2024
fix(ci): remove unnecessary permissions
McPatate
committedJun 10, 2024
feat(ci): add trufflehog secrets detection
McPatate
committedJun 10, 2024

Commits on May 30, 2024

Merge pull request #188 from jquesnelle/patch-1
NouamaneTazi
committedMay 30, 2024

Commits on May 29, 2024

add rope_theta to hf conversion script
jquesnelle
committedMay 29, 2024
Merge pull request #185 from eliebak/add-decay-function
3outeille
committedMay 29, 2024

Commits on May 27, 2024

fix typo
eliebak
committedMay 27, 2024
Add 1-sqrt function for the cooldown phase.
eliebak
committedMay 27, 2024

Commits on May 20, 2024

Merge pull request #170 from TJ-Solergibert/numba_dependency
xrsrke
committedMay 20, 2024
Merge pull request #125 from yardenas/main
xrsrke
committedMay 20, 2024
Merge pull request #173 from jquesnelle/rope-theta
xrsrke
committedMay 20, 2024

Commits on May 18, 2024

Update examples/llama/tests/test_conversion.py

yardenas
and
xrsrke
committedMay 18, 2024
Update examples/llama/tests/test_conversion.py

yardenas
and
xrsrke
committedMay 18, 2024
add rope_theta config var for llama
jquesnelle
committedMay 18, 2024

Commits on May 14, 2024

layer recompute
C-TC
committedMay 14, 2024
wip
C-TC
committedMay 14, 2024
Fixed FA2 test
TJ-Solergibert
committedMay 14, 2024

Commits on May 13, 2024

Merge pull request #164 from huggingface/nouamane/readme
NouamaneTazi
committedMay 13, 2024
apparently flash-attn needs triton now
NouamaneTazi
committedMay 13, 2024
make numba import optional
NouamaneTazi
committedMay 13, 2024
.
NouamaneTazi
committedMay 13, 2024
.
NouamaneTazi
committedMay 13, 2024
.
NouamaneTazi
committedMay 13, 2024
Merge branch 'main' of https://github.com/huggingface/nanotron into nouamane/readme
NouamaneTazi
committedMay 13, 2024
Merge pull request #155 from TJ-Solergibert/nanosets
xrsrke
committedMay 13, 2024
Last fixes
TJ-Solergibert
committedMay 13, 2024

Commits on May 12, 2024

Adding support for tokenizers with vocab_size > 65536 (e.g. Llama3)
TJ-Solergibert
committedMay 12, 2024

Commits on May 10, 2024

Docs
TJ-Solergibert
committedMay 10, 2024
torchrun comment
TJ-Solergibert
committedMay 10, 2024