Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add StarCoder/SantaCoder example #146

Merged
merged 14 commits into from
May 13, 2023
Merged

Add StarCoder/SantaCoder example #146

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
fb25cfd
init commit
NouamaneTazi May 11, 2023
83205ac
fix building starcoder
NouamaneTazi May 11, 2023
13af9ed
gen work
NouamaneTazi May 11, 2023
a850b78
fix vocab
NouamaneTazi May 11, 2023
f191133
santacoder mha
NouamaneTazi May 11, 2023
8d5253b
.
NouamaneTazi May 11, 2023
2861556
fix quantize
NouamaneTazi May 11, 2023
68bad53
offload_state_dict
NouamaneTazi May 11, 2023
56b3398
endoftext
NouamaneTazi May 11, 2023
94bfd58
rename scripts
NouamaneTazi May 11, 2023
fba0a14
fix main
NouamaneTazi May 12, 2023
b6b6348
scripts
NouamaneTazi May 12, 2023
3825839
update README
NouamaneTazi May 12, 2023
9c0c853
quickfixes
NouamaneTazi May 12, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix quantize
  • Loading branch information
@NouamaneTazi
NouamaneTazi committed May 11, 2023
commit 286155605297d8b562275509bcb6ac96dc679898
10 changes: 5 additions & 5 deletions examples/starcoder/quantize.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,11 +15,11 @@

// default hparams (GPT-2 117M)
struct gpt2_hparams {
int32_t n_vocab = 50257;
int32_t n_ctx = 1024;
int32_t n_embd = 768;
int32_t n_head = 12;
int32_t n_layer = 12;
int32_t n_vocab = 49280;
int32_t n_ctx = 2048;
int32_t n_embd = 2048;
int32_t n_head = 16;
int32_t n_layer = 24;
int32_t f16 = 1;
};

Expand Down