Skip to content

Commit

Permalink
DOC Add audio demo to README (PABannier#93)
Browse files Browse the repository at this point in the history
  • Loading branch information
PABannier committed Aug 26, 2023
1 parent d1afa34 commit 02f1f14
Showing 1 changed file with 10 additions and 2 deletions.
12 changes: 10 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,12 @@ The original implementation of `bark.cpp` is the bark's 24Khz English model. We

---

Here are typical audio pieces generated by `bark.cpp`:

https://github.com/PABannier/bark.cpp/assets/12958149/f9f240fd-975f-4d69-9bb3-b295a61daaff

https://github.com/PABannier/bark.cpp/assets/12958149/c0caadfd-bed9-4a48-8c17-3215963facc1

Here is a typical run using Bark:

```java
Expand Down Expand Up @@ -192,15 +198,17 @@ python3 convert.py \
./main -m ./ggml_weights/ -p "this is an audio"
```

### Optional quantize weights
### (Optional) Quantize weights

Weights can be quantized using the following strategy: `q4_0`, `q4_1`, `q5_0`, `q5_1`, `q8_0`.

Note that to preserve audio quality, we do not quantize the codec model. The bulk of the
computation is in the forward pass of the GPT models.

```bash
./quantize ./ggml_weights/ggml_weights_text.bin ./ggml_weights_q4/ggml_weights_text.bin q4_0
./quantize ./ggml_weights/ggml_weights_coarse.bin ./ggml_weights_q4/ggml_weights_coarse.bin q4_0
./quantize ./ggml_weights/ggml_weights_fine.bin ./ggml_weights_q4/ggml_weights_fine.bin q4_0
./quantize ./ggml_weights/ggml_weights_codec.bin ./ggml_weights_q4/ggml_weights_codec.bin q4_0
```

### Seminal papers and background on models
Expand Down

0 comments on commit 02f1f14

Please sign in to comment.