Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sync : whisper.cpp #823

Merged
merged 14 commits into from
May 14, 2024
Merged

sync : whisper.cpp #823

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
8821421
whisper : update grammar-parser.cpp (whisper/2058)
eltociear Apr 15, 2024
6d3b994
main : pass nullptr when regex is empty (whisper/2070)
ggerganov Apr 17, 2024
85a1d20
whisper : more prominent log message for sub-1s audio (whisper/2065)
ggerganov Apr 24, 2024
623b291
Remove unnecessary memory reallocation in fft (whisper/2080)
goldwaving Apr 28, 2024
083d952
ggml : expose SSE3 and SSSE3 for MSVC when AVX is available (whisper/…
przemoc May 8, 2024
9466438
ggml : try fix ppc64 (whisper/0)
ggerganov May 12, 2024
14001e4
whisper : remove old flash attn code (whisper/0)
ggerganov May 13, 2024
b842efa
metal : tune soft_max number of threads (whisper/0)
ggerganov May 13, 2024
737407f
main : fix double quote escaping in csv output (whisper/2090)
mashizora May 13, 2024
71ce179
whisper : switch back to F32 mask (whisper/0)
ggerganov May 13, 2024
36caae3
main : add options for temperature control (whisper/2088)
ziegenberg May 13, 2024
42526d6
main : dont print timings with --no-prints (whisper/2108)
ziegenberg May 13, 2024
c7385b4
whisper : fix model path encoding in windows (whisper/2086)
thewh1teagle May 14, 2024
b2773a4
sync : whisper.cpp
ggerganov May 14, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
metal : tune soft_max number of threads (whisper/0)
  • Loading branch information
@ggerganov
ggerganov committed May 14, 2024
commit b842efa492c0ab5518cf144607aa9e9c17d9a4a1
4 changes: 2 additions & 2 deletions src/ggml-metal.m
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1378,7 +1378,7 @@ static enum ggml_status ggml_metal_graph_compute(
const bool use_f16 = (src1 && src1->type == GGML_TYPE_F16);

if (ne00%4 == 0) {
while (nth < ne00/4 && nth < 256) {
while (nth < ne00/4 && nth*ne01*ne02*ne03 < 256) {
nth *= 2;
}
if (use_f16) {
Expand All @@ -1387,7 +1387,7 @@ static enum ggml_status ggml_metal_graph_compute(
pipeline = ctx->kernels[GGML_METAL_KERNEL_TYPE_SOFT_MAX_F32_4].pipeline;
}
} else {
while (nth < ne00 && nth < 1024) {
while (nth < ne00 && nth*ne01*ne02*ne03 < 256) {
nth *= 2;
}
if (use_f16) {
Expand Down