Instructions on how to build a wasm ggml.

[fire]

It sounds obvious that we can compile ggml into wasm with WebGPU or Webgl2 support.

Has anyone done it and written about how to do it?

Alternatively, one can assist with some idea how to do it.

[fire]

The information was in the whispher.cpp repo

[westurner]

• "Minimal whisper.cpp example running fully in the browser"
  https://whisper.ggerganov.com/
• https://github.com/ggerganov/whisper.cpp/tree/master/examples/whisper.wasm :

  This WASM port utilizes WASM SIMD 128-bit intrinsics so you have to make sure that your browser supports them.

  • whisper.wasm : update Emscripten bridge to provide text segments and token data to the JS layer whisper.cpp#585
  • [Feature request] WASM WebGPU whisper.cpp#103
    • W3C WebNN
      • Spec: https://w3.org/TR/webnn/
      • Web: https://webmachinelearning.github.io/webnn-intro/
    • WASI-NN
      • Spec: https://github.com/WebAssembly/wasi-nn
  • WebAssembly and emscripten headers llama.cpp#97
  • Add example for voice-controlled Chess game using WASM whisper.cpp#428 (neat demo idea)

[westurner]

• https://github.com/rahuldshetty/starcoder.js/blob/cfd52a54f1c5224be8ee8524b55b9df4c82d09a5/build.sh#L9C1-L9C380 w/ newlines:

make \
  CC=emcc \
  CXX=em++ \
  LLAMA_NO_ACCELERATE=1 \
  CFLAGS="\
    -DNDEBUG \
    -s MEMORY64" \
  CXXFLAGS="\
    -DNDEBUG \
    -s MEMORY64" \
  LDFLAGS="\
    -s MEMORY64 \
    -s FORCE_FILESYSTEM=1 \
    -s EXPORT_ES6=1 \
    -s MODULARIZE=1 \
    -s TOTAL_MEMORY=2GB \
    -s STACK_SIZE=524288 \
    -s ALLOW_MEMORY_GROWTH \
    -s EXPORTED_FUNCTIONS=_main \
    -s EXPORTED_RUNTIME_METHODS=callMain \
    -s BUILD_AS_WORKER=1 \
    -s SINGLE_FILE=1 \
    -s NO_EXIT_RUNTIME=1" \
  main.js

• examples/Converting_starcoder_model.ipynb: https://github.com/rahuldshetty/starcoder.js/blob/main/examples/Converting_starcoder_model.ipynb

[westurner]

• ggml, llama.cpp, and whisper.cpp could be built with/by emscripten-forge?

  The existing emscripten-forge package definitions are in emscripten-forge/recipes//recipes/recipes_emscripten:
  https://github.com/emscripten-forge/recipes/tree/main/recipes/recipes_emscripten

[limcheekin]

• ggml, llama.cpp, and whisper.cpp could be built with/by emscripten-forge?
  The existing emscripten-forge package definitions are in emscripten-forge/recipes//recipes/recipes_emscripten:
  https://github.com/emscripten-forge/recipes/tree/main/recipes/recipes_emscripten

Thanks for sharing. As the issue had been closed, do you found the solution to build llama.cpp to WebAssembly?