Let's build a conversational engine so we can talk to our computers!
- TTS engine added
- Runs completely locally
- Usuable by my grandmother, if she spoke english
- Simple to extend
- Discover little HCI hacks
- Being able to learn something while driving
- Clean up the LLaMa node cpp binding I added in my forked submodule enough to merge into mainline
- npm install
- Clone the submodules
- Build & run them (make sure that whisper.cpp & llama.cpp can run)
- In whisper.cpp git submodule
npx cmake-js compile --CDWHISPER_CUBLAS="ON" -T whisper-addon -B Release && cp -r ./build/Release /home/kache/attractor/talk/conversation/build/whisper - Note that the above command has --CDWHISPER_CUBLAS=ON. Change that depending on the build parameters you want for your whisper engine. cmake-js can take cmake flags using --CD{The flag you want}. I'm using CUBLAS=ON because I'm on a 3090. Drop it if you're on a macbook.
- Move the created ./whisper.cpp/build/Relase contents to ./bindings/whisper/whisper-addon
- In llama.cpp git submodule
npx cmake-js compile --CDLLAMA_CUBLAS="ON" -T llama-addon -B Release && cp -r ./build/Release /home/kache/attractor/talk/conversation/build/llama - Note, again, this includes LLAMA_CUBLAS flag. You only want this if you know what that flag does! E.g. if you're on a macbook, you don't want it.
- Move the created ./llama.cpp/build/Relase contents to ./bindings/llama/llama-addon
- Get weights! I'm using hermes-13b for LLaMa, and whisper tiny.
- Change config.json to point to the models
npm run start
Please do
vim ./${llama/whisper}/examples/addon.node/addon.cpp