This version of GGML makes it possible to build the binaries using MinGW.
- Written in C
- 16-bit float support
- 4-bit integer quantization support
- Automatic differentiation (WIP in progress)
- ADAM and L-BFGS optimizers
- Optimized for Apple silicon via NEON intrinsics and Accelerate framework
- On x86 architectures utilzes AVX intrinsics
- No third-party dependencies
- Zero memory allocations during runtime
Here is how to run the example programs:
- Clone the repo:
git clone https://github.com/appvoid/windows-ggml.git
- Download w64devkit.
- Extract w64devkit on your pc.
- Run w64devkit.exe.
- Use the
cd
command to reach the windows-ggml folder.
From here you can run
mkdir build && cd build
cmake -G "MinGW Makefiles" ..
make -j4 gpt-2
I've just noticed all you need is the cmake command to make it work almost everywhere. Made a whole repo, lol.