Skip to content

Tensor library for machine learning on Winfows

License

Notifications You must be signed in to change notification settings

appvoid/windows-ggml

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

windows-ggml

The famous GGML library working now on Microsoft's OS

This version of GGML makes it possible to build the binaries using MinGW.

Features

  • Written in C
  • 16-bit float support
  • 4-bit integer quantization support
  • Automatic differentiation (WIP in progress)
  • ADAM and L-BFGS optimizers
  • Optimized for Apple silicon via NEON intrinsics and Accelerate framework
  • On x86 architectures utilzes AVX intrinsics
  • No third-party dependencies
  • Zero memory allocations during runtime

Here is how to run the example programs:

  1. Clone the repo: git clone https://github.com/appvoid/windows-ggml.git
  2. Download w64devkit.
  3. Extract w64devkit on your pc.
  4. Run w64devkit.exe.
  5. Use the cd command to reach the windows-ggml folder.

From here you can run

mkdir build && cd build
cmake -G "MinGW Makefiles" ..
make -j4 gpt-2

I've just noticed all you need is the cmake command to make it work almost everywhere. Made a whole repo, lol.

About

Tensor library for machine learning on Winfows

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C 95.3%
  • CMake 3.3%
  • Cuda 1.4%