QLoRA: Efficient Finetuning of Quantized LLMs

Go ahead and axolotl questions

LLM Frontend for Power Users.

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

I2C device library collection for AVR/Arduino or other C++-based MCUs

CUDA on AMD GPUs

Arduino core for the ESP32

Rust library for quantitative finance.

Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them.

DeepSeek Coder: Let the Code Write Itself

GitHub-Powered AI for effortless development. Start as an open-source alternative to v0.dev.

Cloud native secrets management for developers - never leave your command line for secrets.

Unified framework for building enterprise RAG pipelines with small, specialized models

LSTM-RNN for sentiment analysis

Give a brain to your game's NPCs

The SQL IDE for Your Terminal.

📝 A curated list of awesome Raspberry Pi tools, projects, images and resources

esProc SPL is a scripting language for data processing, with well-designed rich library functions and powerful syntax, which can be executed in a Java program through JDBC interface and computing i…

An open-source, cross-platform terminal for seamless workflows

A knowledge base construction engine for richly formatted data

🌲 A tool for converting PDF into hOCR with text, tables, and figures being recognized and preserved.

Tesseract Open Source OCR Engine (main repository)

🧙‍♂️ ImageMagick 7

Formula recognition based on LaTeX-OCR and ONNXRuntime.

Image to LaTeX pytorch model

Another LaTex equation OCR tool based on ConvNeXt and Transformer