Stars
4
stars
written in Python
Clear filter
A high-throughput and memory-efficient inference and serving engine for LLMs
🥚 Transform PDF to JSON or Markdown with ease and speed 🐣
Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.