Pretrain, finetune and serve LLMs on Intel platforms with Ray

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

KServe models web UI

A toolkit to run Ray applications on Kubernetes

Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

A high-throughput and memory-efficient inference and serving engine for LLMs

🤗 AutoTrain Advanced

Create GNOME Shell extensions in seconds

🥧 Fly-Pie is an innovative marking menu written as a GNOME Shell extension.

Create GNOME Shell extensions in seconds

A browser extension that generates and runs LLM prompts based on templates and user input such as selected text and the contents of the current page

Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of …

Discover the simplicity and strength of Duckdb, dbt, and Iceberg in this project. Create an efficient, versatile data analytics solution for valuable insights.

Memory for AI agents

Quick Guides from Dremio on Several topics

This book is a comprehensive manual designed to empower professionals to harness the potential of AI technologies responsibly and innovatively. The book addresses the technical, ethical, and practi…

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of …

Create markdown-backed Kanban boards in Obsidian.

Apache Kafka® running on Kubernetes

Kubeflow on OKE

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your d…

The GUI for Milvus

Open-source vector similarity search for Postgres

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.