Stars
A fast Golang Valkey client that supports Client Side Caching and Auto Pipelining.
A fast Golang Redis client that supports Client Side Caching, Auto Pipelining, Generics OM, RedisJSON, RedisBloom, RediSearch, etc.
Efficient Triton Kernels for LLM Training
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Serve LLMs on NCSA hardware. Support the best FOSS models, and the long tail on HuggingFace Hub.
A high-throughput and memory-efficient inference and serving engine for LLMs
A toolkit to run Ray applications on Kubernetes
hyoer0423 / ray
Forked from ray-project/rayRay is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
A cross platform CLI for Flyte. Written in Golang. Offers an intuitive interface to Flyte https://docs.flyte.org/projects/flytectl/en/latest/
Apache Spark - A unified analytics engine for large-scale data processing
GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under al…
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Standardized Serverless ML Inference Platform on Kubernetes
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
Code AI platform with Code Search & Cody
Altinity Kubernetes Operator for ClickHouse creates, configures and manages ClickHouse® clusters running on Kubernetes
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Yicheng-Lu-llll / flytekit
Forked from flyteorg/flytekitExtensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Yicheng-Lu-llll / kuberay
Forked from ray-project/kuberayA toolkit to run Ray applications on Kubernetes