SecretSun
Follow
Stars
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
For recording and retrieving metadata associated with ML developer and data scientist workflows.
A high-throughput and memory-efficient inference and serving engine for LLMs
LlamaIndex is a data framework for your LLM applications
Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…
Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
The reference implementation of the Linux FUSE (Filesystem in Userspace) interface
Universal LLM Deployment Engine with ML Compilation
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch…
Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API
本项目是一个 Redis 成本优化工程沉淀的工具集，包含了 Redis 的常用操作，比如 Redis 流量复制回放、Redis 数据在线压缩解压缩、Redis 数据清理TTL设置等工具集。
A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Example TensorFlow codes and Caicloud TensorFlow as a Service dev environment.
TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.
Read and write Tensorflow TFRecord data from Apache Spark.
Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with …
A FastAPI Middleware of https://github.com/joerick/pyinstrument to check your service performance.
KubeMQ is a Kubernetes native message queue broker
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
A modular graph-based Retrieval-Augmented Generation (RAG) system