ffmpeg support on jetson nano

SGLang is yet another fast serving framework for large language models and vision language models.

Real-time and accurate open-vocabulary end-to-end object detection

Enforce the output format (JSON Schema, Regex etc) of a language model

Structured Text Generation

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

[ICCV 2023] MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Tracking

TensorRT implementation of Depth-Anything V1, V2

WEB VIDEO PLATFORM是一个基于GB28181-2016标准实现的网络视频平台，支持NAT穿透，支持海康、大华、宇视等品牌的IPC、NVR、DVR接入。支持国标级联，支持rtsp/rtmp等视频流转发到国标平台，支持rtsp/rtmp等推流转发到国标平台。

轻量模型的图像分析web服务，包括倾斜矫正OCR，公章(印章)检测+识别，车牌识别。api方案使用FastAPI+Gunicorn，提供gradio展示。

🎉CUDA/C++ 笔记 / 大模型手撕CUDA / 技术博客，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

ppstructure deploy by ncnn

ComfyUI implementation of Omost

Resources for Multiple Object Tracking (MOT)

Cost-efficient and fast multi-LLM serving.

Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,Agents.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/

A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks including TensorRT, PyTorch, Paddle, and more. Protect your AI mod…

A reference application for a local AI assistant with LLM and RAG

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，…

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

《大模型白盒子构建指南》：一个全手搓的Tiny-Universe

OC_SORT implemented in C++ with Eigen Library