MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

Can I Trust Your Answer? Visually Grounded Video Question Answering (CVPR'24, Highlight)

Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges

Examples and guides for using the OpenAI API

A family of lightweight multimodal models.

VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

[Preprint] VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding

[ICCV2023] UniVTG: Towards Unified Video-Language Temporal Grounding

official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input

Inference of InternVL model on V100

Official Implementation of "The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval"

[CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".

Official implementation of OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusion

GPT4V-level open-source multi-modal model based on Llama3-8B

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

[ECCV2024] This is an official implementation for "PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model"

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-V…

[ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model

This is an official implementation of our CVPR 2020 paper "HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation" (https://arxiv.org/abs/1908.10357)

[CVPR 2024] Real-Time Open-Vocabulary Object Detection

UniMD: Towards Unifying Moment retrieval and temporal action Detection

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding