[IROS 2024] Official implementation of paper: DriVLMe: "Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experience"s

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)

Mobile Sensing and Robotics Course - 2020/21 By Prof. C. Stachniss

Multiple object tracking using Kalman Filter and Hungarian Algorithm - OpenCV

Occupancy grid mapping based on 2D Lidar data assuming perfect knowledge of a robot's trajectory.

Simulator for the MBZIRC Maritime Grand Challenge

[ACL 24] The official implementation of MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigation.

Codebase for the Airbert paper

A Python package for fast and robust Image Stitching

Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

Must-read Papers on Large Language Model (LLM) Planning.

Virtual RobotX (VRX) resources.

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

An all-weather, day-and-night, collision avoidance simulator that can be implemented as a digital twin for the autonomous COLREG-compliant navigation of maritime vessels.

Library for tracking-by-detection multi object tracking implemented in python

Segment Anything in High Quality [NeurIPS 2023]

A diagnostic dataset for navigation reasoning.

Talk2BEV: Language-Enhanced Bird's Eye View Maps (Accepted to ICRA'24)

Code for the ICCV'21 paper "Context-aware Scene Graph Generation with Seq2Seq Transformers"

Train Scene Graph Generation for Visual Genome and GQA in PyTorch >= 1.2 with improved zero and few-shot generalization.

Pytorch implementation of "A simple neural network module for relational reasoning" (Relational Networks)

Handbook of Marine Craft Hydrodynamics and Motion Control is an extensive study of the latest research in marine craft hydrodynamics, guidance, navigation, and control (GNC) systems.

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

This is implementation of finetuning BLIP model for Visual Question Answering

A simple script that reads a directory of videos, grabs a random frame, and automatically discovers a prompt for it