Use the following commands to install the required dependencies.
conda create --name holodeck python=3.9.16
conda activate holodeck
pip install -r requirements.txt
pip install --extra-index-url https://ai2thor-pypi.allenai.org ai2thor==0+6f165fdaf3cf2d03728f931f39261d14a67414d0
Download the data from here and extract it to the data/
folder, or use the following command:
FILE_ID=1MQbFbNfTz94x8Pxfkgbohz4l46O5e3G1
CONFIRM=$(curl -sc /tmp/gcookie "https://drive.google.com/uc?export=download&id=${FILE_ID}" | grep -o 'confirm=[^&]*' | sed 's/confirm=https://')
wget --load-cookies /tmp/gcookie "https://drive.google.com/uc?export=download&confirm=${CONFIRM}&id=${FILE_ID}" -O data.zip && rm -rf /tmp/gcookie
unzip data.zip
You can use the following command to generate a new environment.
python main.py --query "a living room" --openai_api_key <OPENAI_API_KEY>
To be noticed, our system is using gpt-4-1106-preview
, please make sure you have access to it.
Please cite the following paper if you use this code in your work.
@misc{yang2023holodeck,
title={Holodeck: Language Guided Generation of 3D Embodied AI Environments},
author={Yue Yang and Fan-Yun Sun and Luca Weihs and Eli VanderBilt and Alvaro Herrasti and Winson Han and Jiajun Wu and Nick Haber and Ranjay Krishna and Lingjie Liu and Chris Callison-Burch and Mark Yatskar and Aniruddha Kembhavi and Christopher Clark},
year={2023},
eprint={2312.09067},
archivePrefix={arXiv},
primaryClass={cs.CV}
}