A pytorch implementation of HumanNeRF (CVPR2022), as described in HumanNeRF : Efficiently Generated Human Radiance Field from Sparse Inputs.
HumanNeRF : Efficiently Generated Human Radiance Field from Sparse Inputs
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu
Project page / Paper / Video / Data
Tested on Ubuntu 20.04 + Pytorch 1.10.1 + RTX3090
Install environment:
$ conda create -n humannerf python=3.8
$ conda activate humannerf
$ pip install torch==1.10.1+cu113 torchvision==0.11.2+cu113 torchaudio==0.10.1+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
$ pip install imageio pillow scikit-image opencv-python configargparse lpips kornia warmup_scheduler matplotlib test-tube imageio-ffmpegPlease see each subsection for training or inference on different componenments. Available training datasets:
Our collected multi-view datasets are avaliable at Google Driver
Run
$ cd tools
$ python train_net.py configs/config.yml --gpu 0Run
$ cd tools
$ python render.py ${DATA_DIR} --output ${OUTPU_DIR} --render nerf --gpu 0Run
$ cd tools
$ python render.py ${DATA_DIR} --output ${OUTPU_DIR} --render blending --gpu 0@InProceedings{Zhao_2022_CVPR,
author = {Zhao, Fuqiang and Yang, Wei and Zhang, Jiakai and Lin, Pei and Zhang, Yingliang and Yu, Jingyi and Xu, Lan},
title = {HumanNeRF: Efficiently Generated Human Radiance Field From Sparse Inputs},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2022},
pages = {7743-7753}
}