Jingbo Zhang, Xiaoyu Li, Qi Zhang, Yanpei Cao, Ying Shan, Jing Liao
| Project Page | Paper |
This repository contains the official implementation of the paper "HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion". Note that, this code is forked from threestudio for 3D representation and rendering pipeline.
conda env create -f environment.yml
Preprocessing: Estimate the SMPL-X body mesh using ECON and segment the input image into RGBA format
You need to modify the path setting ('os.environ['WEIGHT_PATH']') in 'third_parties/ECON/run_ECON_smpl.py'.
python third_parties/ECON/run_ECON_smpl.py --in_dir='./data/image_000355.jpg' --out_dir='./data/Results_ECON'
python run.py --config configs/humanref.yaml --train --gpu 0 image_path='./data/Results_ECON/image_000355/econ/imgs_crop/image_000355_0_rgba.png'
If you find our code or paper helps, please consider citing:
@inproceedings{zhang2024humanref,
title={Humanref: Single image to 3d human generation via reference-guided diffusion},
author={Zhang, Jingbo and Li, Xiaoyu and Zhang, Qi and Cao, Yanpei and Shan, Ying and Liao, Jing},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={1844--1854},
year={2024}
}