Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About dataset preprocessing: how to match the original videos with annots.npz in mpi_inf_3dhp #126

Closed
tinatiansjz opened this issue Dec 24, 2021 · 8 comments

Comments

@tinatiansjz
Copy link

tinatiansjz commented Dec 24, 2021

ROMP is an impressive work indeed! Thanks for sharing the code. Besides, it's admirable of you to deal with all the issues in time.
I have a little question about preprocessing of MPI_INF_3DHP dataset.
I examined the img_names field in dataset/mpi-inf-3dhp/cluster_results_noumap_mpiinf_kmeans.npz and found out that there exists video_[9,10] in every S[1-8]_Seq[1-2]. It confuses me as the original MPI_INF_3DHP only contains video_[1-8] in S[1-8]_Seq[1-2], as illustrated below.
企业微信截图_1640355146748

I wondered how to match the original videos with annots.npz or cluster_results_noumap_mpiinf_kmeans.npz that is officially provided. To put it another way, to which original videos that the frames with filenames containing video_[9,10] correspond?
It'd be appreciated if you could give me some advice. Thank you for your time.

@Arthur151
Copy link
Owner

Arthur151 commented Dec 26, 2021

Thanks for your kind words!
The code about extracting frames from video is placed at here.
About the MPI_INF_3DHP datasets, you may miss some videos. It contains 14 videos (0-13) in each Seq. Please refer to this introduction. I drop the unusual view of 11-13 and leave 0-10 for training.

@Arthur151
Copy link
Owner

No feedback

@tinatiansjz
Copy link
Author

Thank you for your notes and I apologize for the late reply.
I looked at the officially provided MPI-INF-3DHP download link on the project page and re-checked the config.ig.
It turns out that download_extra_wall_cameras and download_extra_ceiling_cameras (Line 13-14) need to be set to 1. Then we can get the additional video_[9-13] in every S[1-8]_Seq[1-2].
image
Thanks again for your time. The question has been solved!

@tinatiansjz tinatiansjz changed the title About dataset preprocessing: how to extract frames from original mpi_inf_3dhp dataset About dataset preprocessing: how to match the original videos with annots.npz in mpi_inf_3dhp Dec 28, 2021
@Arthur151
Copy link
Owner

Thanks for sharing this with other developers.

@liangwx
Copy link

liangwx commented Mar 1, 2022

请问cluster_results_noumap_h36m_kmeans.npz和cluster_results_noumap_mpiinf_kmeans.npz是如何生成的,没有找到生成代码

@Arthur151
Copy link
Owner

Arthur151 commented Mar 1, 2022

这个涉及到我们另一篇论文使用的姿态聚类方法(arxiv论文的Fig.12),相关代码会在论文接收后开源。

@liangwx
Copy link

liangwx commented Mar 1, 2022

请问还有annots_train2014.npz和annots_val2014.npz的生成过程和代码呢?

@Arthur151
Copy link
Owner

这里。每个数据集的annots.npz的生成函数就是各自的pack_data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants