Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3D joints/ skeleton plot without Mesh #433

Open
Dipankar1997161 opened this issue Mar 22, 2023 · 1 comment
Open

3D joints/ skeleton plot without Mesh #433

Dipankar1997161 opened this issue Mar 22, 2023 · 1 comment

Comments

@Dipankar1997161
Copy link

Hey @Arthur151
I clarified my concepts and used Humannerf for my own 3d reconstruction and your parameters, helped a lot in this. Thank you for the work.

There's one final thing that I have to achieve which is plotting the 3d joints. how can I plot the 3d key points / skeleton in the 3d space?
here is a sample file shape from ROMP on 1 h36m image

The shape of the array under key "cam" is (1, 3)
The shape of the array under key "global_orient" is (1, 3)
The shape of the array under key "body_pose" is (1, 69)
The shape of the array under key "smpl_betas" is (1, 10)
The shape of the array under key "smpl_thetas" is (1, 72)
The shape of the array under key "center_preds" is (1, 2)
The shape of the array under key "center_confs" is (1, 1)
The shape of the array under key "cam_trans" is (1, 3)
The shape of the array under key "verts" is (1, 6890, 3)
The shape of the array under key "joints" is (1, 71, 3)
The shape of the array under key "pj2d_org" is (1, 71, 2)

i believe, the verts is the j_regressor, smpl_thetas represent the rotation of the smpl joints, betas are betas.
the cam is "Rh" and the cam_trans is "Th" in smpl format.

but I wonder, what are these joints and body_pose?? usually, smpl has a 24x3 shape so accordingly, the body_pose should be the 3d smpl joints which can be used to plot them into 3d space.

The shape of the joints is so weird and I am not sure because h36m has 17 keypoints but i shows 71,3 and also for the 2d image 71,2?

My main goal is to plot 3d smpl joints/ skeleton in the 3d space without the mesh. Any referrals to how I can achieve this?
Can we do this in ROMP too??

@yqtl
Copy link

yqtl commented Jul 25, 2023

I believe that the smpl_thetas corresponds to the values you're seeking. It should be shaped as 24x3. Please note that the composition of smpl_thetas (1,72) consists global_orientation (1,3) and body_pose (1, 69).

I guess pj2d_org[-17:] is the h36m joints.
#joints-in-output-npz-file

@Arthur151
However, there seems to be a discrepancy with the pj2d_org shape in your config_guide, which is specified as (54, 2).

Other things such as j3d_all54 and j3d_smpl24, which are supposedly part of the setting in the config_guide are missing, I was also wondering where to obtain them?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants