Poorly Segmented body

[asimniazi63]

Poor results on some images, one of the examples is attached below:

How can we improve it

[Arthur151]

Sorry for the failure in body shape estimation. The reason is that the body shape of the training data is not abundant. Most 3D pose dataset only have tens of subjects (actors). Therefore, the estimated shape tend to be normal weight.
Most straight-forward solution is to fit the estimated body mesh to the body segmentation via a differentiable renderer (such as Example 2: Optimizing vertices of neural_renderer).
The drawback is that you may have to take care of the number of iterative optimization.

To avoid the bad results like above, it'd be better to optimize the estimated SMPL shape parameter and use its GMM prior constrain during loss calculation.