[Feature] Support Delving into High-Quality Synthetic Face Occlusion Segmentation Datasets #2194
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -61,6 +61,4 @@ | |
| evaluation = dict( | ||
| interval=400, metric=['mIoU', 'mDice', 'mFscore'], pre_eval=True) | ||
|
|
||
| auto_resume = False | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -392,11 +392,58 @@ The extracted and upsampled COCO objects images and masks can be found in this [ | |
|
|
||
| Please extract CelebAMask-HQ and 11k Hands images based on the splits found in [drive](https://drive.google.com/drive/folders/15nZETWlGMdcKY6aHbchRsWkUI42KTNs5?usp=sharing). | ||
|
|
||
| download file to ./data_materials | ||
| ```none | ||
| CelebAMask-HQ.zip | ||
| CelebAMask-HQ-masks_corrected.7z | ||
| RealOcc.7z | ||
| RealOcc-Wild.7z | ||
| 11k-hands_mask.7z | ||
| 11k-hands_image.7z | ||
|
There was a problem hiding this comment. No. the datas can be found in the drive. https://github.com/jinwonkim93/mmsegmentation/blob/c222684c292f1f7edbb40ef761e7ff48a3b73602/docs/en/dataset_prepare.md?plain=1#L403 There was a problem hiding this comment. Perhaps I missed some information, I only found this link to download hand images at https://sites.google.com/view/11khands. There was a problem hiding this comment. yes. https://sites.google.com/view/11khands visit this site and download Hand images There was a problem hiding this comment. i will redefine the steps to download materials. There was a problem hiding this comment. i rewrote the procedure of downloading materials |
||
| coco_object.7z | ||
| dtd-r1.0.1.tar.gz | ||
| ``` | ||
| --- | ||
|
|
||
| ```bash | ||
| apt-get install p7zip-full | ||
|
|
||
| cd data_materials | ||
|
|
||
| #extract celebAMask-HQ and split by train-set | ||
| unzip CelebAMask-HQ.zip | ||
| 7za x CelebAMask-HQ-masks_corrected.7z -o./CelebAMask-HQ | ||
| #suggest better code if you have | ||
| rsync -a ./CelebAMask-HQ/CelebA-HQ-img/ --files-from=./CelebAMask-HQ-WO-train.txt ./CelebAMask-HQ-WO-Train_img | ||
| basename -s .jpg ./CelebAMask-HQ-train/* > train.txt | ||
|
There was a problem hiding this comment. Does There was a problem hiding this comment. yes you are right. sorry for the typo error. i will fix it |
||
| xargs -n 1 -i echo {}.png < train.txt > mask_train.txt | ||
| rsync -a ./CelebAMask-HQ/CelebAMask-HQ-masks_corrected/ --files-from=./mask_train.txt ./CelebAMask-HQ-WO-Train_mask | ||
| mv train.txt ../data/occlusion-aware-face-dataset | ||
|
There was a problem hiding this comment. I suggest creating the folder |
||
|
|
||
| #extact DTD | ||
| tar -zxvf dtd-r1.0.1.tar.gz | ||
| mv dtd DTD | ||
|
|
||
| #extract hands dataset and split by 200 samples | ||
| 7za x 11k-hands_masks.7z -o. | ||
| unzip Hands.zip | ||
| rsync -a ./Hands/ --files-from=./11k_hands_sample.txt ./11k-hands_img | ||
|
|
||
| #extract upscaled coco object | ||
| 7za x coco_object.7z -o. | ||
| mv coco_object/* . | ||
|
|
||
| #extract validation set | ||
| 7za x RealOcc.7z -o../data/occlusion-aware-face-dataset | ||
|
|
||
| ``` | ||
|
|
||
|
|
||
| **Dataset Organization:** | ||
|
|
||
| ```none | ||
|
|
||
| ├── data_materials | ||
| │ ├── CelebAMask-HQ-WO-Train_img | ||
| │ │ ├── {image}.jpg | ||
| │ ├── CelebAMask-HQ-WO-Train_mask | ||
|
|
@@ -413,20 +460,75 @@ Please extract CelebAMask-HQ and 11k Hands images based on the splits found in [ | |
| │ │ ├── {mask}.png | ||
| │ ├── object_image_sr | ||
| │ │ ├── {image}.jpg | ||
| │ ├── object_mask_x4 | ||
| │ │ ├── {mask}.png | ||
|
|
||
| ├── data | ||
| │ ├── occlusion-aware-face-dataset | ||
| │ │ ├── train.txt | ||
| │ │ ├── NatOcc_hand_sot | ||
| │ │ │ ├── img | ||
| │ │ │ │ ├── {image}.jpg | ||
| │ │ │ ├── mask | ||
| │ │ │ │ ├── {mask}.png | ||
| │ │ ├── NatOcc_object | ||
| │ │ │ ├── img | ||
| │ │ │ │ ├── {image}.jpg | ||
| │ │ │ ├── mask | ||
| │ │ │ │ ├── {mask}.png | ||
| │ │ ├── RandOcc | ||
| │ │ │ ├── img | ||
| │ │ │ │ ├── {image}.jpg | ||
| │ │ │ ├── mask | ||
| │ │ │ │ ├── {mask}.png | ||
| │ │ ├── RandOcc | ||
| │ │ │ ├── img | ||
| │ │ │ │ ├── {image}.jpg | ||
| │ │ │ ├── mask | ||
| │ │ │ │ ├── {mask}.png | ||
| │ │ │ ├── split | ||
| │ │ │ │ ├── val.txt | ||
| ``` | ||
|
|
||
| ## Data Generation | ||
|
|
||
| ```bash | ||
| git clone https://github.com/jinwonkim93/face-occlusion-generation.git | ||
| cd face_occlusion-generation | ||
| ``` | ||
| Example script to generate NatOcc hand dataset | ||
|
|
||
| ```bash | ||
| CUDA_VISIBLE_DEVICES=0 NUM_WORKERS=4 python main.py \ | ||
| --config ./configs/natocc_hand.yaml \ | ||
| --opts OUTPUT_PATH "path/to/mmsegmentation/data/occlusion-aware-face-dataset/NatOcc_hand_sot"\ | ||
| AUGMENTATION.SOT True \ | ||
| SOURCE_DATASET.IMG_DIR "path/to/data_materials/CelebAMask-HQ-WO-Train_img" \ | ||
| SOURCE_DATASET.MASK_DIR "path/to/mmsegmentation/data_materials/CelebAMask-HQ-WO-Train_mask" \ | ||
| OCCLUDER_DATASET.IMG_DIR "path/to/mmsegmentation/data_materials/11k-hands_img" \ | ||
| OCCLUDER_DATASET.MASK_DIR "path/to/mmsegmentation/data_materials/11k-hands_masks" | ||
|
Comment on lines
+520
to
+522
There was a problem hiding this comment. The '/' should be added to the end of the address, otherwise, the mask image will not be found. There was a problem hiding this comment. Yes, and i have fix the problem and PR it to the author. Try git pull the latest version |
||
| ``` | ||
| Example script to generate NatOcc object dataset | ||
|
|
||
| ```bash | ||
| CUDA_VISIBLE_DEVICES=0 NUM_WORKERS=4 python main.py \ | ||
| --config ./configs/natocc_objects.yaml \ | ||
| --opts OUTPUT_PATH "path/to/mmsegmentation/data/occlusion-aware-face-dataset/NatOcc_object" \ | ||
| SOURCE_DATASET.IMG_DIR "path/to/mmsegmentation/data_materials/CelebAMask-HQ-WO-Train_img" \ | ||
| SOURCE_DATASET.MASK_DIR "path/to/mmsegmentation/data_materials/CelebAMask-HQ-WO-Train_mask" \ | ||
| OCCLUDER_DATASET.IMG_DIR "path/to/mmsegmentation/data_materials/object_image_sr" \ | ||
| OCCLUDER_DATASET.MASK_DIR "path/to/mmsegmentation/data_materials/object_mask_x4" | ||
| ``` | ||
| Example script to generate RandOcc dataset | ||
|
|
||
| ```bash | ||
| CUDA_VISIBLE_DEVICES=0 NUM_WORKERS=4 python main.py \ | ||
| --config ./configs/randocc.yaml \ | ||
| --opts OUTPUT_PATH "path/to/mmsegmentation/data/occlusion-aware-face-dataset/RandOcc" \ | ||
| SOURCE_DATASET.IMG_DIR "path/to/mmsegmentation/data_materials/CelebAMask-HQ-WO-Train_img/" \ | ||
| SOURCE_DATASET.MASK_DIR "path/to/mmsegmentation/data_materials/CelebAMask-HQ-WO-Train_mask" \ | ||
| OCCLUDER_DATASET.IMG_DIR "path/to/jw93/mmsegmentation/data_materials/DTD/images" | ||
| ``` | ||
| <!-- #endregion --> | ||
|
|
||
| ```python | ||
|
|
||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think it's better to provide a script to help other users extract and split these images.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done