Skip to content

CPM R-CNN: Calibrating Point-guided Misalignment in Object Detection

Notifications You must be signed in to change notification settings

zhubinQAQ/CPM-R-CNN

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CPM R-CNN: Calibrating Point-guided Misalignment in Object Detection

The official pytorch implementation of CPM R-CNN.

CPM R-CNN: Calibrating Point-guided Misalignment in Object Detection,
Bin Zhu, Qing Song, Lu Yang, Zhihui Wang, Chun Liu, Mengjie Hu WACV 2021. (arXiv pre-print)

Introduction

In object detection, offset-guided and point-guided regression dominate anchor-based and anchor-free method separately. Recently, point-guided approach is introduced to anchor-based method. However, we observe points predicted by this way are misaligned with matched region of proposals and score of localization, causing a notable gap in performance. In this paper, we propose CPM R-CNN which contains three efficient modules to optimize anchor-based point-guided method. According to sufficient evaluations on the COCO dataset, CPM R-CNN is demonstrated efficient to improve the localization accuracy by calibrating mentioned misalignment. Compared with Faster R-CNN and Grid R-CNN based on ResNet-101 with FPN, our approach can substantially improve detection mAP by 3.3% and 1.5% respectively without whistles and bells. Moreover, our best model achieves improvement by a large margin to 49.9% on COCO test-dev. Code and models will be publicly available.

  • CPM R-CNN pipeline:

  • Modules in CPM R-CNN:

Installation

  • 8 x TITAN RTX GPU

  • pytorch1.5.1

  • python3.7.0

  • Other details will be public soon.

Results and Models

On MS COCO test-dev

Backbone LR mAP AP50 (APs/APm/APl) DOWNLOAD
R-50-FPN 2x 41.7 59.2 23.1/44.0/54.7 [GoogleDrive] [BaiduPan]:a7k0
R-101-FPN 2x 43.3 61.2 23.9/46.3/56.6 [GoogleDrive] [BaiduPan]:mpc8
X-101-FPN-DCN 2x 46.4 65.3 26.8/49.4/61.0 [GoogleDrive] [BaiduPan]:enbd

Component-wise performance

CMM ISM RSM mAP
39.9
yes 40.7
yes 40.5
yes 40.6
yes yes yes 41.3

ImageNet pretrained weight

Training

To train a model with 8 GPUs run:

python -m torch.distributed.launch --nproc_per_node=8 tools/rcnn/train_net.py --cfg $CFG_NAME

Evaluation

python tools/rcnn/test_net.py --cfg $CFG_NAME

Citing CPM

If you find this work or code is helpful in your research, please cite:

@article{zhu2020cpm,
  title={CPM R-CNN: Calibrating Point-guided Misalignment in Object Detection},
  author={Zhu, Bin and Song, Qing and Yang, Lu and Wang, Zhihui and Liu, Chun and Hu, Mengjie},
  journal={arXiv preprint arXiv:2003.03570},
  year={2020}
}

About

CPM R-CNN: Calibrating Point-guided Misalignment in Object Detection

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published