Mask R-CNN

被引:288
作者
He, Kaiming [1 ]
Gkioxari, Georgia [1 ]
Dollar, Piotr [1 ]
Girshick, Ross [1 ]
机构
[1] Facebook AI Res, Menlo Pk, CA 94025 USA
关键词
Task analysis; Semantics; Feature extraction; Object detection; Proposals; Image segmentation; Quantization (signal); Instance segmentation; object detection; pose estimation; convolutional neural network;
D O I
10.1109/TPAMI.2018.2844175
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition. Mask R-CNN is simple to train and adds only a small overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to generalize to other tasks, e.g., allowing us to estimate human poses in the same framework. We show top results in all three tracks of the COCO suite of challenges, including instance segmentation, bounding-box object detection, and person keypoint detection. Without bells and whistles, Mask R-CNN outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners. We hope our simple and effective approach will serve as a solid baseline and help ease future research in instance-level recognition. Code has been made available at: https://github.com/facebookresearch/Detectron.
引用
收藏
页码:386 / 397
页数:12
相关论文
共 50 条
[21]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[22]   Research on abnormal object detection in specific region based on Mask R-CNN [J].
Xiong, Haitao ;
Wu, Jiaqing ;
Liu, Qing ;
Cai, Yuanyuan .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03)
[23]   Mask R-CNN Object Detection Method Based on Improved Feature Pyramid [J].
Ren Zhijun ;
Lin Suzhen ;
Li Dawei ;
Wang Lifang ;
Zuo Jianhong .
LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (04)
[24]   Instance segmentation scheme for roofs in rural areas based on Mask R-CNN [J].
Amo-Boateng, Mark ;
Sey, Nana Ekow Nkwa ;
Amproche, Amprofi Ampah ;
Domfeh, Martin Kyereh .
EGYPTIAN JOURNAL OF REMOTE SENSING AND SPACE SCIENCES, 2022, 25 (02) :569-577
[25]   Joint Mask R-CNN and Least Square Method for Antenna Parameters Measurement [J].
Xu, Ying ;
Ke, Qirui ;
Deng, Wenbo ;
Wu, Xi ;
Zhai, Yikui .
2019 3RD INTERNATIONAL CONFERENCE ON DATA SCIENCE AND BUSINESS ANALYTICS (ICDSBA 2019), 2019, :437-439
[26]   Enhanced Mask R-CNN for herd segmentation [J].
Bello, Rotimi-Williams ;
Mohamed, Ahmad Sufril Azlan ;
Talib, Abdullah Zawawi .
INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING, 2021, 14 (04) :238-244
[27]   Gastric Cancer Diagnosis with Mask R-CNN [J].
Cao, Guitao ;
Song, Wenli ;
Zhao, Zhenwei .
2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 1, 2019, :60-63
[28]   Building Area Estimation in Drone Aerial Images Based on Mask R-CNN [J].
Chen, Jun ;
Wang, Ganbei ;
Luo, Linbo ;
Gong, Wenping ;
Cheng, Zhan .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :891-894
[29]   Vision-Based Parking Space Detection: A Mask R-CNN Approach [J].
Song, Yuxin ;
Zeng, Jie ;
Wu, Teng ;
Ni, Wei ;
Liu, Ren Ping .
2021 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2021, :300-305
[30]   Ganster R-CNN: Occluded Object Detection Network Based on Generative Adversarial Nets and Faster R-CNN [J].
Sun, Kelei ;
Wen, Qiufen ;
Zhou, Huaping .
IEEE ACCESS, 2022, 10 :105022-105030