360 degrees omnidirectional image;
salient object detection;
equirectangular and cube-map projection;
projection features adaptation;
multi-level features adaptation;
SEGMENTATION;
D O I:
10.1109/LSP.2020.3028192
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
Salient object detection (SOD) in 360 degrees omnidirectional images has become an eye-catching problem because of the popularity of affordable 360 degrees cameras. In this paper, we propose a Features Adaptation Network (FANet) to highlight salient objects in 360 degrees omnidirectional images reliably. To utilize the feature extraction capability of convolutional neural networks and capture global object information, we input the equirectangular 360 degrees images and corresponding cube-map 360 degrees images to the feature extraction network (FENet) simultaneously to obtain multi-level equirectangular and cube-map features. Furthermore, we fuse these two kinds of features at each level of the FENet by a projection features adaptation (PFA) module, for selecting these two kinds of features adaptively. Finally, we combine the preliminary adaptation features at different levels by a multi-level features adaptation (MLFA) module, which weights these different-level features adaptively and produces the final saliencymaps. Experiments show our FANet outperforms the state-of-the-art methods on the 360 degrees omnidirectional SOD datasets.
机构:
Univ Wisconsin, Dept Comp Sci, Milwaukee, WI 53211 USAUniv Wisconsin, Dept Comp Sci, Milwaukee, WI 53211 USA
Borji, Ali
Cheng, Ming-Ming
论文数: 0引用数: 0
h-index: 0
机构:
Univ Oxford, Dept Engn Sci, Oxford OX1 3PJ, EnglandUniv Wisconsin, Dept Comp Sci, Milwaukee, WI 53211 USA
Cheng, Ming-Ming
Jiang, Huaizu
论文数: 0引用数: 0
h-index: 0
机构:
Univ Massachusetts, Coll Informat & Comp Sci, Amherst, MA 01003 USAUniv Wisconsin, Dept Comp Sci, Milwaukee, WI 53211 USA
Jiang, Huaizu
Li, Jia
论文数: 0引用数: 0
h-index: 0
机构:
Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100871, Peoples R China
Beihang Univ, Int Res Inst Multidisciplinary Sci, Beijing 100871, Peoples R ChinaUniv Wisconsin, Dept Comp Sci, Milwaukee, WI 53211 USA
机构:
Sichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu 610017, Sichuan, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Fu, Keren
Fan, Deng-Ping
论文数: 0引用数: 0
h-index: 0
机构:
Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Fan, Deng-Ping
Ji, Ge-Peng
论文数: 0引用数: 0
h-index: 0
机构:
Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Ji, Ge-Peng
Zhao, Qijun
论文数: 0引用数: 0
h-index: 0
机构:
Sichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu 610017, Sichuan, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Zhao, Qijun
Shen, Jianbing
论文数: 0引用数: 0
h-index: 0
机构:
Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
Shen, Jianbing
Zhu, Ce
论文数: 0引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Sichuan, Peoples R ChinaSichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
机构:
Anhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R ChinaAnhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R China
Gu Zongyun
Kan Junling
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R ChinaAnhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R China
Kan Junling
Ma Chun
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R ChinaAnhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R China
Ma Chun
Wang Qing
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R ChinaAnhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R China
Wang Qing
Li Fangfang
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R ChinaAnhui Univ Chinese Med, Coll Med Informat Engn, Hefei 230012, Peoples R China