Two-way focal stack fusion for light field saliency detection

被引:0
作者
Zhang, Yani [1 ]
Chen, Fen [1 ,2 ]
Peng, Zongju [1 ,2 ]
Zou, Wenhui [2 ]
Nie, Mengyu [1 ]
Zhang, Changhe [1 ]
机构
[1] Chongqing Univ Technol, Sch Elect & Elect Engn, 69 Hongguang Ave, Chongqing 400054, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
基金
中国国家自然科学基金;
关键词
FIBER-BUNDLE; OBJECT DETECTION; CONFOCAL MICROSCOPY; RESOLUTION; ENDOMICROSCOPY; ENHANCEMENT; NETWORK; MICROENDOSCOPE; IMAGES; TISSUE;
D O I
10.1364/AO.500999
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
To improve the accuracy of saliency detection in challenging scenes such as small objects, multiple objects, and blur, we propose a light field saliency detection method via two-way focal stack fusion. The first way extracts latent depth features by calculating the transmittance of the focal stack to avoid the interference of out-of-focus regions. The second way analyzes the focused distribution and calculates the background probability of the slice, which can distinguish the foreground from the background. Extracting the potential cues of the focal stack through the two different ways can improve saliency detection in complex scenes. Finally, a multi-layer cellular automaton optimizer is utilized to incorporate compactness, focus, center prior, and depth features to obtain the final salient result. Comparison and ablation experiments are performed to verify the effectiveness of the proposed method. Experimental results prove that the proposed method demonstrates effectiveness in challenging scenarios and outperforms the state-of-the-art methods. They also verify that the depth and focus cues of the focal stack can enhance the performance of previous methods. (c) 2023 Optica Publishing Group
引用
收藏
页码:9057 / 9065
页数:9
相关论文
共 88 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[3]   Ultrathin endoscopes based on multicore fibers and adaptive optics: a status review and perspectives [J].
Andresen, Esben Ravn ;
Sivankutty, Siddharth ;
Tsvirkun, Viktor ;
Bouwmans, Geraud ;
Rigneault, Herve .
JOURNAL OF BIOMEDICAL OPTICS, 2016, 21 (12)
[4]   Real-time video mosaicing with a high-resolution microendoscope [J].
Bedard, Noah ;
Quang, Timothy ;
Schmeler, Kathleen ;
Richards-Kortum, Rebecca ;
Tkaczyk, Tomasz S. .
BIOMEDICAL OPTICS EXPRESS, 2012, 3 (10) :2428-2435
[5]  
Berier F., 2010, US Patent, Patent No. [7,646,938, 7646938]
[6]   Fluorescence endomicroscopy with structured illumination [J].
Bozinovic, Nenad ;
Ventalon, Cathie ;
Ford, Tim ;
Mertz, Jerome .
OPTICS EXPRESS, 2008, 16 (11) :8016-8025
[7]   Flexible endoscope for continuous in vivo multispectral fluorescence lifetime imaging [J].
Cheng, Shuna ;
Rico-Jimenez, J. Jesus ;
Jabbour, Joey ;
Malik, Bilal ;
Maitland, Kristen C. ;
Wright, John ;
Cheng, Yi-Shing Lisa ;
Jo, Javier A. .
OPTICS LETTERS, 2013, 38 (09) :1515-1517
[8]   Saliency Detection for Stereoscopic Images Based on Depth Confidence Analysis and Multiple Cues Fusion [J].
Cong, Runmin ;
Lei, Jianjun ;
Zhang, Changqing ;
Huang, Qingming ;
Cao, Xiaochun ;
Hou, Chunping .
IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (06) :819-823
[9]   Micromachined scanning confocal optical microscope [J].
Dickensheets, DL ;
Kino, GS .
OPTICS LETTERS, 1996, 21 (10) :764-766
[10]   Fiber Bundle Image Reconstruction Using Convolutional Neural Networks and Bundle Rotation in Endomicroscopy [J].
Eadie, Matthew ;
Liao, Jinpeng ;
Ageeli, Wael ;
Nabi, Ghulam ;
Krstajic, Nikola .
SENSORS, 2023, 23 (05)