TWO-STEP COLOR-POLARIZATION DEMOSAICKING NETWORK

被引：12

作者：

Nguyen, Vy ^{[1
]}

Tanaka, Masayuki ^{[1
]}

Monno, Yusuke ^{[1
]}

Okutomi, Masatoshi ^{[1
]}

机构：

[1] Tokyo Inst Technol, Tokyo, Japan

来源：

2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年

关键词：

Color-polarization filter array; color demosaicking; polarization demosaicking; deep learning; RESIDUAL INTERPOLATION;

D O I：

10.1109/ICIP46576.2022.9897426

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Polarization information of light in a scene is valuable for various image processing and computer vision tasks. A division-of-focal-plane polarimeter is a promising approach to capture the polarization images of different orientations in one shot, while it requires color-polarization demosaicking. In this paper, we propose a two-step color-polarization demosaicking network (TCPDNet), which consists of two sub-tasks of color demosaicking and polarization demosaicking. We also introduce a reconstruction loss in the YCbCr color space to improve the performance of TCPDNet. Experimental comparisons demonstrate that TCPDNet outperforms existing methods in terms of the image quality of polarization images and the accuracy of Stokes parameters.

引用

收藏

页码：1011 / 1015

页数：5

相关论文

共 19 条

[1] Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters With Different Micro-Polarizer Patterns [J].

Ahmed, Ashfaq ;

Zhao, Xiaojin ;

Chang, Jintao ;

Ma, Hui ;

Gruev, Viktor ;

Bermak, Amine .

IEEE SENSORS JOURNAL, 2018, 18 (19) :7990-7997

[2] An Unconventional Method for Well-seismic Integrated Cycle Correlation and Sedimentary Evolution of Fluvial Reservoir [J].

Hu, Shuiqing ;

Wang, Jue ;

Zhao, Yi ;

Qin, Yong ;

Chen, Liuqin ;

Liu, Wenling ;

Liu, Yujuan .

JOURNAL OF COASTAL RESEARCH, 2020, :85-92

[3] Shape and Refractive Index from Single-View Spectro-Polarimetric Images [J].

Huynh, Cong Phuoc ;

Robles-Kelly, Antonio ;

Hancock, Edwin R. .

INTERNATIONAL JOURNAL OF COMPUTER VISION, 2013, 101 (01) :64-94

[4] Minimized Laplacian residual interpolation for DoFP polarization image demosaicking [J].

Jiang, Tuochi ;

Wen, Desheng ;

Song, Zongxi ;

Zhang, Weikang ;

Li, Zhixin ;

Wei, Xin ;

Liu, Gang .

APPLIED OPTICS, 2019, 58 (27) :7367-7374

[5]

Jospin L., 2018, ASIAN C COMPUTER VIS, P3

[6] Deep Polarization Cues for Transparent Object Segmentation [J].

Kalra, Agastya ;

Taamazyan, Vage ;

Rao, Supreeth Krishna ;

Venkataraman, Kartik ;

Raskar, Ramesh ;

Kadambi, Achuta .

2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8599-8608

[7] Beyond Color Difference: Residual Interpolation for Color Image Demosaicking [J].

Kiku, Daisuke ;

Monno, Yusuke ;

Tanaka, Masayuki ;

Okutomi, Masatoshi .

IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (03) :1288-1300

[8]

Kingma DP, 2014, ADV NEUR IN, V27

[9] 3.2-MP Back-Illuminated Polarization Image Sensor With Four-Directional Air-Gap Wire Grid and 2.5-μm Pixels [J].

Maruyama, Yasushi ;

Terada, Takashi ;

Yamazaki, Tomohiro ;

Uesaka, Yusuke ;

Nakamura, Motoaki ;

Matoba, Yoshihisa ;

Komori, Kenta ;

Ohba, Yoshiyuki ;

Arakawa, Shinichi ;

Hirasawa, Yasutaka ;

Kondo, Yuhi ;

Murayama, Jun ;

Akiyama, Kentaro ;

Oike, Yusuke ;

Sato, Shuzo ;

Ezaki, Takayuki .

IEEE TRANSACTIONS ON ELECTRON DEVICES, 2018, 65 (06) :2544-2551

[10] Survey of Demosaicking Methods for Polarization Filter Array Images [J].

Mihoubi, Sofiane ;

Lapray, Pierre-Jean ;

Bigue, Laurent .

SENSORS, 2018, 18 (11)