Multi-orientation depthwise extraction for stereo image super-resolution

被引:1
作者
Fan, Xiangyang [1 ]
Ye, Renjia [2 ]
Cai, Feifan [1 ]
Liu, Jinhua [1 ]
Li, Yuhang [1 ]
Huang, Liting [1 ]
Ding, Youdong [1 ,3 ]
机构
[1] Shanghai Univ, Coll Shanghai Film, 788 Guangzhong Rd, Shanghai 200072, Peoples R China
[2] Shanghai Univ, Sch Life Sci, 99 Shangda Rd, Shanghai 200444, Peoples R China
[3] Shanghai Engn Res Ctr Mot Picture Special Effects, 788 Guangzhong Rd, Shanghai 200072, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo vision; Super-resolution; Direction-aware; Parallax attention; PARALLAX ATTENTION;
D O I
10.1007/s11760-023-02640-w
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The increasing trend of binocular imaging in recent years has sparked a surge of interest in stereo image super-resolution. While considerable progress has been made in improving model performance, the potential of single-view and cross-view features remains largely unexplored. To address this, we present a novel network that incorporates both intra-view and inter-view feature extraction to enhance stereo image super-resolution. Specially, we design a multi-orientation depthwise extraction module to sufficiently extract various orientation features within a single view. Additionally, a cross focus module is proposed to capture more reliable hierarchical cross-view features. These modules can be integrated together to exploit trustworthier complementary information for HR image reconstruction. Our experimental results showcase the excellent performance of our method, surpassing all previous state-of-the-art methods for stereo image super-resolution.
引用
收藏
页码:4087 / 4095
页数:9
相关论文
共 28 条
[1]  
Ba J. L., 2016, CoRR
[2]   Cross Parallax Attention Network for Stereo Image Super-Resolution [J].
Chen, Canqiang ;
Qing, Chunmei ;
Xu, Xiangmin ;
Dickinson, Patrick .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :202-216
[3]   Simple Baselines for Image Restoration [J].
Chen, Liangyu ;
Chu, Xiaojie ;
Zhang, Xiangyu ;
Sun, Jian .
COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 :17-33
[4]   NAFSSR: Stereo Image Super-Resolution Using NAFNet [J].
Chu, Xiaojie ;
Chen, Liangyu ;
Yu, Wenqing .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :1238-1247
[5]   Feedback Network for Mutually Boosted Stereo Image Super-Resolution and Disparity Estimation [J].
Dai, Qinyan ;
Li, Juncheng ;
Yi, Qiaosi ;
Fang, Faming ;
Zhang, Guixu .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :1985-1993
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]  
Geiger A, 2012, PROC CVPR IEEE, P3354, DOI 10.1109/CVPR.2012.6248074
[8]   Image Super-Resolution via Dual-State Recurrent Networks [J].
Han, Wei ;
Chang, Shiyu ;
Liu, Ding ;
Yu, Mo ;
Witbrock, Michael ;
Huang, Thomas S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1654-1663
[9]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673
[10]   Single image super-resolution based on progressive fusion of orientation-aware features [J].
He, Zewei ;
Chen, Du ;
Cao, Yanpeng ;
Yang, Jiangxin ;
Cao, Yanlong ;
Li, Xin ;
Tang, Siliang ;
Zhuang, Yueting ;
Lu, Zhe-ming .
PATTERN RECOGNITION, 2023, 133