Hardware-friendly tone-mapping operator design and implementation for real-time embedded vision applications?

被引:4
作者
Muneer, Muhammad Hamza [1 ]
Pasha, Muhammad Adeel [1 ]
Khan, Ishtiaq Rasool [2 ]
机构
[1] Lahore Univ Management Sci LUMS, Dept Elect Engn, Lahore, Pakistan
[2] Univ Jeddah, Coll Comp Sci & Engn, Jeddah, Saudi Arabia
关键词
Tone-mapping operator; FPGA design and implementation; Power efficiency; High throughput; HDR; MODEL;
D O I
10.1016/j.compeleceng.2023.108892
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Tone-mapping is required to convert High Dynamic Range (HDR) images to Low Dynamic Range (LDR) images for viewing on standard displays. Most recent works in the domain include the efficient implementation of tone-mapping algorithms on Graphics Processing Units (GPUs) for throughput improvements. However, their downside is significantly high power consumption, making such solutions unsuitable for displays on embedded and general consumer electronic devices. In contrast, Field Programmable Gate Arrays (FPGAs) have demonstrated significant speedup on data-intensive image and video applications with a much lower power consumption than GPUs. This paper proposes a modular, scalable and resource-efficient FPGA implementation of a global Tone-Mapping Operator (TMO) based on histogram of the scene luminance and characteristics of the Human Visual System (HVS). Compared to GPU based implementation of a state-of-the-art TMO, our FPGA implementation achieved a higher throughput in the range of 2.5x to 4.5x with power savings of more than two orders of magnitude. Moreover, tonal quality of the proposed solution is better than the baseline TMO in approximately 80% of a dataset of 288 HDR images. The proposed solution also outperformed the state-of-the-art FPGA implementations of other TMOs in throughput, resource usage and scalability.
引用
收藏
页数:18
相关论文
共 25 条
[1]   An Adaptive Global and Local Tone Mapping Algorithm Implemented on FPGA [J].
Ambalathankandy, Prasoon ;
Ikebe, Masayuki ;
Yoshida, Takayuki ;
Shimada, Takeshi ;
Takamaeda, Shinya ;
Motomura, Masato ;
Asai, Tetsuya .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (09) :3015-3028
[2]   An FPGA implementation of a tone mapping algorithm with a halo-reducing filter [J].
Ambalathankandy, Prasoon ;
Hore, Alain ;
Yadid-Pecht, Orly .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2019, 16 (04) :1317-1333
[3]  
Cao X, 2020, 2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), P1814, DOI [10.1109/SSCI47803.2020.9308535, 10.1109/ssci47803.2020.9308535]
[4]  
Ferwerda J. A., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P249, DOI 10.1145/237170.237262
[5]   Tone-Mapping Using Perceptual-Quantizer and Image Histogram [J].
Khan, Ishtiaq Rasool ;
Aziz, Wajid ;
Shim, Seong-O. .
IEEE ACCESS, 2020, 8 :31350-31358
[6]   A Tone-Mapping Technique Based on Histogram Using a Sensitivity Model of the Human Visual System [J].
Khan, Ishtiaq Rasool ;
Rahardja, Susanto ;
Khan, Muhammad Murtaza ;
Movania, Muhammad Mobeen ;
Abed, Fidaa .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (04) :3469-3479
[7]   HDR-ARtiSt: an adaptive real-time smart camera for high dynamic range imaging [J].
Lapray, Pierre-Jean ;
Heyrman, Barthelemy ;
Ginhac, Dominique .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 12 (04) :747-762
[8]   A visibility matching tone reproduction operator for high dynamic range scenes [J].
Larson, GW ;
Rushmeier, H ;
Piatko, C .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 1997, 3 (04) :291-306
[9]   Low-cost and high-speed hardware implementation of contrast-preserving image dynamic range compression for full-HD video enhancement [J].
Li, Shih-An ;
Tsai, Chi-Yi .
IET IMAGE PROCESSING, 2015, 9 (08) :605-614
[10]   A Hybrid l1-l0 to Layer Decomposition Model for Tone Mapping [J].
Liang, Zhetong ;
Xu, Jun ;
Zhang, David ;
Cao, Zisheng ;
Zhang, Lei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4758-4766