Image Noise Simulation and Verification of Area Array CMOS Sensor

被引:0
|
作者
Chen Jingyuan [1 ,2 ]
Liu Xiao [2 ]
Du Lili [2 ]
Song Bo [2 ]
Sun Xiaobing [2 ]
机构
[1] Univ Sci & Technol China, Hefei 230026, Anhui, Peoples R China
[2] Chinese Acad Sci, Key Lab Optic Calibrat & Characterizat, Anhui Inst Opt & Fine Mech, Hefei Inst Phys Sci, Hefei 230031, Anhui, Peoples R China
关键词
sensors; area array CMOS; noise model; noise calibration; simulation analysis;
D O I
10.3788/AOS240581
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Objective With the continuous improvement in complementary metal-oxide-semiconductor ( CMOS) manufacturing technology, the performance of CMOS sensors has been significantly enhanced, making them comparable to charge-coupled device (CCD) sensors. Additionally, due to their advantages such as high integration, small size, low power consumption, and fast speed, CMOS sensors have gradually become the primary imaging devices in many fields such as aerospace, biomedical, industrial vision, and digital photography. In optical remote sensing imaging, the development of high- performance optical CMOS cameras requires significant investment and long development cycles. Adopting computer technology to simulate remote sensing images is of great significance for camera design, image quality assessment, and research on data processing algorithms. Building noise simulation models that match the working principles of optical sensors is a necessary and meaningful task. Currently, there are many studies related to noise simulation of CCD and CMOS sensors, but research on noise simulation of area array CMOS sensors often focuses on one or a few types of noise. Therefore, it is necessary to comprehensively analyze the noise data characteristics of area array CMOS sensors and build a complete noise simulation model. Methods We analyze various sources of noise during the imaging process based on the physics of CMOS sensors, build a set of noise models for CMOS sensor images and conduct noise simulation and validation of the effects. Firstly, the noise generated during the signal conversion of CMOS sensors is analyzed. Then, based on the noise characteristics, we build a noise model and propose a parameter calibration method for this model. Finally, we carry out simulations based on the calibrated noise parameters and evaluate and compare the simulated images under different noise models with actual images. By employing aerial photography data from Huizhou, Guangdong Province captured by a CMOS camera array, we adjust the noise model parameters to simulate the main noise components, thus validating the reliability of the noise simulation model and the effectiveness of the parameter calibration method. Results and Discussions To verify the superiority of the proposed noise model, we conduct laboratory simulations using two different noise models. Lab-captured R-channel bright field images with grayscale values saturated at 10%, 25%, 45%, and 60% of the dynamic range are selected as experimental objects. The simulated images using the proposed noise model exhibit brightness and noise distributions similar to those of the real images [Figs. 9( a) and 9(b)]. The average relative deviations of SNR, PSNR, and SSIM between simulated images using the Poisson-Gaussian distribution mixed noise model and real images are 4.83%, 1.21%, and 1.59% ( Table 2). Meanwhile, the average relative deviations of SNR, PSNR, and SSIM between simulated images using the proposed noise model and real images are 3.85%, 0.99%, and 1.33% (Table 2). It is observed that the proposed noise model has smaller relative deviations, which validates the effectiveness of the proposed method. Furthermore, the result comparison under different grayscale values using the same noise model indicates that under identical camera settings, higher light intensity leads to higher SNR. Additionally, SNR increases more rapidly at lower illuminations and transitions to a relatively slower growth rate at higher illuminations, which conforms to the general rule of SNR varying with signal intensity. The camera is primarily affected by photon shot noise at low illuminations, while at higher illuminations, it is mainly influenced by residual noise such as read noise. This may explain the relatively larger relative deviation when the grayscale value is saturated at 45%. To verify the influence of each noise component in the noise model on the image, we make adjustments to the parameters of the noise model based on aerial photography data captured by a CMOS camera. As the total gain increases, the image photon shot noise also rises to decrease image contrast, which is particularly noticeable in darker areas [Figs. 11( a) and 11(b)]. Row noise introduces noticeable horizontal stripe distortion in the image, and as the scale parameter of row noise increases, the horizontal stripes become more pronounced [Figs. 12(a) and 12(b)]. Increasing the scale parameter of read noise leads to a decrease in image sharpness, especially in low-contrast areas. Noise blurs edges and details in the image [ Figs. 13(a) and 13(b)]. Conclusions We propose a comprehensive noise simulation model, which fits noise data with heavy-tailed distributions using the Tukey lambda distribution. Meanwhile, we provide a method to calibrate model parameters for the noise model. By applying this noise model and calibration method to a scientific- grade CMOS camera, we obtain the noise model parameters for the camera sensor. Simulations are then conducted based on the calibrated noise parameters, with the simulated images compared with real images. The results show that the average relative deviations of SNR, PSNR, and SSIM between simulated and real images are 3.85%, 0.99%, and 1.33% ( Table 2). Additionally, the simulated images using our proposed noise model exhibit smaller relative deviations than those using different noise models. By adopting aerial photography data captured by a CMOS camera, we adjust the noise model parameters to simulate the main noise components. The simulation results reflect the influence of changes in noise model parameters on images and are consistent with the theoretical trends of noise characteristics. These two simulation experiments validate the reliability of the noise simulation model and parameter calibration method, and the effectiveness of the simulation method.
引用
收藏
页数:9
相关论文
共 21 条
  • [1] Review of CMOS image sensors
    Bigas, M
    Cabruja, E
    Forest, J
    Salvi, J
    [J]. MICROELECTRONICS JOURNAL, 2006, 37 (05) : 433 - 451
  • [2] Performance analysis of a color CMOS photogate image sensor
    Blanksby, AJ
    Loinaz, MJ
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2000, 47 (01) : 55 - 64
  • [3] Bu F, 2023, Proceedings of SPIE, V12747
  • [4] Design and testing of Monolithic Active Pixel Sensors for charged particle tracking
    Deptuch, G
    Berst, JD
    Claus, G
    Colledani, C
    Dulinski, W
    Gornushkin, Y
    Husson, D
    Riester, JL
    Winter, M
    [J]. IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2002, 49 (02) : 601 - 610
  • [5] Comparison of SNR image quality metrics for remote sensing systems
    Fiete, RD
    Tantalo, T
    [J]. OPTICAL ENGINEERING, 2001, 40 (04) : 574 - 585
  • [6] Source follower noise limitations in CMOS active pixel sensors
    Findlater, KM
    Vaillant, JM
    Baxter, DJ
    Augier, C
    Herault, D
    Henderson, RK
    Hurwitz, JED
    Grant, LA
    Volle, JM
    [J]. DETECTORS AND ASSOCIATED SIGNAL PROCESSING, 2004, 5251 : 187 - 195
  • [7] Practical Poissonian-Gaussian noise modeling and fitting for single-image raw-data
    Foi, Alessandro
    Trimeche, Mejdi
    Katkovnik, Vladimir
    Egiazarian, Karen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (10) : 1737 - 1754
  • [8] EXTREMES, EXTREME SPACINGS AND OUTLIERS IN THE TUKEY AND WEIBULL FAMILIES
    FREIMER, M
    KOLLIA, G
    MUDHOLKAR, GS
    LIN, CT
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1989, 18 (11) : 4261 - 4274
  • [9] Han B Y, 2012, Research on noise model and noise suppression methods of CMOS imaging devices
  • [10] A technique for evaluation of CCD video-camera noise
    Irie, Kenji
    McKinnon, Alan E.
    Unsworth, Keith
    Woodhead, Ian M.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2008, 18 (02) : 280 - 284