Image Content Enhancement Through Salient Regions Segmentation for People With Color Vision Deficiencies

被引:11
作者
Bruno, Alessandro [1 ]
Gugliuzza, Francesco [2 ]
Ardizzone, Edoardo [2 ]
Giunta, Calogero Carlo [2 ]
Pirrone, Roberto [2 ]
机构
[1] INAF IASF Palermo Ist Nazl Astrofis, Ist Astrofis Spaziale & Fis Cosm, Palermo, Italy
[2] Univ Palermo, Dipartimento Innovaz Ind & Digitale, Palermo, Italy
关键词
visual saliency; color vision deficiencies; image enhancement; eye-tracking; eye movements; image segmentation; imagery; VISUAL-ATTENTION; MODEL; RECOGNITION; SIMULATION; PATTERN; VIDEO;
D O I
10.1177/2041669519841073
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Color vision deficiencies affect visual perception of colors and, more generally, color images. Several sciences such as genetics, biology, medicine, and computer vision are involved in studying and analyzing vision deficiencies. As we know from visual saliency findings, human visual system tends to fix some specific points and regions of the image in the first seconds of observation summing up the most important and meaningful parts of the scene. In this article, we provide some studies about human visual system behavior differences between normal and color vision-deficient visual systems. We eye-tracked the human fixations in first 3 seconds of observation of color images to build real fixation point maps. One of our contributions is to detect the main differences between the aforementioned human visual systems related to color vision deficiencies by analyzing real fixation maps among people with and without color vision deficiencies. Another contribution is to provide a method to enhance color regions of the image by using a detailed color mapping of the segmented salient regions of the given image. The segmentation is performed by using the difference between the original input image and the corresponding color blind altered image. A second eye-tracking of color blind people with the images enhanced by using recoloring of segmented salient regions reveals that the real fixation points are then more coherent (up to 10%) with the normal visual system. The eye-tracking data collected during our experiments are in a publicly available dataset called Eye-Tracking of Color Vision Deficiencies.
引用
收藏
页数:21
相关论文
共 62 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]  
[Anonymous], COMPUTATIONAL PERSPE, DOI DOI 10.7551/MITPRESS/9780262015417.001.0001
[3]  
[Anonymous], 2015, CVPR 2015 WORKSHOP F
[4]   Exploiting Visual Saliency Algorithms for Object-Based Attention: A New Color and Scale-Based Approach [J].
Ardizzone, Edoardo ;
Bruno, Alessandro ;
Gugliuzza, Francesco .
IMAGE ANALYSIS AND PROCESSING (ICIAP 2017), PT II, 2017, 10485 :191-201
[5]   Scale detection via keypoint density maps in regular or near-regular textures [J].
Ardizzone, Edoardo ;
Bruno, Alessandro ;
Mazzola, Giuseppe .
PATTERN RECOGNITION LETTERS, 2013, 34 (16) :2071-2078
[6]  
Ardizzone E, 2013, LECT NOTES COMPUT SC, V8156, P773
[7]  
Ardizzone E, 2011, LECT NOTES COMPUT SC, V6978, P691, DOI 10.1007/978-3-642-24085-0_70
[8]   Quantifying variations in personal color spaces: Are there sex differences in color vision? [J].
Bimler, DL ;
Kirkland, J ;
Jameson, KA .
COLOR RESEARCH AND APPLICATION, 2004, 29 (02) :128-134
[9]   Computerized simulation of color appearance for dichromats [J].
Brettel, H ;
Vienot, F ;
Mollon, JD .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1997, 14 (10) :2647-2655
[10]  
Bruno A., 2018, ETOCVD EYE TRACKING