A vision substitution method based on visual attention models

被引:0
作者
机构
[1] School of Information Science and Engineering, Northeastern University, Shenyang
来源
Tian, Y.-N. (tianyanan@ise.neu.edu.cn) | 1600年 / Chinese Institute of Electronics卷 / 42期
关键词
Auditory display; Region of interest (ROI); Vision substitution; Visual attention;
D O I
10.3969/j.issn.0372-2112.2014.05.009
中图分类号
学科分类号
摘要
The existing vision substitution methods are only used in special environments because their mapping features are obtained by object recognition. Aiming at this problem, a vision substitution method based on visual attention models is proposed. Firstly, regions of interest are extracted according to human visual properties. And on the basis of the auditory display theory, PSC mapping method is presented that the position, size and color of regions of interest are respectively mapped into note loudness, duration and pitch. Results show that this method corresponds with the cognitive processes of human vision. It is good at helping the blind to obtain the important information and reducing the difficulty of training and learning. Moreover, the mapped electronic music is pleasing to ear and enjoyable.
引用
收藏
页码:890 / 895
页数:5
相关论文
共 10 条
  • [1] Meijer P.B.L., An experimental system for auditory image representations, IEEE Transactions on Biomedical Engineering, 39, 2, pp. 112-121, (1992)
  • [2] Sainarayanan G., Nagarajan R., Yaacob S., Fuzzy image processing scheme for autonomous navigation of human blind, Applied Soft Computing, 7, 1, pp. 257-264, (2007)
  • [3] Bologna G., Deville B., Pun T., On the use of the auditory pathway to represent image scenes in real-time, Neurocomputing, 72, 4, pp. 839-849, (2009)
  • [4] Chen C.L., Liao Y.F., Tai C.L., Image to MIDI mapping based on dynamic fuzzy color segmentation for visually impaired people, Pattern Recognition Letters, 32, 4, pp. 549-560, (2011)
  • [5] Itti L., Koch C., Niebur E., A model of saliency-based visual attention for rapid scene analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 11, pp. 1254-1259, (1998)
  • [6] Siagian C., Itti L., Rapid biologically-inspired scene classification using features shared with visual attention, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 2, pp. 300-312, (2007)
  • [7] Wang Z., Hu G., Ming J., Et al., Video quality assessment based on SSIM and ROI, Chinese Journal of Scientific Instrument, 30, 9, pp. 1906-1911, (2009)
  • [8] Huang K., Wang Q., Wu Z., Multi-scale color image enhancement algorithm based on color space and human visual system (HVS), Acta Electronica Sinica, 32, 4, pp. 673-676, (2004)
  • [9] Smith J.R., Integrated spatial and feature image systems: Retrieval, analysis and compression, (1997)
  • [10] Berlin B., Kay P., Basic Colors Terms: Their Universality and Evolution, pp. 15-25, (1991)