Multimode modulated memristors for in-sensor computing system

To develop future interactive artificial intelligence system, the construction of high-performance human perception system and processing system is vital. In a traditional perceptual and processing system, sensors, memory and processing units are physically separated because of their different functions and manufacture conditions, which results in frequent shuttling and format transformation of data resulting in long time delay and high energy consumption. Inspired by biological sensory nervous system, one has proposed the concept of in-sensor computing system in which the basic unit integrates sensor, storage and computing functions in the same place. In-sensor computing technology can provide a reliable technical scheme for the area of sensory processing. Artificial memristive synapse capable of sensing light, pressure, chemical substances, etc. is one type of ideal device for the application of in-sensor computing system. In this paper, at the device level, recent progress of sensory memristive synapses applied to in-sensor computing systems are reviewed, including visual, olfactory, auditory, tactile and multimode sensation. This review points out the challenge and prospect from the aspects of device, fabrication, integrated circuit system architecture and algorithms, aiming to provide possible research direction for future development of in-sensor computing system.