A spatial-temporal multiresolution CMOS image sensor with adaptive frame rates for tracking the moving objects in region-of-interest and suppressing motion blur

In this paper, we report a CMOS image sensor for spatial-temporal multiresolution images. This image sensor simultaneously generates two outputs: one for normal images (<30 fps) of stationery background and the other for adaptable frame-rate images (over 960 fps) of moving objects. The moving objects are tracked with a reduced spatial resolution in the region-of-interest (ROI). The entire image is reconstructed from the two images with the details in stationery objects and the suppressed motion blur in moving objects. High frame rate only applies to the ROI; therefore, the proposed scheme can significantly reduce power consumption by adjusting the optimal use of bandwidth. In order to provide real-time decision of ROI, the sensor employs on-chip motion-detection circuits based on the inter-pixel switch operation by storing the previous frame signal in a floating diffusion node. This allows a small pixel implementation without adding any extra in-pixel memory components. A prototype chip has been implemented using a 0.35 mu m 1P4M standard CMOS process and multiresolution images have been successfully captured. The fabricated chip operates at 3.3 V and consumes 75 mW in the multiresolution readout of a 256 x 256 normal image at 30 fps and a 64 x 64 ROI image at 240 fps.