Bio-inspired color-polarization imager for real-time in situ imaging

被引:139
作者
Garcia, Missael [1 ,2 ]
Edmiston, Christopher [1 ]
Marinov, Radoslav [1 ,3 ]
Vail, Alexander [4 ]
Gruev, Viktor [2 ,5 ]
机构
[1] Washington Univ, Dept Comp Sci & Engn, St Louis, MO 63130 USA
[2] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[3] Washington Univ, Inst Mat Sci & Engn, St Louis, MO 63130 USA
[4] Univ Cambridge, Dept Zool, Cambridge CB2 3EJ, England
[5] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
VISION; DIVISION; CUTTLEFISH; LIGHT; POLARIMETER; CAMOUFLAGE; CAMERAS; SENSORS; SYSTEM; EYES;
D O I
10.1364/OPTICA.4.001263
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Nature has a large repertoire of animals that take advantage of naturally abundant polarization phenomena. Among them, the mantis shrimp possesses one of the most advanced and elegant visual systems nature has developed, capable of high polarization sensitivity and hyperspectral imaging. Here, we demonstrate that by shifting the design paradigm away from the conventional paths adopted in the imaging and vision sensor fields and instead functionally mimicking the visual system of the mantis shrimp, we have developed a single-chip, low-power, high-resolution color-polarization imaging system. Our bio-inspired imager captures co-registered color and polarization information in real time with high resolution by monolithically integrating nanowire polarization filters with vertically stacked photodetectors. These photodetectors capture three different spectral channels per pixel by exploiting wavelength-dependent depth absorption of photons. Our bio-inspired imager comprises 1280 by 720 pixels with a dynamic range of 62 dB and a maximum signal-to-noise ratio of 48 dB. The quantum efficiency is above 30% over the entire visible spectrum, while achieving high polarization extinction ratios of similar to 40 on each spectral channel. This technology is enabling underwater imaging studies of marine species, which exploit both color and polarization information, as well as applications in biomedical fields. (C) 2017 Optical Society of America
引用
收藏
页码:1263 / 1271
页数:9
相关论文
共 57 条
[1]   Enhanced Sensitivity of CMOS Image Sensors by Stacked Diodes [J].
Antonio Lenero-Bardallo, Juan ;
Delgado-Restituto, Manuel ;
Carmona-Galan, Ricardo ;
Rodriguez-Vazquez, Angel .
IEEE SENSORS JOURNAL, 2016, 16 (23) :8448-8455
[2]   Event-Based Pixel Sensitive to Changes of Color and Brightness [J].
Berner, Raphael ;
Delbruck, Tobi .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2011, 58 (07) :1581-1590
[3]   Near-field Fourier transform polarimetry by use of a discrete space-variant subwavelength grating [J].
Biener, G ;
Niv, A ;
Kleiner, V ;
Hasman, E .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2003, 20 (10) :1940-1948
[4]   Ultraviolet filters in stomatopod crustaceans: diversity, ecology and evolution [J].
Bok, Michael J. ;
Porter, Megan L. ;
Cronin, Thomas W. .
JOURNAL OF EXPERIMENTAL BIOLOGY, 2015, 218 (13) :2055-2066
[5]   Biological Sunscreens Tune Polychromatic Ultraviolet Vision in Mantis Shrimp [J].
Bok, Michael J. ;
Porter, Megan L. ;
Place, Allen R. ;
Cronin, Thomas W. .
CURRENT BIOLOGY, 2014, 24 (14) :1636-1642
[6]   Open-ocean fish reveal an omnidirectional solution to camouflage in polarized environments [J].
Brady, Parrish C. ;
Gilerson, Alexander A. ;
Kattawar, George W. ;
Sullivan, James M. ;
Twardowski, Michael S. ;
Dierssen, Heidi M. ;
Gao, Meng ;
Travis, Kort ;
Etheredge, Robert Ian ;
Tonizzo, Alberto ;
Ibrahim, Amir ;
Carrizo, Carlos ;
Gu, Yalong ;
Russell, Brandon J. ;
Mislinski, Kathryn ;
Zhao, Shulei ;
Cummings, Molly E. .
SCIENCE, 2015, 350 (6263) :965-969
[7]  
Burkey B. C., 1986, U. S. patent, Patent No. [4,613,895 A, 4613895A]
[8]   Polarization signaling in swordtails alters female mate preference [J].
Calabrese, Gina M. ;
Brady, Parrish C. ;
Gruev, Viktor ;
Cummings, Molly E. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (37) :13397-13402
[9]   Trimodal color-fluorescence-polarization endoscopy aided by a tumor selective molecular probe accurately detects flat lesions in colitis-associated cancer [J].
Charanya, Tauseef ;
York, Timothy ;
Bloch, Sharon ;
Sudlow, Gail ;
Liang, Kexian ;
Garcia, Missael ;
Akers, Walter J. ;
Rubin, Deborah ;
Gruev, Viktor ;
Achilefu, Samuel .
JOURNAL OF BIOMEDICAL OPTICS, 2014, 19 (12)
[10]   Hyperspectral imaging of cuttlefish camouflage indicates good color match in the eyes of fish predators [J].
Chiao, Chuan-Chin ;
Wickiser, J. Kenneth ;
Allen, Justine J. ;
Genter, Brock ;
Hanlon, Roger T. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (22) :9148-9153