Hexachromatic bioinspired camera for image-guided cancer surgery

被引:40
作者
Blair, Steven [1 ]
Garcia, Missael [1 ]
Davis, Tyler [1 ]
Zhu, Zhongmin [1 ]
Liang, Zuodong [1 ]
Konopka, Christian [2 ,3 ]
Kauffman, Kevin [4 ]
Colanceski, Risto [5 ]
Ferati, Imran [5 ]
Kondov, Borislav [5 ]
Stojanoski, Sinisa [6 ]
Todorovska, Magdalena Bogdanovska [7 ]
Dimitrovska, Natasha Toleska [5 ]
Jakupi, Nexhat [5 ]
Miladinova, Daniela [6 ]
Petrusevska, Gordana [7 ]
Kondov, Goran [5 ]
Dobrucki, Wawrzyniec Lawrence [2 ,3 ,8 ]
Nie, Shuming [1 ,2 ,9 ,10 ]
Gruev, Viktor [1 ,3 ,8 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois, Dept Bioengn, Urbana, IL 61801 USA
[3] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[4] Univ Michigan, Dept Biomed Engn, Ann Arbor, MI 48109 USA
[5] Ss Cyril & Methodius Univ Skopje, Univ Clin Hosp, Dept Thorac & Vasc Surg, Skopje 1000, North Macedonia
[6] Ss Cyril & Methodius Univ Skopje, Univ Clin Hosp, Inst Pathophysiol & Nucl Med, Skopje 1000, North Macedonia
[7] Ss Cyril & Methodius Univ Skopje, Univ Clin Hosp, Dept Pathol, Skopje 1000, North Macedonia
[8] Univ Illinois, Carle Illinois Coll Med, Urbana, IL 61820 USA
[9] Univ Illinois, Dept Chem, Urbana, IL 61801 USA
[10] Univ Illinois, Dept Mat Sci & Engn, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
3-DIMENSIONAL SHAPE MEASUREMENT; BREAST-CANCER; FLUORESCENCE; SENSORS; VISION; COLOR;
D O I
10.1126/scitranslmed.aaw7067
中图分类号
Q2 [细胞生物学];
学科分类号
071009 ; 090102 ;
摘要
Cancer affects one in three people worldwide. Surgery remains the primary curative option for localized cancers, but good prognoses require complete removal of primary tumors and timely recognition of metastases. To expand surgical capabilities and enhance patient outcomes, we developed a six-channel color/near-infrared image sensor inspired by the mantis shrimp visual system that enabled near-infrared fluorescence image guidance during surgery. The mantis shrimp's unique eye, which maximizes the number of photons contributing to and the amount of information contained in each glimpse of its surroundings, is recapitulated in our single-chip imaging system that integrates arrays of vertically stacked silicon photodetectors and pixelated spectral filters. To provide information about tumor location unavailable from a single instrument, we tuned three color channels to permit an intuitive perspective of the surgical procedure and three near-infrared channels to permit multifunctional imaging of optical probes highlighting cancerous tissue. In nude athymic mice bearing human prostate tumors, our image sensor enabled simultaneous detection of two tumor-targeted fluorophores, distinguishing diseased from healthy tissue in an estimated 92% of cases. It also permitted extraction of near-infrared structured illumination enabling the mapping of the three-dimensional topography of tumors and surgical sites to within 1.2-mm error. In the operating room, during surgical resection in 18 patients with breast cancer, our image sensor further enabled sentinel lymph node mapping using clinically approved near-infrared fluorophores. The flexibility and performance afforded by this simple and compact architecture highlights the benefits of biologically inspired sensors in image-guided surgery.
引用
收藏
页数:12
相关论文
共 41 条
[41]   Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector [J].
Zhang, Song ;
Yau, Shing-Tung .
APPLIED OPTICS, 2007, 46 (01) :36-43