AutoAtlas: Neural Network for 3D Unsupervised Partitioning and Representation Learning

被引:0
作者
Mohan, Kadri Aditya [1 ]
Kaplan, Alan D. [1 ]
机构
[1] Lawrence Livermore Natl Lab, Computat Engn Div CED, Livermore, CA 94551 USA
关键词
Three-dimensional displays; Magnetic resonance imaging; Biological neural networks; Task analysis; Image segmentation; Brain; Image reconstruction; Brain imaging; MRI; representation learning; deep learning; CNN; MRI SCANS; BRAIN; SEGMENTATION; PARCELLATION; MODEL; FMRI;
D O I
10.1109/JBHI.2021.3124733
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a novel neural network architecture called AutoAtlas for fully unsupervised partitioning and representation learning of 3D brain Magnetic Resonance Imaging (MRI) volumes. AutoAtlas consists of two neural network components: one neural network to perform multi-label partitioning based on local texture in the volume, and a second neural network to compress the information contained within each partition. We train both of these components simultaneously by optimizing a loss function that is designed to promote accurate reconstruction of each partition, while encouraging spatially smooth and contiguous partitioning, and discouraging relatively small partitions. We show that the partitions adapt to the subject specific structural variations of brain tissue while consistently appearing at similar spatial locations across subjects. AutoAtlas also produces very low dimensional features that represent local texture of each partition. We demonstrate prediction of metadata associated with each subject using the derived feature representations and compare the results to prediction using features derived from FreeSurfer anatomical parcellation. Since our features are intrinsically linked to distinct partitions, we can then map values of interest, such as partition-specific feature importance scores onto the brain for visualization.
引用
收藏
页码:2180 / 2191
页数:12
相关论文
共 50 条
[21]   Mutual Information Driven Equivariant Contrastive Learning for 3D Action Representation Learning [J].
Lin, Lilang ;
Zhang, Jiahang ;
Liu, Jiaying .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :1883-1897
[22]   Feedback Attention to Enhance Unsupervised Deep Learning Image Registration in 3D Echocardiography [J].
Hasan, Md. Kamrul ;
Luo, Yihao ;
Yang, Guang ;
Yap, Choon Hwai .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2025, 44 (05) :2230-2243
[23]   Denoising of 3D magnetic resonance images with multi-channel residual learning of convolutional neural network [J].
Dongsheng Jiang ;
Weiqiang Dou ;
Luc Vosters ;
Xiayu Xu ;
Yue Sun ;
Tao Tan .
Japanese Journal of Radiology, 2018, 36 :566-574
[24]   Denoising of 3D magnetic resonance images with multi-channel residual learning of convolutional neural network [J].
Jiang, Dongsheng ;
Dou, Weiqiang ;
Vosters, Luc ;
Xu, Xiayu ;
Sun, Yue ;
Tan, Tao .
JAPANESE JOURNAL OF RADIOLOGY, 2018, 36 (09) :566-574
[25]   MwoA auxiliary diagnosis using 3D convolutional neural network [J].
Li, Xiang ;
Wei, Benzheng ;
Wu, Hongyun ;
Li, Xuzhou ;
Cong, Jinyu .
2020 11TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST), 2020,
[26]   Learning Hierarchical Adaptive Code Clouds for Neural 3D Shape Representation [J].
Lu, Yuanxun ;
Ji, Xinya ;
Zhu, Hao ;
Cao, Xun .
MACHINE INTELLIGENCE RESEARCH, 2025, 22 (02) :304-323
[27]   Ensemble learning with 3D convolutional neural networks for functional connectome-based prediction [J].
Khosla, Meenakshi ;
Jamison, Keith ;
Kuceyeski, Amy ;
Sabuncu, Mert R. .
NEUROIMAGE, 2019, 199 :651-662
[28]   A 3D neural network for moving microorganism extraction [J].
Zhou, Fang ;
Wu, Tin-Yu ;
Liu, Jun ;
Wang, Bing ;
Obaidat, Mohammad S. .
NEURAL COMPUTING & APPLICATIONS, 2018, 30 (01) :57-67
[29]   Denoising 3D integral images by a single-shot unsupervised deep neural network [J].
Yaffe, Danielle ;
Reuven, Ayalla ;
Hazan, Adir ;
Stern, Adrian .
OPTICS EXPRESS, 2025, 33 (07) :15254-15267
[30]   Analysis and 3D Representation of Visual Information from fMRI of Ventral Temporal Cortex Using Neural Network and Support Vector Machine [J].
Reza, Md Tanzim ;
Zatnan, Md Sakib ;
Mobin, Iftekharul ;
Alam, Md Ashraful .
2019 5TH INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL ENGINEERING (ICAEE), 2019, :207-211