Interactive Molecular Graphics for Augmented Reality Using HoloLens

被引:27
作者
Mueller, Christoph [1 ]
Krone, Michael [1 ]
Huber, Markus [1 ]
Biener, Verena [1 ]
Herr, Dominik [2 ,3 ]
Koch, Steffen [2 ]
Reina, Guido [1 ]
Weiskopf, Daniel [1 ,2 ]
Ertl, Thomas [1 ,2 ]
机构
[1] Univ Stuttgart, Visualisat Res Ctr VISUS, D-70569 Stuttgart, Germany
[2] Univ Stuttgart, Inst Visualisat & Interact Syst VIS, D-70569 Stuttgart, Germany
[3] Univ Stuttgart, GSaME, D-70569 Stuttgart, Germany
关键词
Bioinformatics; HoloLens; Augmented reality; Molecular visualisation; GPU; Scientific visualisation; Immersive Analytics;
D O I
10.1515/jib-2018-0005
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Immersive technologies like stereo rendering, virtual reality, or augmented reality (AR) are often used in the field of molecular visualisation. Modern, comparably lightweight and affordable AR headsets like Microsoft's HoloLens open up new possibilities for immersive analytics in molecular visualisation. A crucial factor for a comprehensive analysis of molecular data in AR is the rendering speed. HoloLens, however, has limited hardware capabilities due to requirements like battery life, fanless cooling and weight. Consequently, insights from best practises for powerful desktop hardware may not be transferable. Therefore, we evaluate the capabilities of the HoloLens hardware for modern, GPU-enabled, high-quality rendering methods for the space-filling model commonly used in molecular visualisation. We also assess the scalability for large molecular data sets. Based on the results, we discuss ideas and possibilities for immersive molecular analytics. Besides more obvious benefits like the stereoscopic rendering offered by the device, this specifically includes natural user interfaces that use physical navigation instead of the traditional virtual one. Furthermore, we consider different scenarios for such an immersive system, ranging from educational use to collaborative scenarios.
引用
收藏
页数:13
相关论文
共 28 条
[1]  
Ball R, 2007, CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, P191
[2]   The Protein Data Bank [J].
Berman, HM ;
Westbrook, J ;
Feng, Z ;
Gilliland, G ;
Bhat, TN ;
Weissig, H ;
Shindyalov, IN ;
Bourne, PE .
NUCLEIC ACIDS RESEARCH, 2000, 28 (01) :235-242
[3]   A Protein in the Palm of Your Hand Through Augmented Reality [J].
Berry, Colin ;
Board, Jason .
BIOCHEMISTRY AND MOLECULAR BIOLOGY EDUCATION, 2014, 42 (05) :446-449
[4]  
Chandler T, 2015, 2015 BIG DATA VISUAL ANALYTICS (BDVA)
[5]  
Chen Z, 2017, P ACM IEEE S EDG COM
[6]   THE CAVE - AUDIO-VISUAL EXPERIENCE AUTOMATIC VIRTUAL ENVIRONMENT [J].
CRUZNEIRA, C ;
SANDIN, DJ ;
DEFANTI, TA ;
KENYON, RV ;
HART, JC .
COMMUNICATIONS OF THE ACM, 1992, 35 (06) :64-72
[7]  
Falk M., 2016, INTERACTIVE GPU BASE
[8]   Augmented reality with tangible auto-fabricated models for molecular biology applications [J].
Gillet, A ;
Sanner, M ;
Stoffler, D ;
Goodsell, D ;
Olson, A .
IEEE VISUALIZATION 2004, PROCEEEDINGS, 2004, :235-241
[9]   3D-Lab: a collaborative web-based platform for molecular modeling [J].
Grebner, Christoph ;
Norrby, Magnus ;
Enstrom, Jonatan ;
Nilsson, Ingemar ;
Hogner, Anders ;
Henriksson, Jonas ;
Westin, Johan ;
Faramarzi, Farzad ;
Werner, Philip ;
Bostrom, Jonas .
FUTURE MEDICINAL CHEMISTRY, 2016, 8 (14)
[10]   Optimized Data Transfer for Time-dependent, GPU-based Glyphs [J].
Grottel, S. ;
Reina, G. ;
Ertl, T. .
IEEE PACIFIC VISUALIZATION SYMPOSIUM 2009, PROCEEDINGS, 2009, :65-72