The kandinsky experience: A multisensory augmented reality application for cultural heritage

被引：0

作者：

Belloli S. ^{[1
]}

Porro S. ^{[1
]}

Virk V.S. ^{[1
]}

Etzi R. ^{[1
]}

Gallace A. ^{[2
]}

Bordegoni M. ^{[1
]}

Carulli M. ^{[1
]}

机构：

[1] Mind and Behavior Technological Center, Università di Milano Bicocca

来源：

Computer-Aided Design and Applications | 2020年 / 18卷 / 04期

关键词：

Augmented Reality; Cultural Heritage; Multisensory Perception; User Experience;

D O I：

10.14733/cadaps.2021.799-814

中图分类号：

学科分类号：

摘要：

Kandinsky-Experience Book is a multisensory Augmented Reality experience that involves sight, hearing and smell senses and aims at improving the users’ engagement in the Kandinsky’s artworks. Specifically, the aim of the application is to augment the experience of the user creating a journey throughout Kandinsky's work by using an AR application for smartphones integrated with audio and olfactory stimuli, in order to allow him/her to be more immersed in the piece of art. The research project has been inspired by the synesthetic approach of the abstract painter to the theory and the perception of art in his books. Starting from the artist’s considerations about the relationship between different sensorial stimuli in works of art, we decided to amplify some of his theories suggesting a connection between the main pictorial elements and some corresponding olfactory stimuli, grounding our hypotheses on the content of papers concerning the crossmodal synesthetic correspondences between olfactory stimuli and other sensorial modalities. Thanks to the simultaneous presentation of the specifically developed AR contents and the olfactory stimuli, the users’ feelings and emotions during the experience are amplified as a result of the sensory integration. Moreover, by using AR technology and olfactory devices to stimulate visual and olfactory perceptual channels we aimed at increasing the generation of longer-lasting memories in the users' mind. © 2021 CAD Solutions, LLC,.

引用

页码：799 / 814

页数：15

共 38 条

[1]

Alam K.-M., Rahman A.-S., El Saddik A., Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments, ACM Trans. Multimedia Comput. Commun. Appl, 9, 4, (2013)

[2]

Blazhenkova O., Kumar M.M., Angular Versus Curved Shapes: Correspondences and Emotional Processing, Perception, 47, 1, pp. 67-89, (2018)

[3]

Bordegoni M., Carulli M., Bader S., Wearable Olfactory Display for Museum Exhibitions, ISOEN 2019 – 18th International Symposium on Olfaction and Electronic Nose, Proceedings, (2019)

[4]

Bordegoni M., Carulli M., Ferrise F., Improving multisensory user experience through olfactory stimuli, Emotional Engineering, 7, (2019)

[5]

Bordegoni M., Carulli M., Shi Y., Ruscio D., Investigating the effects of odour integration in reading and learning experiences, Interaction Design and Architecture(s), 32, pp. 104-125, (2017)

[6]

Brunye T.T., Taylor H.A., Rapp D.N., Repetition and dual coding in procedural multimedia presentations, Applied Cognitive Psychology, 22, pp. 877-895, (2008)

[7]

Carulli M., Bordegoni M., Multisensory Augmented Reality Experiences for Cultural Heritage Exhibitions, Lecture Notes in Mechanical Engineering, (2020)

[8]

Clinton V., Reading from paper compared to screens: A systematic review and meta‐analysis, Journal of Research in Reading, 42, 2, pp. 288-325, (2019)

[9]

Crisinel A., Jacquier C., Deroy O., Et al., Composing with Cross-modal Correspondences: Music and Odors in Concert, Chem. Percept, 6, pp. 45-52, (2013)

[10]

Dalim C.S.B.C., Astronomy for Kids, E-Learning System Using Markerless Augmented Reality, (2013)

← 1 2 3 4 →