Don't Look Now: Audio/Haptic Guidance for 3D Scanning of Landmarks

被引:0
|
作者
Van Brummelen, Jessica [1 ]
Urwin, Liv Piper [2 ]
Johnston, Oliver James [1 ]
Sayed, Mohamed [1 ]
Brostow, Gabriel [2 ]
机构
[1] Niantic Inc, London, England
[2] UCL, Niant Inc, London, England
来源
PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024 | 2024年
关键词
3D scanning; mesh reconstruction accuracy; guidance; multimodal feedback; audio feedback; haptic feedback; visual feedback; AR; engagement; user safety; HEART-RATE; LOCALIZATION; COMPLEX;
D O I
10.1145/3613904.3642271
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People are increasingly using their smartphones to 3D scan objects and landmarks. On one hand, users have intrinsic motivations to scanwell, i.e. keeping the object in-frame while walking around it to achieve coverage. On the other, users can lose interest when filming inanimate objects, and feel rushed and uncertain of their progress when watching their step in public, seeking to avoid attention. We set out to guide users while reducing their stress and increasing engagement, by moving away from the on-screen feedback ubiquitous in existing products and apps meant for 3D scanning. Specifically, our novel interface gives users audio/haptic guidance while they scan statue-type landmarks in public. The interface results from a conceptual design process and a pilot study. Ultimately, we tested 50 users in an ultra-high-traffic area of central London. Compared to regular on-screen feedback, users were more engaged, had unchanged stress levels, and produced better scans.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] A 3D Nonlinear Guidance Law with Impact Terminal Angle Constraints
    Li Xinsan
    Wang Lixin
    Chen Ke
    Yan Xunliang
    Fan Xiaohu
    Ding Bangping
    2015 CHINESE AUTOMATION CONGRESS (CAC), 2015, : 2242 - 2246
  • [22] 3D Audio-Visual Speaker Tracking with A Novel Particle Filter
    Liu, Hong
    Sun, Yongheng
    Li, Yidi
    Yang, Bing
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7343 - 7348
  • [23] 3D Room Geometry Reconstruction Using Audio-Visual Sensors
    Kim, Hansung
    Remaggi, Luca
    Jackson, Philip J. B.
    Fazi, Filippo Maria
    Hilton, Adrian
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 621 - 629
  • [24] Synthetic Transaural Audio Rendering (STAR): Extension to Full 3D Spatialization
    Marchand, Sylvain
    Meaux, Eric
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2023, 71 (09): : 596 - 606
  • [25] Collaborative Experience Prototyping of Automotive Interior in VR with 3D Sketching and Haptic Helpers
    An, Sang-Gyun
    Kim, Yongkwan
    Lee, Joon Hyub
    Bae, Seok-Hyung
    AUTOMOTIVEUI 2017: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON AUTOMOTIVE USER INTERFACES AND INTERACTIVE VEHICULAR APPLICATIONS, 2017, : 183 - 192
  • [26] Evaluation of haptic virtual reality user interfaces for medical marking on 3D models
    Li, Zhenxing
    Kiiveri, Maria
    Rantala, Jussi
    Raisamo, Roope
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2021, 147
  • [27] Fast Continuous Measurement of HRTFs with Unconstrained Head Movements for 3D Audio
    He, Jianjun
    Ranjan, Rishabh
    Gan, Woon-Seng
    Chaudhary, Nitesh Kumar
    Nguyen Duy Hai
    Gupta, Rishabh
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2018, 66 (11): : 884 - 900
  • [28] Learning to Detect 3D Facial Landmarks via Heatmap Regression with Graph Convolutional Network
    Wang, Yuan
    Cao, Min
    Fan, Zhenfeng
    Peng, Silong
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2595 - 2603
  • [29] Faster acquisition of laparoscopic skills in virtual reality with haptic feedback and 3D vision
    Hagelsteen, Kristine
    Langegard, Anders
    Lantz, Adam
    Ekelund, Mikael
    Anderberg, Magnus
    Bergenfelz, Anders
    MINIMALLY INVASIVE THERAPY & ALLIED TECHNOLOGIES, 2017, 26 (05) : 269 - 277
  • [30] Effect of 2D/3D Visual and Haptic Cues for Fine Operation Tasks With Varying Difficulties
    Hou, Zhenghang
    He, Weiping
    Wang, Shuxia
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2025, 41 (05) : 3004 - 3013