Don't Look Now: Audio/Haptic Guidance for 3D Scanning of Landmarks

被引:0
|
作者
Van Brummelen, Jessica [1 ]
Urwin, Liv Piper [2 ]
Johnston, Oliver James [1 ]
Sayed, Mohamed [1 ]
Brostow, Gabriel [2 ]
机构
[1] Niantic Inc, London, England
[2] UCL, Niant Inc, London, England
来源
PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024 | 2024年
关键词
3D scanning; mesh reconstruction accuracy; guidance; multimodal feedback; audio feedback; haptic feedback; visual feedback; AR; engagement; user safety; HEART-RATE; LOCALIZATION; COMPLEX;
D O I
10.1145/3613904.3642271
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People are increasingly using their smartphones to 3D scan objects and landmarks. On one hand, users have intrinsic motivations to scanwell, i.e. keeping the object in-frame while walking around it to achieve coverage. On the other, users can lose interest when filming inanimate objects, and feel rushed and uncertain of their progress when watching their step in public, seeking to avoid attention. We set out to guide users while reducing their stress and increasing engagement, by moving away from the on-screen feedback ubiquitous in existing products and apps meant for 3D scanning. Specifically, our novel interface gives users audio/haptic guidance while they scan statue-type landmarks in public. The interface results from a conceptual design process and a pilot study. Ultimately, we tested 50 users in an ultra-high-traffic area of central London. Compared to regular on-screen feedback, users were more engaged, had unchanged stress levels, and produced better scans.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Haptic and Visual feedback in 3D Audio Mixing Interfaces
    Gelineck, Steven
    Overholt, Dan
    PROCEEDINGS OF THE 10TH AUDIO MOSTLY: A CONFERENCE ON INTERACTION WITH SOUND, AM'15, 2015,
  • [2] Evaluation of haptic guidance virtual fixtures and 3D visualization methods in telemanipulation—a user study
    Kevin Huang
    Digesh Chitrakar
    Fredrik Rydén
    Howard Jay Chizeck
    Intelligent Service Robotics, 2019, 12 : 289 - 301
  • [3] Evaluation of haptic guidance virtual fixtures and 3D visualization methods in telemanipulation-a user study
    Huang, Kevin
    Chitrakar, Digesh
    Ryden, Fredrik
    Chizeck, Howard Jay
    INTELLIGENT SERVICE ROBOTICS, 2019, 12 (04) : 289 - 301
  • [4] The method for generating 3D audio content
    Wang, Heng
    Wu, Yafei
    Zhang, Cong
    Tu, Weiping
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2016, 31 (06) : 3203 - 3210
  • [5] CADLens: Haptic Feedback for Navigating in 3D Environments
    Haulrik, Nikolaj
    Petersen, Rasmus M.
    Merritt, Timothy
    DIS'17 COMPANION: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON DESIGNING INTERACTIVE SYSTEMS, 2017, : 127 - 131
  • [6] Haptic Manipulation of 3D Scans for Geometric Feature Enhancement
    Turlapati, Sri Harsha
    Accoto, Dino
    Campolo, Domenico
    SENSORS, 2021, 21 (08)
  • [7] 3D sound and 3D image interactions: a review of audio-visual depth perception
    Berry, Jonathan S.
    Roberts, David A. T.
    Holliman, Nicolas S.
    HUMAN VISION AND ELECTRONIC IMAGING XIX, 2014, 9014
  • [8] Visual SLAM Based on Rigid-Body 3D Landmarks
    Patricio Loncomilla
    Javier Ruiz del Solar
    Journal of Intelligent & Robotic Systems, 2012, 66 : 125 - 149
  • [9] Visual SLAM Based on Rigid-Body 3D Landmarks
    Loncomilla, Patricio
    Ruiz del Solar, Javier
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2012, 66 (1-2) : 125 - 149
  • [10] 3D human face description: landmarks measures and geometrical features
    Vezzetti, Enrico
    Marcolin, Federica
    IMAGE AND VISION COMPUTING, 2012, 30 (10) : 698 - 712