Mobile Augmented Reality for Providing Perception of Materials

被引：5
作者：
Nomura, Ryota [1 ]
Yamamoto, Shoji [2 ]
Unuma, Yuko [1 ]
Tsumura, Norimichi [3 ]
Komuro, Takashi [1 ]
机构：
[1] Saitama Univ, Sakura Ku, 255 Shimo Okubo, Saitama 3388570, Japan
[2] Tokyo Metropolitan Coll Ind Technol, Arakawa Ku, 17-1 Minamisenju 8 Chome, Tokyo 1168523, Japan
[3] Chiba Univ, Inage Ku, 1-33 Yayoi Cho, Chiba 2638522, Japan
来源：
16TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS MULTIMEDIA (MUM 2017) | 2017年
关键词：
Material appearance; visual and somatic sensation; object manipulation; mobile device; depth camera;
D O I：
10.1145/3152832.3157810
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this paper, we propose an AR system using a mobile display that allows the user to manipulate a virtual object using the user's own hand to provide the user with perception of materials. To realize more natural interaction with a virtual object, our proposed system provides visual information that is consistent with the user's somatic sensation by displaying user-perspective images on the mobile display. The system allows the user to manipulate the virtual object with six degrees of freedom (three degrees of freedom for translation and three degrees of freedom for rotation) by mapping the hand pose to the object's translation and rotation. Material appearance of objects is presented by rendering the virtual object using Unity 3D. We showed the effectiveness of our proposed system by showing how the user manipulates the virtual object and obtains the gloss and burnish of the object using the proposed system.
引用
收藏
页码：501 / 506
页数：6
相关论文
共 13 条
  • [1] Andersen D, 2016, ADJUNCT PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), P96, DOI [10.1109/ISMAR-Adjunct.2016.42, 10.1109/ISMAR-Adjunct.2016.0049]
  • [2] [Anonymous], 2014, ACM T GRAPHICS
  • [3] Csongei M, 2012, INT SYM MIX AUGMENT, P277, DOI 10.1109/ISMAR.2012.6402572
  • [4] Darling Benjamin A, 2010, P SPIE HUM VIS EL IM
  • [5] Linear light source reflectometry
    Gardner, A
    Tchou, C
    Hawkins, T
    Debevec, P
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03): : 749 - 758
  • [6] Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality
    Hettiarachchi, Anuruddha
    Wigdor, Daniel
    [J]. 34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, : 1957 - 1967
  • [7] A Coaxial Optical Scanner for Synchronous Acquisition of 3D Geometry and Surface Reflectance
    Holroyd, Michael
    Lawrence, Jason
    Zickler, Todd
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04):
  • [8] Okazaki Tomoya, 2010, Information and Media Technologies, V5, P691
  • [9] Tomioka M, 2013, INT SYM MIX AUGMENT, P21, DOI 10.1109/ISMAR.2013.6671760
  • [10] Natural 3D Interaction using a See-through Mobile AR System
    Unuma, Yuko
    Komuro, Takashi
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, 2015, : 84 - 87
12