TOM: A Development Platform For Wearable Intelligent Assistants

被引：6

作者：

Janaka, Nuwan ^{[1
,2
]}

Zhao, Shengdong ^{[3
,4
]}

Hsu, David ^{[1
,5
]}

Wen, Sherisse Tan Jing ^{[5
]}

Koh, Chun Keat ^{[1
]}

机构：

[1] Natl Univ Singapore, Smart Syst Inst, Singapore, Singapore

[2] Synteract Lab, Singapore, Singapore

[3] City Univ Hong Kong, Sch Creat Media, Hong Kong, Peoples R China

[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China

[5] Natl Univ Singapore, Sch Comp, Singapore, Singapore

来源：

COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024 | 2024年

基金：

新加坡国家研究基金会;

关键词：

context-aware system; wearable; AI assistance; smart glasses; HMD; interactions; augmented reality; AR; MR; XR; AI/ML;

D O I：

10.1145/3675094.3678382

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Advanced wearable digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, developing these assistants presents several challenges. To address this, we introduce TOM (The Other Me), a conceptual architecture and open-source software platform (https://github.com/TOM-Platform) that supports the development of wearable intelligent assistants that are contextually aware of both the user and the environment. Collaboratively developed with researchers and developers, TOM meets their diverse requirements. TOM facilitates the creation of intelligent assistive AR applications for daily activities, supports the recording and analysis of user interactions, and provides assistance for various activities, as demonstrated in our preliminary evaluations.

引用

页码：837 / 843

页数：7

共 33 条

[1] Performer vs. Observer: Whose Comfort Level Should We Consider when Examining the Social Acceptability of Input Modalities for Head-Worn Display? [J].

Alallah, Fouad ;

Neshati, Ali ;

Sakamoto, Yumiko ;

Hasan, Khalad ;

Lank, Edward ;

Bunt, Andrea ;

Irani, Pourang .

24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018), 2018,

[2] Guidelines for Human-AI Interaction [J].

Amershi, Saleema ;

Weld, Dan ;

Vorvoreanu, Mihaela ;

Fourney, Adam ;

Nushi, Besmira ;

Collisson, Penny ;

Suh, Jina ;

Iqbal, Shamsi ;

Bennett, Paul N. ;

Inkpen, Kori ;

Teevan, Jaime ;

Kikin-Gil, Ruth ;

Horvitz, Eric .

CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,

[3]

Anderson Christoph, 2018, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, V2, DOI [10.1145/3214261, 10.1145/3214261]

[4] Developing Mixed Reality Applications with Platform for Situated Intelligence [J].

Andrist, Sean ;

Bohus, Dan ;

Feniello, Ashley ;

Saw, Nick .

2022 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2022), 2022, :48-50

[5]

[Anonymous], 2024, Ai Pin Overview

[6] Systematic review on the effectiveness of augmented reality applications in medical training [J].

Barsom, E. Z. ;

Graafland, M. ;

Schijven, M. P. .

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2016, 30 (10) :4174-4183

[7] A survey of augmented reality [J].

Billinghurst, Mark ;

Clark, Adrian ;

Lee, Gun .

Foundations and Trends in Human-Computer Interaction, 2014, 8 (2-3) :73-272

[8]

Bohus D, 2024, Arxiv, DOI arXiv:2405.13035

[9]

Bohus Dan., Platform for situated intelligence

[10]

Carroll John M., 2022, ACM Interactions, V29, P73, DOI [10.1145/3538392, 10.1145/3538392]

← 1 2 3 4 →