Speech enabled Integrated AR-based Multimodal Language Translation

被引:0
|
作者
Bhargava, Mahesh [1 ]
Dhote, Pavan [1 ]
Srivastava, Amit [1 ]
Kumar, Ajai [1 ]
机构
[1] Ctr Dev Adv Comp C DAC, AAI, Pune, Maharashtra, India
来源
2016 CONFERENCE ON ADVANCES IN SIGNAL PROCESSING (CASP) | 2016年
关键词
Augmented Reality; visual data translation Optical Character Recognition (OCR) and speech synthesis;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With rapidly increasing smartphone user base in the country, many opportunities revolving the same can be explored. India being a multilingual nation, domestic/international tourist needs several language solutions on their fingertips. Applications such as instant language translation, maps, travel assistance, routes, restaurants, banks etc. have become a necessity on smartphones in the current scenario. We present a speech enabled augmented reality (AR) smartphones application for Hindi to English translation and vice-versa. With application interface user can move their smartphone over the word, phrase, billboard, signboard, hoarding, milestone etc. to get translated text. Using augmented reality technology the translated text seamlessly overlay [1] to the original text in real time video stream. This is achieved by critical mix of underlying technologies such as augmented reality, Optical Character Recognition (OCR), translation of visual data and speech synthesis. User will be able to effectively engage, communicate and access information originally available in native language.
引用
收藏
页码:226 / 230
页数:5
相关论文
共 50 条
  • [31] A Novel AR-based Interactive E-Learning Platform
    Chang, Rong-Chi
    MEMS, NANO AND SMART SYSTEMS, PTS 1-6, 2012, 403-408 : 1244 - 1248
  • [32] AR-based Taxi Recommendation by Leveraging Crowd Sharing Comments
    Chen, Yan Ting
    Ho, Yu
    Yan, Yi Xiang
    Chen, Hsi-Min
    2018 15TH INTERNATIONAL SYMPOSIUM ON PERVASIVE SYSTEMS, ALGORITHMS AND NETWORKS (I-SPAN 2018), 2018, : 337 - 339
  • [33] AR-based Virtual Musical Instruments using SMC Tracking
    Olivieri, David
    Gomez Conde, Ivan
    Anton Vila-Sobrino, Xose
    SISTEMAS E TECNOLOGIAS DE INFORMACAO, VOL I, 2011, : 664 - +
  • [34] Toward Mobile AR-Based Interactive Smart Parking System
    Al-Jabi, Muhannad
    Sammaneh, Haya
    IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 1243 - 1247
  • [35] Personalizing an AR-based Communication System for Nonspeaking Autistic Users
    Nazari, Ahmadreza
    Alabood, Lorans
    Feeley, Kaylyn B.
    Jaswal, Vikram K.
    Krishnamurthy, Diwakar
    PROCEEDINGS OF 2024 29TH ANNUAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2024, 2024, : 731 - 741
  • [36] AR-based interaction for human-robot collaborative manufacturing
    Hietanen, Antti
    Latokartano, Jyrki
    Pieters, Roel
    Lanz, Minna
    Kamarainen, Joni-Kristian
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2020, 63
  • [37] Comparative Performance Characterization of Mobile AR Frameworks in the Context of AR-Based Grocery Shopping Applications
    Lee, Juhwan
    Hwang, Sangwon
    Lee, Jisun
    Kang, Seungwoo
    APPLIED SCIENCES-BASEL, 2020, 10 (04):
  • [38] Mime: An AR-based System Helping Patients to Test their Blood at Home
    Djajadiningrat, Tom
    Chao, Pei-Yin
    Kim, SeYoung
    van Leengoed, Marleen
    Raijmakers, Jeroen
    DIS 2016: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON DESIGNING INTERACTIVE SYSTEMS, 2016, : 347 - 359
  • [39] A Development of Visualization Technology through AR-Based Design Checklist Connection
    Park, Hyejin
    Choo, Seungyeon
    APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [40] AR-Based Visual Aids for sUAS Operations in Security Sensitive Areas
    Avanzini, Giulio
    De Luca, Valerio
    Pascarelli, Claudio
    AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2020, PT I, 2020, 12242 : 289 - 298