Dark-Side Avoidance of Mobile Applications With Data Biases Elimination in Socio-Cyber World

被引:8
作者
Ma, Ying [1 ,2 ]
Yu, Chuyi [2 ]
Yan, Ming [3 ]
Sangaiah, Arun Kumar [4 ,5 ]
Wu, Youke [6 ]
机构
[1] Harbin Inst Technol, Fac Comp, Harbin 150006, Peoples R China
[2] Xiamen Univ Technol, Dept Comp & Informat Technol, Xiamen 361024, Peoples R China
[3] Agcy Sci Technol & Res, Inst High Performance Comp, Singapore, Singapore
[4] Natl Yunlin Univ Sci & Technol, Int Grad Inst AI, Touliu 454000, Taiwan
[5] Lebanese Amer Univ, Dept Elect & Comp Engn, Byblos 11022801, Lebanon
[6] Wuyi Univ, Dept Econ & Management, Jiangmen 529020, Peoples R China
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2024年 / 11卷 / 04期
基金
中国国家自然科学基金;
关键词
Accessibility; dark side; image-based icon label; mobile applications; socio-cyber world;
D O I
10.1109/TCSS.2023.3264696
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The accessibility of mobile apps takes into account the rights and interests of various social groups, which is vital for the millions of smartphone users who are visually impaired given the variety of mobile applications available on Google Play and the App Store. Most application icons, however, lack natural language labels. It is challenging for these users to engage with mobile phones utilizing screen readers featured in mobile operating systems. Millions of visually impaired smartphone Internet users' inability to communicate with mobile applications have become the socio-cyber world's dark side. COALA is a pilot work that solves this issue by generating the textual label from the imaging icon automatically. However, most icon datasets have imbalance distributions in the real-world scenario that only a few categories have rich-resource labeled samples, and the major rest categories have very limited samples. To address the data imbalance problem in the icon label generation task, we provide an interconnected two-stream language model with mean teacher learning, which learns a generalized feature representation from divergent data distributions. Extensive experiments demonstrate the superiority of our two-stream language model over previous single-language models on different low-resource datasets. More experimental results reveal that our method outperforms the COALA model by a wide margin in decreasing the dark side of the socio-cyber world.
引用
收藏
页码:4955 / 4964
页数:10
相关论文
共 44 条
  • [1] Accessibility Issues in Android Apps: State of Affairs, Sentiments, and Ways Forward
    Alshayban, Abdulaziz
    Ahmed, Iftekhar
    Malek, Sam
    [J]. 2020 ACM/IEEE 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2020), 2020, : 1323 - 1334
  • [2] [Anonymous], 2022, ANDR ACC TEST FRAM
  • [3] [Anonymous], About Us
  • [4] [Anonymous], 2022, ESPR ANDR DEV
  • [5] [Anonymous], 2022, ACC SCANN
  • [6] CaMEL: Mean Teacher Learning for Image Captioning
    Barraco, Manuele
    Stefanini, Matteo
    Cornia, Marcella
    Cascianelli, Silvia
    Baraldi, Lorenzo
    Cucchiara, Rita
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4087 - 4094
  • [7] Android: Changing the Mobile Landscape
    Butler, Margaret
    [J]. IEEE PERVASIVE COMPUTING, 2011, 10 (01) : 4 - 7
  • [8] Emerging Properties in Self-Supervised Vision Transformers
    Caron, Mathilde
    Touvron, Hugo
    Misra, Ishan
    Jegou, Herve
    Mairal, Julien
    Bojanowski, Piotr
    Joulin, Armand
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9630 - 9640
  • [9] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
    Chen, Jieshan
    Chen, Chunyang
    Xing, Zhenchang
    Xu, Xiwei
    Zhu, Liming
    Li, Guoqiang
    Wang, Jinshui
    [J]. 2020 ACM/IEEE 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2020), 2020, : 322 - 334
  • [10] Explaining transformer-based image captioning models: An empirical analysis
    Cornia, Marcella
    Baraldi, Lorenzo
    Cucchiara, Rita
    [J]. AI COMMUNICATIONS, 2022, 35 (02) : 111 - 129