Dark-Side Avoidance of Mobile Applications With Data Biases Elimination in Socio-Cyber World

被引:8
作者
Ma, Ying [1 ,2 ]
Yu, Chuyi [2 ]
Yan, Ming [3 ]
Sangaiah, Arun Kumar [4 ,5 ]
Wu, Youke [6 ]
机构
[1] Harbin Inst Technol, Fac Comp, Harbin 150006, Peoples R China
[2] Xiamen Univ Technol, Dept Comp & Informat Technol, Xiamen 361024, Peoples R China
[3] Agcy Sci Technol & Res, Inst High Performance Comp, Singapore, Singapore
[4] Natl Yunlin Univ Sci & Technol, Int Grad Inst AI, Touliu 454000, Taiwan
[5] Lebanese Amer Univ, Dept Elect & Comp Engn, Byblos 11022801, Lebanon
[6] Wuyi Univ, Dept Econ & Management, Jiangmen 529020, Peoples R China
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2024年 / 11卷 / 04期
基金
中国国家自然科学基金;
关键词
Accessibility; dark side; image-based icon label; mobile applications; socio-cyber world;
D O I
10.1109/TCSS.2023.3264696
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The accessibility of mobile apps takes into account the rights and interests of various social groups, which is vital for the millions of smartphone users who are visually impaired given the variety of mobile applications available on Google Play and the App Store. Most application icons, however, lack natural language labels. It is challenging for these users to engage with mobile phones utilizing screen readers featured in mobile operating systems. Millions of visually impaired smartphone Internet users' inability to communicate with mobile applications have become the socio-cyber world's dark side. COALA is a pilot work that solves this issue by generating the textual label from the imaging icon automatically. However, most icon datasets have imbalance distributions in the real-world scenario that only a few categories have rich-resource labeled samples, and the major rest categories have very limited samples. To address the data imbalance problem in the icon label generation task, we provide an interconnected two-stream language model with mean teacher learning, which learns a generalized feature representation from divergent data distributions. Extensive experiments demonstrate the superiority of our two-stream language model over previous single-language models on different low-resource datasets. More experimental results reveal that our method outperforms the COALA model by a wide margin in decreasing the dark side of the socio-cyber world.
引用
收藏
页码:4955 / 4964
页数:10
相关论文
共 44 条
  • [21] Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
    Krishna, Ranjay
    Zhu, Yuke
    Groth, Oliver
    Johnson, Justin
    Hata, Kenji
    Kravitz, Joshua
    Chen, Stephanie
    Kalantidis, Yannis
    Li, Li-Jia
    Shamma, David A.
    Bernstein, Michael S.
    Li Fei-Fei
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 123 (01) : 32 - 73
  • [22] Lavie A., 2007, P 2 WORKSHOP STAT MA, P228
  • [23] Leporini B., 2012, P 24 AUSTR COMP HUM, P339, DOI DOI 10.1145/2414536.2414591
  • [24] Lin C. -Y., 2004, Text summarization branches out, P74
  • [25] Liu G., 2011, Proc. 25th AAAI Conf. Artificial Intell, P1222
  • [26] Liu GF, 2015, PROC INT CONF DATA, P351, DOI 10.1109/ICDE.2015.7113297
  • [27] Finding the Optimal Social Trust Path for the Selection of Trustworthy Service Providers in Complex Social Networks
    Liu, Guanfeng
    Wang, Yan
    Orgun, Mehmet A.
    Lim, Ee-Peng
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2013, 6 (02) : 152 - 167
  • [28] Liu W., 2021, arXiv
  • [29] Data-Driven Accessibility Repair Revisited: On the Effectiveness of Generating Labels for Icons in Android Apps
    Mehralian, Forough
    Salehnamadi, Navid
    Malek, Sam
    [J]. PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21), 2021, : 107 - 118
  • [30] Pan YW, 2020, PROC CVPR IEEE, P10968, DOI 10.1109/CVPR42600.2020.01098