Multimodal Data Fusion and Deep Learning for Occupant-Centric Indoor Environmental Quality Classification

被引:0
作者
Lee, Min Jae [1 ]
Zhang, Ruichuan [1 ]
机构
[1] Virginia Polytech Inst & State Univ, Myers Lawson Sch Construction, Blacksburg, VA 24061 USA
关键词
Indoor environmental quality (IEQ); Multimodal data fusion; Deep learning; Occupant comfort and health; Transformer; IMPROVED EFFICIENCY; FEEDBACK; HEALTH; IMPACT; IEQ;
D O I
10.1061/JCCEE5.CPENG-6249
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Amidst the growing recognition of the impact of indoor environmental conditions on buildings and occupant comfort, health, and well-being, there has been an increasing focus on the assessment and modeling of indoor environmental quality (IEQ). Despite considerable advancements, existing IEQ modeling methodologies often prioritize and limit to singular comfort metrics, potentially neglecting the comprehensive factors associated with occupant comfort and health. There is a need for more inclusive and occupant-centric IEQ assessment models that cover a broader spectrum of environmental parameters and occupant needs. Such models require integrating diverse environmental and occupant data, facing challenges in leveraging data across various modalities and time scales as well as understanding the temporal patterns, relationships, and trends. This paper proposes a novel framework for classifying IEQ conditions based on occupant self-reported comfort and health levels to address these challenges. The proposed framework leverages a multimodal data-fusion approach with Transformer-based models, aiming to accurately predict indoor comfort and health levels by integrating diverse data sources, including multidimensional IEQ data and multimodal occupant feedback. The framework was evaluated in classifying IEQ conditions of selected public indoor spaces and achieved 97% and 96% accuracy in comfort and health-based classifications, outperforming several baselines.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] EmbraceNet: A robust deep learning architecture for multimodal classification
    Choi, Jun-Ho
    Lee, Jong-Seok
    INFORMATION FUSION, 2019, 51 : 259 - 270
  • [22] A Hybrid Deep Learning Emotion Classification System Using Multimodal Data
    Kim, Dong-Hwi
    Son, Woo-Hyeok
    Kwak, Sung-Shin
    Yun, Tae-Hyeon
    Park, Ji-Hyeok
    Lee, Jae-Dong
    SENSORS, 2023, 23 (23)
  • [23] Interactions and comprehensive effect of indoor environmental quality factors on occupant satisfaction
    Tang, Hao
    Ding, Yong
    Singer, Brett
    BUILDING AND ENVIRONMENT, 2020, 167 (167)
  • [24] Multimodal data fusion enhanced deep learning prediction of crack path segmentation in CFRP composites
    Zhang, Peng
    Tang, Keke
    Chen, Guangxu
    Li, Jiangfeng
    Li, Yan
    COMPOSITES SCIENCE AND TECHNOLOGY, 2024, 257
  • [25] Data collection and quality challenges in deep learning: a data-centric AI perspective
    Whang, Steven Euijong
    Roh, Yuji
    Song, Hwanjun
    Lee, Jae-Gil
    VLDB JOURNAL, 2023, 32 (04) : 791 - 813
  • [26] Data collection and quality challenges in deep learning: a data-centric AI perspective
    Steven Euijong Whang
    Yuji Roh
    Hwanjun Song
    Jae-Gil Lee
    The VLDB Journal, 2023, 32 : 791 - 813
  • [27] Design and application of occupant voting systems for collecting occupant feedback on indoor environmental quality of buildings - A review
    Khan, Donya Sheikh
    Kolarik, Jakub
    Weitzmann, Peter
    BUILDING AND ENVIRONMENT, 2020, 183
  • [28] Advancing Building Assessment Tools: Achieving Sustainable Development Goals through the Fusion of Internet of Things Occupant-Centric Principles and Sustainable Practices
    Metwally, Esraa A.
    Ismail, Mostafa Refat
    Farid, Ayman A.
    BUILDINGS, 2024, 14 (06)
  • [29] Deep-Learning based Global and Semantic Feature Fusion for Indoor Scene Classification
    Pereira, Ricardo
    Goncalves, Nuno
    Garrote, Luis
    Barros, Tiago
    Lopes, Ana
    Nunes, Urbano J.
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, : 67 - 73
  • [30] Deep learning based multimodal biomedical data fusion: An overview and comparative review
    Duan, Junwei
    Xiong, Jiaqi
    Li, Yinghui
    Ding, Weiping
    INFORMATION FUSION, 2024, 112