Multimodal Data Fusion and Deep Learning for Occupant-Centric Indoor Environmental Quality Classification

被引:0
作者
Lee, Min Jae [1 ]
Zhang, Ruichuan [1 ]
机构
[1] Virginia Polytech Inst & State Univ, Myers Lawson Sch Construction, Blacksburg, VA 24061 USA
关键词
Indoor environmental quality (IEQ); Multimodal data fusion; Deep learning; Occupant comfort and health; Transformer; IMPROVED EFFICIENCY; FEEDBACK; HEALTH; IMPACT; IEQ;
D O I
10.1061/JCCEE5.CPENG-6249
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Amidst the growing recognition of the impact of indoor environmental conditions on buildings and occupant comfort, health, and well-being, there has been an increasing focus on the assessment and modeling of indoor environmental quality (IEQ). Despite considerable advancements, existing IEQ modeling methodologies often prioritize and limit to singular comfort metrics, potentially neglecting the comprehensive factors associated with occupant comfort and health. There is a need for more inclusive and occupant-centric IEQ assessment models that cover a broader spectrum of environmental parameters and occupant needs. Such models require integrating diverse environmental and occupant data, facing challenges in leveraging data across various modalities and time scales as well as understanding the temporal patterns, relationships, and trends. This paper proposes a novel framework for classifying IEQ conditions based on occupant self-reported comfort and health levels to address these challenges. The proposed framework leverages a multimodal data-fusion approach with Transformer-based models, aiming to accurately predict indoor comfort and health levels by integrating diverse data sources, including multidimensional IEQ data and multimodal occupant feedback. The framework was evaluated in classifying IEQ conditions of selected public indoor spaces and achieved 97% and 96% accuracy in comfort and health-based classifications, outperforming several baselines.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Deep-Learning based Global and Semantic Feature Fusion for Indoor Scene Classification
    Pereira, Ricardo
    Goncalves, Nuno
    Garrote, Luis
    Barros, Tiago
    Lopes, Ana
    Nunes, Urbano J.
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, : 67 - 73
  • [32] Deep Learning for HABs Prediction with Multimodal Fusion
    Zhao, Fei
    Zhang, Chengcui
    31ST ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2023, 2023, : 17 - 18
  • [33] Indoor Air Quality Analysis Using Deep Learning with Sensor Data
    Ahn, Jaehyun
    Shin, Dongil
    Kim, Kyuho
    Yang, Jihoon
    SENSORS, 2017, 17 (11)
  • [34] Establishment and Optimization of the Early Warning System for Student Academy:multimodal data fusion based on deep learning
    Guan, Chunhua
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (06) : 399 - 404
  • [35] A Multi-label Multimodal Deep Learning Framework for Imbalanced Data Classification
    Pouyanfar, Samira
    Wang, Tianyi
    Chen, Shu-Ching
    2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 199 - 204
  • [36] Comparative Analysis of Deep Learning Models for Breast Cancer Classification on Multimodal Data
    Hussain, Sadam
    Ali, Mansoor
    Ali Pirzado, Farman
    Ahmed, Masroor
    Gerardo Tamez-Pena, Jose
    PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON VISION-LANGUAGE MODELS FOR BIOMEDICAL APPLICATIONS, VLM4BIO 2024, 2024, : 31 - 39
  • [37] Design process for an occupant survey system to assess satisfaction with indoor environmental quality
    Castro, Luiza
    De Vecchi, Renata
    Lamberts, Roberto
    BUILDING RESEARCH AND INFORMATION, 2025, 53 (1-2) : 242 - 260
  • [38] A method to conduct longitudinal studies on indoor environmental quality and perceived occupant comfort
    Berquist, Justin
    Ouf, Mohamed M.
    O'Brien, William
    BUILDING AND ENVIRONMENT, 2019, 150 : 88 - 98
  • [39] Deep learning decision fusion for the classification of urban remote sensing data
    Abdi, Ghasem
    Samadzadegan, Farhad
    Reinartz, Peter
    JOURNAL OF APPLIED REMOTE SENSING, 2018, 12 (01):
  • [40] Indoor environmental quality improvement in green building: Occupant perception and behavioral impact
    Oh, Jeongyoon
    Wong, Wingyin
    Castro-Lacouture, Daniel
    Lee, JeeHee
    Koo, Choongwan
    JOURNAL OF BUILDING ENGINEERING, 2023, 69