Multi-view representation learning for tabular data integration using inter-feature relationships

被引:2
作者
Tripathi, Sandhya [1 ]
Fritz, Bradley A. [1 ]
Abdelhack, Mohamed [3 ]
Avidan, Michael S. [1 ]
Chen, Yixin [2 ]
King, Christopher R. [1 ]
机构
[1] Washington Univ, Dept Anesthesiol, St Louis, MO 63110 USA
[2] Washington Univ, Dept Comp Sci & Engn, St Louis, MO USA
[3] Ctr Addict & Mental Hlth, Krembil Ctr Neuroinformat, Toronto, ON, Canada
关键词
Schema matching; Electronic health records; Contrastive learning; Fingerprints; Partial autoencoders;
D O I
10.1016/j.jbi.2024.104602
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Objective: An applied problem facing all areas of data science is harmonizing data sources. Joining data from multiple origins with unmapped and only partially overlapping features is a prerequisite to developing and testing robust, generalizable algorithms, especially in healthcare. This integrating is usually resolved using meta -data such as feature names, which may be unavailable or ambiguous. Our goal is to design methods that create a mapping between structured tabular datasets derived from electronic health records independent of meta -data. Methods: We evaluate methods in the challenging case of numeric features without reliable and distinctive univariate summaries, such as nearly Gaussian and binary features. We assume that a small set of features are a priori mapped between two datasets, which share unknown identical features and possibly many unrelated features. Inter -feature relationships are the main source of identification which we expect. We compare the performance of contrastive learning methods for feature representations, novel partial auto -encoders, mutualinformation graph optimizers, and simple statistical baselines on simulated data, public datasets, the MIMIC -III medical -record changeover, and perioperative records from before and after a medical -record system change. Performance was evaluated using both mapping of identical features and reconstruction accuracy of examples in the format of the other dataset. Results: Contrastive learning -based methods overall performed the best, often substantially beating the literature baseline in matching and reconstruction, especially in the more challenging real data experiments. Partial auto -encoder methods showed on -par matching with contrastive methods in all synthetic and some real datasets, along with good reconstruction. However, the statistical method we created performed reasonably well in many cases, with much less dependence on hyperparameter tuning. When validating feature match output in the EHR dataset we found that some mistakes were actually a surrogate or related feature as reviewed by two subject matter experts. Conclusion: In simulation studies and real -world examples, we find that inter -feature relationships are effective at identifying matching or closely related features across tabular datasets when meta -data is not available. Decoder architectures are also reasonably effective at imputing features without an exact match.
引用
收藏
页数:12
相关论文
共 26 条
  • [21] Generation-based Multi-view Contrast for Self-supervised Graph Representation Learning
    Han, Yuehui
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (05)
  • [22] Contrastive Learning Based Multi-view Feature Fusion Model for Aspect-Based Sentiment Analysis
    Wu, Xing
    Xia, Hongbin
    Liu, Yuan
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (10): : 910 - 922
  • [23] RFMC-CS: a representation fusion based multi-view momentum contrastive learning framework for code search
    Chen, Gong
    Liu, Wenjie
    Xie, Xiaoyuan
    AUTOMATED SOFTWARE ENGINEERING, 2025, 32 (01)
  • [24] MVCLST: A spatial transcriptome data analysis pipeline for cell type classification based on multi-view comparative learning
    Peng, Wei
    Zhang, Zhihao
    Dai, Wei
    Ping, Zhihao
    Fu, Xiaodong
    Liu, Li
    Liu, Lijun
    Yu, Ning
    METHODS, 2024, 232 : 115 - 128
  • [25] Inferring gene regulatory networks from single-cell gene expression data via deep multi-view contrastive learning
    Lin, Zerun
    Le Ou-Yang
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (01)
  • [26] GeoViewMatch: A Multi-Scale Feature-Matching Network for Cross-View Geo-Localization Using Swin-Transformer and Contrastive Learning
    Zhang, Wenhui
    Zhong, Zhinong
    Chen, Hao
    Jing, Ning
    REMOTE SENSING, 2024, 16 (04)