Cloud-based intelligent self-diagnosis and department recommendation service using Chinese medical BERT

被引:26
作者
Wang, Junshu [1 ]
Zhang, Guoming [2 ,3 ]
Wang, Wei [4 ]
Zhang, Ka [1 ]
Sheng, Yehua [1 ,5 ]
机构
[1] Nanjing Normal Univ, Minist Educ, Key Lab Virtual Geog Environm, Nanjing 210008, Peoples R China
[2] Nanjing Univ, Dept Comp Sci & Technol, Nanjing 210023, Peoples R China
[3] Hlth Stat & Informat Ctr Jiangsu Prov, Nanjing 210008, Peoples R China
[4] Tencent Technol Shenzhen Co Ltd, Shenzhen 518100, Peoples R China
[5] Jiangsu Ctr Collaborat Innovat Geog Informat Reso, Nanjing 210023, Peoples R China
来源
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS | 2021年 / 10卷 / 01期
基金
中国国家自然科学基金;
关键词
Cloud computing; Electronic medical record; BERT; Disease diagnosis; PRIVACY-PRESERVATION; PLACEMENT;
D O I
10.1186/s13677-020-00218-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of hospital informatization and Internet medical service in recent years, most hospitals have launched online hospital appointment registration systems to remove patient queues and improve the efficiency of medical services. However, most of the patients lack professional medical knowledge and have no idea of how to choose department when registering. To instruct the patients to seek medical care and register effectively, we proposed CIDRS, an intelligent self-diagnosis and department recommendation framework based on Chinese medical Bidirectional Encoder Representations from Transformers (BERT) in the cloud computing environment. We also established a Chinese BERT model (CHMBERT) trained on a large-scale Chinese medical text corpus. This model was used to optimize self-diagnosis and department recommendation tasks. To solve the limited computing power of terminals, we deployed the proposed framework in a cloud computing environment based on container and micro-service technologies. Real-world medical datasets from hospitals were used in the experiments, and results showed that the proposed model was superior to the traditional deep learning models and other pre-trained language models in terms of performance.
引用
收藏
页数:12
相关论文
共 43 条
[1]  
Beltagy I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P3615
[2]   A disease diagnosis and treatment recommendation system based on big data mining and cloud computing [J].
Chen, Jianguo ;
Li, Kenli ;
Rong, Huigui ;
Bilal, Kashif ;
Yang, Nan ;
Li, Keqin .
INFORMATION SCIENCES, 2018, 435 :124-149
[3]  
Cui Y., 2019, Reinforcement Learning Ship Autopilot: Sample-efficient and Model Predictive Control-based Approach
[4]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[5]  
Ifrim G., 2008, Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, P354, DOI DOI 10.1145/1401890.1401936
[6]  
Joachims T., 1998, EUROPEAN C MACHINE L, P137, DOI DOI 10.1007/S13928716
[7]   Deep Pyramid Convolutional Neural Networks for Text Categorization [J].
Johnson, Rie ;
Zhang, Tong .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :562-570
[8]  
Kim Y, 2014, arXiv, P1746
[9]  
Lai SW, 2015, AAAI CONF ARTIF INTE, P2267
[10]   BioBERT: a pre-trained biomedical language representation model for biomedical text mining [J].
Lee, Jinhyuk ;
Yoon, Wonjin ;
Kim, Sungdong ;
Kim, Donghyeon ;
Kim, Sunkyu ;
So, Chan Ho ;
Kang, Jaewoo .
BIOINFORMATICS, 2020, 36 (04) :1234-1240