Development of a Decision Support System for Selection of Reviewers to Evaluate Research and Development Projects

被引:2
作者
Kocak, Serdar [1 ]
Ic, Yusuf Tansel [2 ]
Sert, Mustafa [3 ]
Atalay, Kumru Didem [2 ]
Dengiz, Berna [2 ]
机构
[1] Sci & Technol Res Council Turkey, TR-06100 Ankara, Turkey
[2] Baskent Univ, Dept Ind Engn, TR-06790 Ankara, Turkey
[3] Baskent Univ, Dept Comp Engn, TR-06790 Ankara, Turkey
关键词
Reviewer selection; hesitant fuzzy sets; natural language processing (NLP); convolutional neural network (CNN); HYBRID KNOWLEDGE; TOPSIS; PROPOSALS; DESIGN;
D O I
10.1142/S0219622022500961
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The evaluation of Research and Development (R&D) projects consists of many steps depending on the government funding agencies and the support program. It is observed that the reviewer evaluation reports have a crucial impact on the support decisions of the projects. In this study, a decision support system (DSS), namely R&D Reviewer, is developed to help the decision-makers with the assignment of the appropriate reviewer to R&D project proposals. It is aimed to create an artificial intelligence-based decision support system that enables the classification of Turkish R&D projects with natural language processing (NLP) methods. Furthermore, we examine the reviewer ranking process by using fuzzy multi-criteria decision-making methods. The data in the database is processed primarily to classify the R&D projects and the word embedding model NLP, "Word2Vec". Also, we designed the Convolutional Neural Network (CNN) model to select the features by using the automatic feature learning approach. Moreover, we incorporate a new integrated hesitant fuzzy VIKOR and TOPSIS methodology into the developed DSS for the reviewer ranking process.
引用
收藏
页码:1991 / 2020
页数:30
相关论文
共 61 条
[1]  
Alinezhad A., 2011, J. Optim. Ind. Eng, V7, P23
[2]  
[Anonymous], 1978, Decision support systems
[3]  
an organizational perspective
[4]  
Arunachalam N., 2013, International Journal of Computer Science & Information Technology, V5, P161, DOI 10.5121/ijcsit.2013.5113
[5]   Ordinal Priority Approach (OPA) in Multiple Attribute Decision-Making [J].
Ataei, Younes ;
Mahmoudi, Amin ;
Feylizadeh, Mohammad Reza ;
Li, Deng-Feng .
APPLIED SOFT COMPUTING, 2020, 86
[6]   Methodical Aspects of MCDM Based E-Commerce Recommender System [J].
Baczkiewicz, Aleksandra ;
Kizielewicz, Bartlomiej ;
Shekhovtsov, Andrii ;
Watrobski, Jaroslaw ;
Salabun, Wojciech .
JOURNAL OF THEORETICAL AND APPLIED ELECTRONIC COMMERCE RESEARCH, 2021, 16 (06) :2192-2229
[7]   The impact of China's R&D subsidies on R&D investment, technological upgrading and economic growth [J].
Boeing, Philipp ;
Eberle, Jonathan ;
Howell, Anthony .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2022, 174
[8]  
Chandre P., 2014, INT J EMERG TECHNOL, P511
[9]  
Choi C., 2006, INT J TECHNOL INTELL, P61, DOI [10.1504/IJTIP.2006.010510, DOI 10.1504/IJTIP.2006.010510]
[10]   Optimal allocation of proposals to reviewers to facilitate effective ranking [J].
Cook, WD ;
Golany, B ;
Kress, M ;
Penn, M ;
Raviv, T .
MANAGEMENT SCIENCE, 2005, 51 (04) :655-661