Investigation on the use of ensemble learning and big data in crop identification

被引:6
|
作者
Ahmed, Sayed [1 ]
Mahmoud, Amira S. [1 ]
Farg, Eslam [1 ]
Mohamed, Amany M. [1 ]
Moustafa, Marwa S. [1 ]
Abutaleb, Khaled [1 ]
Saleh, Ahmed M. [1 ]
AbdelRahman, Mohamed A. E. [1 ]
AbdelSalam, Hisham M. [2 ]
Arafat, Sayed M. [1 ]
机构
[1] Natl Author Remote Sensing & Space Sci NARSS, Cairo, Egypt
[2] Cairo Univ, Fac Comp & Artificial Intelligence, Giza, Egypt
关键词
Big data; Crop identification; Ensemble learning; DB Framework; Apache spark;
D O I
10.1016/j.heliyon.2023.e13339
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The agriculture sector in Egypt faces several problems, such as climate change, water storage, and yield variability. The comprehensive capabilities of Big Data (BD) can help in tackling the uncertainty of food supply occurs due to several factors such as soil erosion, water pollution, climate change, socio-cultural growth, governmental regulations, and market fluctuations. Crop identification and monitoring plays a vital role in modern agriculture. Although several machine learning models have been utilized in identifying crops, the performance of ensemble learning has not been investigated extensively. The massive volume of satellite imageries has been established as a big data problem forcing to deploy the proposed solution using big data technologies to manage, store, analyze, and visualize satellite data. In this paper, we have developed a weighted voting mechanism for improving crop classification performance in a large scale, based on ensemble learning and big data schema. Built upon Apache Spark, the popular DB Framework, the proposed approach was tested on El Salheya, Ismaili governate. The proposed ensemble approach boosted accuracy by 6.5%, 1.9%, 4.4%, 4.9%, 4.7% in precision, recall, F-score, Overall Accuracy (OA), and Matthews correlation coefficient (MCC) metrics respectively. Our findings confirm the generalization of the proposed crop identification approach at a large-scale setting.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Face Angle Identification with Ensemble Learning
    Zhou, Zi-Yang
    Chen, Keke
    PROCEEDINGS OF 2020 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2020, : 122 - 126
  • [42] B-Learning and Big Data: Use in Training an Engineering Course
    Contreras Bravo, Leonardo Emiro
    Rodriguez Molano, Jose Ignacio
    Tarazona Bermudez, Giovanny Mauricio
    DATA MINING AND BIG DATA, DMBD 2017, 2017, 10387 : 221 - 233
  • [43] Output Thresholding for Ensemble Learners and Imbalanced Big Data
    Johnson, Justin M.
    Khoshgoftaar, Taghi M.
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 1449 - 1454
  • [44] Big Ensemble Data Assimilation in Numerical Weather Prediction
    Miyoshi, Takemasa
    Kondo, Keiichi
    Terasaki, Koji
    COMPUTER, 2015, 48 (11) : 15 - 21
  • [45] An Ensemble approach to Big Data Security (Cyber Security)
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Ibrahim, Aidarus M.
    Zaffar, Maryam
    Raza, Kamran
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (09) : 75 - 77
  • [46] Ensemble with Divisive Bagging for Feature Selection in Big Data
    Park, Yousung
    Kwon, Tae Yeon
    COMPUTATIONAL ECONOMICS, 2024,
  • [47] Experimental evaluation of ensemble classifiers for imbalance in Big Data
    Juez-Gil M.
    Arnaiz-González Á.
    Rodríguez J.J.
    García-Osorio C.
    Applied Soft Computing, 2021, 108
  • [48] A Classifier Ensemble Framework for Multimedia Big Data Classification
    Yan, Yilin
    Zhu, Qiusha
    Shyu, Mei-Ling
    Chen, Shu-Ching
    PROCEEDINGS OF 2016 IEEE 17TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IEEE IRI), 2016, : 615 - 622
  • [49] A Flexible Ensemble Algorithm for Big Data Cleaning of PMUs
    Shen, Long
    He, Xin
    Liu, Mingqun
    Qin, Risheng
    Guo, Cheng
    Meng, Xian
    Duan, Ruimin
    FRONTIERS IN ENERGY RESEARCH, 2021, 9
  • [50] PEnBayes: A Multi-Layered Ensemble Approach for Learning Bayesian Network Structure from Big Data
    Tang, Yan
    Wang, Jianwu
    Mai Nguyen
    Altintas, Ilkay
    SENSORS, 2019, 19 (20)