Investigation on the use of ensemble learning and big data in crop identification

被引:6
|
作者
Ahmed, Sayed [1 ]
Mahmoud, Amira S. [1 ]
Farg, Eslam [1 ]
Mohamed, Amany M. [1 ]
Moustafa, Marwa S. [1 ]
Abutaleb, Khaled [1 ]
Saleh, Ahmed M. [1 ]
AbdelRahman, Mohamed A. E. [1 ]
AbdelSalam, Hisham M. [2 ]
Arafat, Sayed M. [1 ]
机构
[1] Natl Author Remote Sensing & Space Sci NARSS, Cairo, Egypt
[2] Cairo Univ, Fac Comp & Artificial Intelligence, Giza, Egypt
关键词
Big data; Crop identification; Ensemble learning; DB Framework; Apache spark;
D O I
10.1016/j.heliyon.2023.e13339
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The agriculture sector in Egypt faces several problems, such as climate change, water storage, and yield variability. The comprehensive capabilities of Big Data (BD) can help in tackling the uncertainty of food supply occurs due to several factors such as soil erosion, water pollution, climate change, socio-cultural growth, governmental regulations, and market fluctuations. Crop identification and monitoring plays a vital role in modern agriculture. Although several machine learning models have been utilized in identifying crops, the performance of ensemble learning has not been investigated extensively. The massive volume of satellite imageries has been established as a big data problem forcing to deploy the proposed solution using big data technologies to manage, store, analyze, and visualize satellite data. In this paper, we have developed a weighted voting mechanism for improving crop classification performance in a large scale, based on ensemble learning and big data schema. Built upon Apache Spark, the popular DB Framework, the proposed approach was tested on El Salheya, Ismaili governate. The proposed ensemble approach boosted accuracy by 6.5%, 1.9%, 4.4%, 4.9%, 4.7% in precision, recall, F-score, Overall Accuracy (OA), and Matthews correlation coefficient (MCC) metrics respectively. Our findings confirm the generalization of the proposed crop identification approach at a large-scale setting.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Bayesian Network Structure Learning from Big Data: A Reservoir Sampling Based Ensemble Method
    Tang, Yan
    Xu, Zhuoming
    Zhuang, Yuanhang
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2016, 2016, 9645 : 209 - 222
  • [32] Forecasting Daily Tourism Demand for Tourist Attractions with Big Data: An Ensemble Deep Learning Method
    Bi, Jian-Wu
    Li, Chunxiao
    Xu, Hong
    Li, Hui
    JOURNAL OF TRAVEL RESEARCH, 2022, 61 (08) : 1719 - 1737
  • [33] An Algorithm for Identifying the Learning Patterns in Big Data
    Farrash, Majed
    Wang, Wenjia
    2015 IEEE TRUSTCOM/BIGDATASE/ISPA, VOL 2, 2015, : 48 - 55
  • [34] Ensemble Learning for Relational Data
    Eldardiry, Hoda
    Neville, Jennifer
    Rossi, Ryan A.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [35] From Big to Smart Data: Iterative ensemble filter for noise filtering in Big Data classification
    Garcia-Gil, Diego
    Luque-Sanchez, Francisco
    Luengo, Julian
    Garcia, Salvador
    Herrera, Francisco
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2019, 34 (12) : 3260 - 3274
  • [36] Ensemble Learning on Large Scale Financial Imbalanced Data
    Sanabila, H. R.
    Jatmiko, Wisnu
    2018 INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS), 2018, : 93 - 98
  • [37] Data learning from big data
    Torrecilla, Jose L.
    Romo, Juan
    STATISTICS & PROBABILITY LETTERS, 2018, 136 : 15 - 19
  • [38] Use of Machine Learning in Big Data Analytics for Insider Threat Detection
    Mayhew, Michael
    Atighetchi, Michael
    Adler, Aaron
    Greenstadt, Rachel
    2015 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM 2015), 2015, : 915 - 922
  • [39] INVESTIGATION OF ENSEMBLE MODELS FOR SEQUENCE LEARNING
    Celikyilmaz, Asli
    Hakkani-Tur, Dilek
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 5381 - 5385
  • [40] A Big Data Security Framework for IoT Networks Using Weighted Average Ensemble
    Hadj-Attou, Abdelkader
    Kabir, Yacine
    Ykhlef, Farid
    PROGRAM OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATIC CONTROL, ICEEAC 2024, 2024,