A New Cloud Computing Architecture for the Classification of Remote Sensing Data

被引:35
作者
Ayma Quirita, Victor Andres [1 ]
Ostwald Pedro da Costa, Gilson Alexandre [2 ]
Happ, Patrick Nigri [1 ]
Feitosa, Raul Queiroz [1 ]
Ferreira, Rodrigo da Silva [3 ]
Borges Oliveira, Dario Augusto [4 ]
Plaza, Antonio [5 ]
机构
[1] Pontifical Catholic Univ Rio de Janeiro, Dept Elect Engn, BR-22451000 Rio De Janeiro, Brazil
[2] Univ Estado Rio De Janeiro, Dept Informat & Comp Sci, BR-20550900 Rio De Janeiro, Brazil
[3] IBM Res Brazil Lab, BR-22290900 Rio De Janeiro, Brazil
[4] Gen Elect Global Res Ctr, BR-21941600 Rio De Janeiro, Brazil
[5] Univ Extremadura, Dept Technol Comp & Commun, Hyperspectral Comp Lab, E-10071 Caceres, Spain
关键词
Distributed computing; image classification; remote sensing; BIG DATA; CHALLENGES; MAPREDUCE;
D O I
10.1109/JSTARS.2016.2603120
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a new distributed architecture for supervised classification of large volumes of earth observation data on a cloud computing environment. The architecture supports distributed execution, network communication, and fault tolerance in a transparent way to the user. The architecture is composed of three abstraction layers, which support the definition and implementation of applications by researchers from different scientific investigation fields. The implementation of architecture is also discussed. A software prototype (available online), which runs machine learning routines implemented on the cloud using the Waikato Environment for Knowledge Analysis (WEKA), a popular free software licensed under the GNU General Public License, is used for validation. Performance issues are addressed through an experimental analysis in which two supervised classifiers available in WEKA were used: random forest and support vector machines. This paper further describes how to include other classification methods in the available software prototype
引用
收藏
页码:409 / 416
页数:8
相关论文
共 22 条
[1]  
Aggarwal C.C., 2015, DATA CLASSIFICATION
[2]  
[Anonymous], 2012, Scaling up Machine LearningParallel and Distributed Approaches
[3]   Big Data computing and clouds: Trends and future directions [J].
Assuncao, Marcos D. ;
Calheiros, Rodrigo N. ;
Bianchi, Silvia ;
Netto, Marco A. S. ;
Buyya, Rajkumar .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2015, 79-80 :3-15
[4]   CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACH [J].
Ayma, V. A. ;
Ferreira, R. S. ;
Happ, P. ;
Oliveira, D. ;
Feitosaa, R. ;
Costa, G. ;
Plaza, A. ;
Gamba, P. .
PIA15+HRIGI15 - JOINT ISPRS CONFERENCE, VOL. I, 2015, 40-3 (W2) :17-21
[5]  
Baumgardner M. F., 2015, 220 BAND AVIRIS HYPE, DOI [10.4231/R7RX991C, DOI 10.4231/R7RX991C]
[6]  
Datcu M., 2015, IEEE INT GEOSC REM S
[7]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[8]   Big Data with Cloud Computing: an insight on the computing environment, MapReduce, and programming frameworks [J].
Fernandez, Alberto ;
del Rio, Sara ;
Lopez, Victoria ;
Bawakid, Abdullah ;
del Jesus, Maria J. ;
Benitez, Jose M. ;
Herrera, Francisco .
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 4 (05) :380-409
[9]  
Ferreira RAT, 2014, PROCEEDINGS OF THE PROBLEM@WEB INTERNATIONAL CONFERENCE: TECHNOLOGY, CREATIVITY AND AFFECT IN MATHEMATICAL PROBLEM SOLVING, P275
[10]  
Gates A., 2012, PROGRAMMING PIG