A Hadoop-based Multimedia Transcoding System for Processing Social Media in the PaaS Platform of SMCCSE

被引:6
作者
Kim, Myoungjin [1 ]
Han, Seungho [1 ]
Cui, Yun [1 ]
Lee, Hanku [1 ]
Jeong, Changsung [2 ]
机构
[1] Konkuk Univ, Dept Internet & Multimedia Engn, Seoul 143701, South Korea
[2] Korea Univ, Dept Elect Engn, Seoul 136713, South Korea
来源
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS | 2012年 / 6卷 / 11期
关键词
Hadoop; mapreduce; multimedia transcoding; cloud computing; paas; VIDEO; MODEL;
D O I
10.3837/tiis.2012.11.005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Previously, we described a social media cloud computing service environment (SMCCSE). This SMCCSE supports the development of social networking services (SNSs) that include audio, image, and video formats. A social media cloud computing PaaS platform, a core component in a SMCCSE, processes large amounts of social media in a parallel and distributed manner for supporting a reliable SNS. Here, we propose a Hadoop-based multimedia system for image and video transcoding processing, necessary functions of our PaaS platform. Our system consists of two modules, including an image transcoding module and a video transcoding module. We also design and implement the system by using a MapReduce framework running on a Hadoop Distributed File System (HDFS) and the media processing libraries Xuggler and JAI. In this way, our system exponentially reduces the encoding time for transcoding large amounts of image and video files into specific formats depending on user-requested options (such as resolution, bit rate, and frame rate). In order to evaluate system performance, we measure the total image and video transcoding time for image and video data sets, respectively, under various experimental conditions. In addition, we compare the video transcoding performance of our cloud-based approach with that of the traditional frame-level parallel processing-based approach. Based on experiments performed on a 28-node cluster, the proposed Hadoop-based multimedia transcoding system delivers excellent speed and quality.
引用
收藏
页码:2827 / 2848
页数:22
相关论文
共 31 条
[1]   Video transcoding: An overview of various techniques and research issues [J].
Ahmad, I ;
Wei, X ;
Sun, Y ;
Zhang, YQ .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (05) :793-804
[2]  
[Anonymous], 2003, P 19 ACM S OP SYST P, DOI [10.1145/1165389.945450, DOI 10.1145/1165389.945450]
[3]   A View of Cloud Computing [J].
Armbrust, Michael ;
Fox, Armando ;
Griffith, Rean ;
Joseph, Anthony D. ;
Katz, Randy ;
Konwinski, Andy ;
Lee, Gunho ;
Patterson, David ;
Rabkin, Ariel ;
Stoica, Ion ;
Zaharia, Matei .
COMMUNICATIONS OF THE ACM, 2010, 53 (04) :50-58
[4]   Cluster-based optimized parallel video transcoding [J].
Barlas, Gerassimos .
PARALLEL COMPUTING, 2012, 38 (4-5) :226-244
[5]   Social Network Sites: Definition, History, and Scholarship [J].
Boyd, Danah M. ;
Ellison, Nicole B. .
JOURNAL OF COMPUTER-MEDIATED COMMUNICATION, 2007, 13 (01) :210-230
[6]   Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility [J].
Buyya, Rajkumar ;
Yeo, Chee Shin ;
Venugopal, Srikumar ;
Broberg, James ;
Brandic, Ivona .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2009, 25 (06) :599-616
[7]  
Chen F., 2003, P PAR DISTR PROC S A
[8]   Social networking: Communication revolution or evolution? [J].
Coyle, Cheryl L. ;
Vaughn, Heather .
BELL LABS TECHNICAL JOURNAL, 2008, 13 (02) :13-17
[9]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[10]   A high-performance, portable implementation of the MPI message passing interface standard [J].
Gropp, W ;
Lusk, E ;
Doss, N ;
Skjellum, A .
PARALLEL COMPUTING, 1996, 22 (06) :789-828