Application of social entertainment robot based on sensor and edge computing in collaborative music performance

被引:1
作者
Ma, Li [1 ]
机构
[1] Yulin Normal Univ, Sch Mus & Dance, Yulin 537000, Guangxi, Peoples R China
关键词
Sensors; Edge computing; Social entertainment robots; Musical performance; SYSTEM; DESIGN;
D O I
10.1016/j.entcom.2024.100741
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of this article is to provide a novel and creative performance experience by developing a music structure and beat recognition model, designing a social entertainment robot music performance system, and achieving collaborative music performance between robots and humans. Research on using edge detection algorithms to partition music structures and determine the beat and rhythm changes of music. Using machine learning algorithms to recognize and classify music beats to adapt to different music styles and rhythms. By utilizing Generative Adversarial Networks (GANs), dance segments that conform to musical beats and rhythms were generated and combined with musical performances. In order to ensure the accuracy and smoothness of music performance, various sensors were integrated to monitor the robot's posture and motion status in real-time. After experimental verification, by integrating technologies such as music recognition, dance generation, and sensor data control, collaborative performance between robots and humans can be achieved. Research has shown that close collaboration between robots and performers can be achieved, resulting in collaborative performance. This not only improves the quality and effectiveness of music performance, but also increases entertainment and interactivity, bringing users a richer and more interesting music entertainment experience.
引用
收藏
页数:8
相关论文
共 22 条
[1]  
Abdulwahid M.M., 2020, Inf.: J. Appl. Mach. Electr. Electron. Comput. Sci. Commun. Syst., P54
[2]   Edge computing technologies for Internet of Things: a primer [J].
Ai, Yuan ;
Peng, Mugen ;
Zhang, Kecheng .
DIGITAL COMMUNICATIONS AND NETWORKS, 2018, 4 (02) :77-86
[3]   How do Consumers' Gender and Rational Thinking Affect the Acceptance of Entertainment Social Robots? [J].
Forgas-Coll, Santiago ;
Huertas-Garcia, Ruben ;
Andriella, Antonio ;
Alenya, Guillem .
INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2022, 14 (04) :973-994
[4]   Simulation of hydraulic transplanting robot control system based on fuzzy PID controller [J].
Jin, Xin ;
Chen, Kaikang ;
Zhao, Yang ;
Ji, Jiangtao ;
Jing, Pang .
MEASUREMENT, 2020, 164 (164)
[5]   Sequence and chance: Design and control methods for entertainment robots [J].
Jochum, Elizabeth ;
Millar, Philip ;
Nunez, David .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 87 :372-380
[7]  
Latour B, 1996, SOZ WELT, V47, P369
[8]   Posture Recognition Technology Based on Kinect [J].
Li, Yan ;
Chu, Zhijie ;
Xin, Yizhong .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (03) :621-630
[9]   Low-Complexity Prescribed Performance Control for Unmanned Aerial Manipulator Robot System Under Model Uncertainty and Unknown Disturbances [J].
Liang, Jiacheng ;
Chen, Yanjie ;
Lai, Ningbin ;
He, Bingwei ;
Miao, Zhiqiang ;
Wang, Yaonan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (07) :4632-4641
[10]   Development of Performance System With Musical Dynamics Expression on Humanoid Saxophonist Robot [J].
Lin, Jia-Yeu ;
Kawai, Mao ;
Nishio, Yuya ;
Cosentino, Sarah ;
Takanishi, Atsuo .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02) :1684-1690