Wing-strain-based flight control of flapping-wing drones through reinforcement learning

被引:7
作者
Kim, Taewi [1 ]
Hong, Insic [1 ]
Im, Sunghoon [1 ]
Rho, Seungeun [2 ]
Kim, Minho [1 ]
Roh, Yeonwook [1 ]
Kim, Changhwan [1 ]
Park, Jieun [1 ]
Lim, Daseul [1 ]
Lee, Doohoe [1 ]
Lee, Seunggon [1 ]
Lee, Jingoo [1 ]
Back, Inryeol [1 ]
Cho, Junggwang [1 ]
Hong, Myung Rae [1 ]
Kang, Sanghun [1 ]
Lee, Joonho [3 ]
Seo, Sungchul [4 ]
Kim, Uikyum [1 ]
Choi, Young-Man [1 ]
Koh, Je-sung [1 ]
Han, Seungyong [1 ]
Kang, Daeshik [1 ]
机构
[1] Ajou Univ, Dept Mech Engn, Suwon, South Korea
[2] Kakaobrain, Seongnam, South Korea
[3] Swiss Fed Inst Technol, Robot Syst Lab, Zurich, Switzerland
[4] Seokyeong Univ, Dept Nanochem Biol & Environm Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
CAMPANIFORM SENSILLA; SPATIAL-DISTRIBUTION; INSECT; AERODYNAMICS; KINEMATICS;
D O I
10.1038/s42256-024-00893-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although drone technology has advanced rapidly, replicating the dynamic control and wind-sensing abilities of biological flight is still beyond reach. Biological studies reveal that insect wings are equipped with mechanoreceptors known as campaniform sensilla, which detect complex aerodynamic loads critical for flight agility. By leveraging robotic experiments designed to mimic these biological systems, we confirm that wing strain provides crucial information about the drone's attitude angle, as well as the direction and velocity of the wind. We introduce a wing-strain-based flight controller that employs the aerodynamic forces exerted on a flapping drone's wings to deduce vital flight data such as attitude and airflow without accelerometers and gyroscopic sensors. The present work spans five key experiments: initial validation of the wing strain sensor system for state information provision, control in a single degree of freedom movement environment with changing winds, control in a two degrees of freedom movement environment for gravitational attitude adjustment, a test for position control in windy conditions and a demonstration of precise flight path manipulation in a windless condition using only wing strain sensors. We have successfully demonstrated control of a flapping drone in various environments using only wing strain sensors, with the aid of a reinforcement-learning-driven flight controller. The demonstrated adaptability to environmental shifts will be beneficial across varied applications, from gust resistance to wind-assisted flight for autonomous flying robots. Inspired by mechanoreceptors on flying insects, a flapping-wing drone that makes use of strain sensors on the wings and reinforcement-learning-based flight control has been developed. The drone can fly in various unsteady environments, including in windy conditions.
引用
收藏
页码:992 / 1005
页数:25
相关论文
共 50 条
[21]   Development and flight performance of a biologically-inspired tailless flapping-wing micro air vehicle with wing stroke plane modulation [J].
Nguyen, Quoc-Viet ;
Chan, Woei Leong .
BIOINSPIRATION & BIOMIMETICS, 2019, 14 (01)
[22]   Novel Dihedral-Based Control of Flapping-Wing Aircraft With Application to Perching [J].
Paranjape, Aditya A. ;
Chung, Soon-Jo ;
Kim, Joseph .
IEEE TRANSACTIONS ON ROBOTICS, 2013, 29 (05) :1071-1084
[23]   Micro Flapping-Wing Vehicles Formation Control With Attitude Estimation [J].
Jiang, Wanyue ;
Li, Dongyu ;
Ge, Shuzhi Sam .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (02) :1035-1047
[24]   Longitudinal modelling and control of a flapping-wing micro aerial vehicle [J].
Rakotomamonjy, Thomas ;
Ouladsine, Mustapha ;
Le Moing, Thierry .
CONTROL ENGINEERING PRACTICE, 2010, 18 (07) :679-690
[25]   Adaptive control of a millimeter-scale flapping-wing robot [J].
Chirarattananon, Pakpong ;
Ma, Kevin Y. ;
Wood, Robert J. .
BIOINSPIRATION & BIOMIMETICS, 2014, 9 (02)
[26]   Altitude Control of Flapping-wing MAV Using Vision-Based Navigation [J].
Lin, S. H. ;
Hsiao, F. Y. ;
Chen, C. L. ;
Shen, J. F. .
2010 AMERICAN CONTROL CONFERENCE, 2010, :21-26
[27]   Human Memory/Learning Inspired Control Method for Flapping-Wing Micro Air Vehicles [J].
Song, Y. D. ;
Weng, Liguo ;
Lebby, Gary .
JOURNAL OF BIONIC ENGINEERING, 2010, 7 (02) :127-133
[28]   Research Progress on Modeling and Control of Flapping-wing Air Vehicles [J].
He W. ;
Ding S.-Q. ;
Sun C.-Y. .
Zidonghua Xuebao/Acta Automatica Sinica, 2017, 43 (05) :685-696
[29]   Full Flight Envelope and Trim Map of Flapping-Wing Micro Aerial Vehicles [J].
Clawson, Taylor S. ;
Ferrari, Silvia ;
Helbling, E. Farrell ;
Wood, Robert J. ;
Fu, Bo ;
Ruina, Andy ;
Wang, Z. Jane .
JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2020, 43 (12) :2218-2236
[30]   Platform Design and Tethered Flight of a Motor-driven Flapping-wing System [J].
Hines, Lindsey ;
Colmenares, David ;
Sitti, Metin .
2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, :5838-5845