Reinforcement learning-based controller design for a ‎proposed octorotor with tilt-arm angles ‎

Document Type : Research Article

Authors

1 Department of Mechanical Engineering, University of Kashan, Kashan, Iran

2 Department of Mechanical Engineering, Kashan University

3 Department of Mechanical Engineering, Faculty of Engineering, University of Isfahan,

4 Department of Mechanical Engineering, Faculty of Engineering, University of Isfahan, Isfahan, Iran

Abstract

The maneuverability of a quadrotor or octorotor UAV is limited in the standard configuration ‎because the force vectors of the propellers are parallel and only have four active degrees of ‎freedom. Therefore, they lack the controllability of six independent degrees of freedom. This ‎study designs a novel configuration for an octorotor capable of hovering with roll or pitch angles in ‎a specific position, contrary to UAVs with a standard configuration that can only hover in a ‎horizontal position. In other words, in this octorotor, orientation tracking is also added to the ‎octorotor's targets in addition to position tracking. The proposed model can be controlled by ‎altering the velocity of the eight rotors and the tilt angle of the four arms. Such alterations in ‎velocity and tilt angle are such that they can provide the aerial vehicle with most optimum ‎maneuverability. After deriving the proposed dynamic octorotor model, a controller is proposed ‎using neural networks (NNs) and reinforcement learning (RL), capable of controlling the proposed ‎octorotor with six independent degrees of freedom. Finally, trajectory tracking, octorotor position, ‎and controller robustness to possible motor malfunctions are examined, and numerical simulation ‎results are provided.‎

Keywords

Main Subjects

References

[1] G. Barbaraci, Modeling and control of a quadrotor with variable geometry arms, Journal of Unmanned Vehicle Systems, 3(2) (2015) 35-57.
[2] D. Brescianini, R. D'Andrea, Design, modeling and control of an omni-directional aerial vehicle, in:  2016 IEEE international conference on robotics and automation (ICRA), IEEE, 2016, pp. 3261-3266.
[3] Y. Tadokoro, T. Ibuki, M. Sampei, Maneuverability analysis of a fully-actuated hexrotor UAV considering tilt angles and arrangement of rotors, IFAC-PapersOnLine, 50(1) (2017) 8981-8986.
[4] D. Invernizzi, M. Lovera, Geometric tracking control of a quadcopter tiltrotor UAV, IFAC-PapersOnLine, 50(1) (2017) 11565-11570.
[5] D. Invernizzi, M. Giurato, P. Gattazzo, M. Lovera, Full pose tracking for a tilt-arm quadrotor UAV, in:  2018 IEEE Conference on Control Technology and Applications (CCTA), IEEE, 2018, pp. 159-164.
[6] E.J. Alvarez, A. Ning, High-fidelity modeling of multirotor aerodynamic interactions for aircraft design, AIAA Journal, 58(10) (2020) 4385-4400.
[7] H. Zhu, H. Nie, L. Zhang, X. Wei, M. Zhang, Design and assessment of octocopter drones with improved aerodynamic efficiency and performance, Aerospace Science and Technology, 106 (2020) 106206.
[8] S. Sridhar, R. Kumar, M. Radmanesh, M. Kumar, Non-linear sliding mode control of a tilting-rotor quadcopter, in:  Dynamic Systems and Control Conference, American Society of Mechanical Engineers, 2017, pp. V001T009A007.
[9] S. Zeghlache, H. Mekki, A. Bouguerra, A. Djerioui, Actuator fault tolerant control using adaptive RBFNN fuzzy sliding mode controller for coaxial octorotor UAV, ISA transactions, 80 (2018) 267-278.
[10] K. Hu, Q. Wu, Y. Li, W. Chen, Quadrator QFT Control Based on Model Reduction Method, in:  2018 5th International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS), IEEE, 2018, pp. 281-286.
[11] V.M. Arellano-Quintana, E.A. Portilla-Flores, E.A. Merchán-Cruz, Multi-objective design optimization of a hexa-rotor with disturbance rejection capability using an evolutionary algorithm, IEEE Access, 6 (2018) 69064-69074.
[12] A. Erasmus, H. Jordaan, Robust adaptive control of a multirotor with an unknown suspended payload, IFAC-PapersOnLine, 53(2) (2020) 9432-9439.
[13] T. Chen, J. Shan, A novel cable-suspended quadrotor transportation system: From theory to experiment, Aerospace Science and Technology, 104 (2020) 105974.
[14] S. Kase, M. Oya, Adaptive tracking controller for hexacopters with a wind disturbance, Artificial Life and Robotics, 25(2) (2020) 322-327.
[15] C.-H. Pi, K.-C. Hu, S. Cheng, I.-C. Wu, Low-level autonomous control and tracking of quadrotor using reinforcement learning, Control Engineering Practice, 95 (2020) 104222.
[16] A. Soltani, A. H. Vahidi Bajestani, M. Goharkhah, Point to Point Control of a Liquid Carrying Quadrotor, AUT Journal of Mechanical Engineering, 54(4) (2022) 727-746. (I‌n P‌e‌r‌s‌i‌a‌n)
[17] H. Shamsollahi, F. Rekabi, F.A. Shirazi, M.J. Sadigh, Control of a Quadrotor Equipped with Robotic Arm Based on Disturbance Estimation, AUT Journal of Mechanical Engineering, 54 (2022) 768-747. (I‌n P‌e‌r‌s‌i‌a‌n)
[18] H. Lee, M. Jeong, C. Kim, H. Lim, C. Park, S. Hwang, H. Myung, Low-level Pose Control of Tilting Multirotor for Wall Perching Tasks Using Reinforcement Learning, in:  2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2021, pp. 9669-9676.
[19] S. Rajappa, M. Ryll, H.H. Bülthoff, A. Franchi, Modeling, control and design optimization for a fully-actuated hexarotor aerial vehicle with tilted propellers, in:  2015 IEEE international conference on robotics and automation (ICRA), IEEE, 2015, pp. 4006-4013.
[20] A. Nemati, M. Kumar, Modeling and control of a single axis tilting quadcopter, in:  2014 American Control Conference, IEEE, 2014, pp. 3077-3082.
[21] N. Osmić, M. Kurić, I. Petrović, Detailed octorotor modeling and PD control, in:  2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2016, pp. 002182-002189.
[22] M. Mikkelsen, Development, modelling and control of a multirotor vehicle, in, 2015.
[23] Y.-W. Dai, C.-H. Pi, K.-C. Hu, S. Cheng, Reinforcement learning control for multi-axis rotor configuration UAV, in:  2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), IEEE, 2020, pp. 1648-1653.
[24] S. Fujimoto, H. Hoof, D. Meger, Addressing function approximation error in actor-critic methods, in:  International conference on machine learning, PMLR, 2018, pp. 1587-1596.
[25] J. Hwangbo, I. Sa, R. Siegwart, M. Hutter, Control of a quadrotor with reinforcement learning, IEEE Robotics and Automation Letters, 2(4) (2017) 2096-2103.
Amirkabir Journal of Mechanical Engineering
Volume 55, Issue 10
January 2024
Pages 1175-1194

Files

Share

How to cite

Statistics