Cost-Effective Real-Time Obstacle Detection and Avoidance for AGVs using YOLOv8 and RGB-D Sensors
Received: 6 January 2025 | Revised: 4 February 2025 and 18 February 2025 | Accepted: 22 February 2025 | Online: 4 March 2025
Corresponding author: Yacine Slimani
Abstract
Recent advances in obstacle detection and avoidance technologies have significantly enhanced robotic navigation capabilities. This study presents a real-time obstacle detection and avoidance system leveraging YOLOv8 and RGB-D sensors. The system integrates Microsoft Kinect V1 to capture RGB and depth images, employing YOLOv8 for efficient real-time object detection and classification. Depth data are utilized to calculate object distances and positions, allowing accurate navigation decisions. Implemented on the Pioneer 3DX robot, the system demonstrates high efficiency, reliability, and adaptability. With a training dataset, the model achieves exceptional performance, attaining an accuracy of 92.6% across all object classes and a mAP@0.5 of 95%, However, the system was primarily tested in structured indoor environments, which may limit its generalization to unstructured outdoor settings. This cost-effective solution offers a practical approach to enhancing autonomous navigation and obstacle avoidance in real-world applications.
Keywords:
YOLOv8, Pioneer 3DX robot, autonomous guided vehicles, real-time obstacle detection, RGB-D sensors, Microsoft Kinect V1Downloads
References
M. Khatun, M. Patel, R. Jung, and M. Glas, "A simulation-based analysis for a transverse guidance for highly automated driving functions," in 2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), Ankara, Turkey, Jun. 2021, pp. 1–6.
G. Ullrich and T. Albrecht, Automated Guided Vehicle Systems: A Guide - With Practical Applications - About The Technology - For Planning. Springer Fachmedien, 2023.
L. Yan, H. Duan, and X. Yu, Eds., Advances in Guidance, Navigation and Control: Proceedings of 2020 International Conference on Guidance, Navigation and Control, ICGNC 2020, Tianjin, China, October 23–25, 2020, vol. 644, 2022.
A. Abdulhafez and G. Harit, "Guide Me: Recognition and Servoing on Mobiles," Arabian Journal for Science and Engineering, vol. 43, no. 12, pp. 7359–7372, Dec. 2018.
J. Betz et al., "Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racing," IEEE Open Journal of Intelligent Transportation Systems, vol. 3, pp. 458–488, 2022.
H. Fazlollahtabar and M. Saidi-Mehrabad, Autonomous Guided Vehicles: Methods and Models for Optimal Path Planning, vol. 20. Springer International Publishing, 2015.
J. Chen, S. Wang, T. Zhou, L. Xiong, and X. Xing, "Study on Safety Analysis Method for Take-over System of Autonomous Vehicles," in 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA, Oct. 2020, pp. 1972–1977.
K. Wang et al., "The adaptability and challenges of autonomous vehicles to pedestrians in urban China," Accident Analysis & Prevention, vol. 145, Sep. 2020, Art. no. 105692.
M. Aizat, A. Azmin, and W. Rahiman, "A Survey on Navigation Approaches for Automated Guided Vehicle Robots in Dynamic Surrounding," IEEE Access, vol. 11, pp. 33934–33955, 2023.
F. Liu, X. Li, and Y. Wang, "Design of Automatic Guided Vehicle Motion Control System Based on Magnetic Navigation," in 2018 Chinese Control And Decision Conference (CCDC), Shenyang, China, Jun. 2018, pp. 4775–4779.
V. Rubanov, D. Bushuev, E. Karikov, A. Bazhanov, and S. Alekseevsky, "Development a low-cost navigation technology based on metal line sensors and passive RFID tags for industrial automated guided vehicle," Journal of Engineering and Applied Sciences, vol. 15, no. 20, pp. 2291–2297, 2020.
Q. F. Yan, H. Yan Hu, T. P. Hang, and Y. Si Fu, "Path Tracking of INS AGV Corrected by Double Magnetic Nails Based on Fuzzy Controller," in 2019 IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Chongqing, China, Oct. 2019, pp. 1732–1735.
Z. Ma, O. Postolache, and Y. Yang, "Obstacle Avoidance for Unmanned Vehicle based on a 2D LIDAR," in 2019 International Conference on Sensing and Instrumentation in IoT Era (ISSI), Lisbon, Portugal, Aug. 2019, pp. 1–6.
G. Fragapane, R. de Koster, F. Sgarbossa, and J. O. Strandhagen, "Planning and control of autonomous mobile robots for intralogistics: Literature review and research agenda," European Journal of Operational Research, vol. 294, no. 2, pp. 405–426, Oct. 2021.
A. N. A. Rafai, N. Adzhar, and N. I. Jaini, "A Review on Path Planning and Obstacle Avoidance Algorithms for Autonomous Mobile Robots," Journal of Robotics, vol. 2022, no. 1, 2022, Art. no. 2538220.
Y. Chen, W. Zheng, Y. Zhao, T. H. Song, and H. Shin, "DW-YOLO: An Efficient Object Detector for Drones and Self-driving Vehicles," Arabian Journal for Science and Engineering, vol. 48, no. 2, pp. 1427–1436, Feb. 2023.
M. Ding et al., "Learning Depth-Guided Convolutions for Monocular 3D Object Detection," in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, Jun. 2020, pp. 11669–11678.
C. Reading, A. Harakeh, J. Chae, and S. L. Waslander, "Categorical Depth Distribution Network for Monocular 3D Object Detection," in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, Jun. 2021, pp. 8551–8560.
D. H. Dos Reis, D. Welfer, M. A. De Souza Leite Cuadros, and D. F. T. Gamarra, "Mobile Robot Navigation Using an Object Recognition Software with RGBD Images and the YOLO Algorithm," Applied Artificial Intelligence, vol. 33, no. 14, pp. 1290–1305, Dec. 2019.
Y. Zhang et al., "A regional distance regression network for monocular object distance estimation," Journal of Visual Communication and Image Representation, vol. 79, Aug. 2021, Art. no. 103224.
H. Saleh, S. Saleh, N. T. Toure, and W. Hardt, "Robust Collision Warning System based on Multi Objects Distance Estimation," in 2021 IEEE Concurrent Processes Architectures and Embedded Systems Virtual Conference (COPA), San Diego, CA, USA, Apr. 2021, pp. 1–6.
F. Shao, X. Wang, F. Meng, J. Zhu, D. Wang, and J. Dai, "Improved Faster R-CNN Traffic Sign Detection Based on a Second Region of Interest and Highly Possible Regions Proposal Network," Sensors, vol. 19, no. 10, Jan. 2019, Art. no. 2288.
W. Huang, M. Huang, and Y. Zhang, "Detection of Traffic Signs Based on Combination of GAN and Faster-RCNN," Journal of Physics: Conference Series, vol. 1069, no. 1, Dec. 2018, Art. no. 012159.
Z. Zhao, H. Liu, and D. Cao, "Improved Traffic Sign Detection Algorithm Based on Libra R-CNN," Journal of Mechanical Engineering, vol. 57, no. 22, pp. 255–265.
G. Jie, Z. Honggang, C. Daiwu, and Z. Nannan, "Object detection algorithm based on deformable part models," in 2014 4th IEEE International Conference on Network Infrastructure and Digital Content, Beijing, China, Sep. 2014, pp. 90–94.
A. Tripathi, V. Gohokar, and R. Kute, "Comparative Analysis of YOLOv8 and YOLOv9 Models for Real-Time Plant Disease Detection in Hydroponics," Engineering, Technology & Applied Science Research, vol. 14, no. 5, pp. 17269–17275, Oct. 2024.
"Road signs Computer Vision Project," Roboflow. https://universe.roboflow.com/mjrob/road-signs-ohan1.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 779–788.
J. Motsch, S. Benammar, and Y. Bergeon, "Interior mapping of a building: A real-life experiment with Microsoft Kinect for Windows v1 and RGBD-SLAM," in 2017 International Conference on Military Technologies (ICMT), Brno, Czech Republic, May 2017, pp. 728–732.
X. Hu et al., "Real-time detection of uneaten feed pellets in underwater images for aquaculture using an improved YOLO-V4 network," Computers and Electronics in Agriculture, vol. 185, Jun. 2021, Art. no. 106135.
M. Cazorla and D. Viejo, "JavaVis: An integrated computer vision library for teaching computer vision," Computer Applications in Engineering Education, vol. 23, no. 2, pp. 258–267, 2015.
K. Pulli, A. Baksheev, K. Kornyakov, and V. Eruhimov, "Real-time computer vision with OpenCV," Communications of the ACM, vol. 55, no. 6, pp. 61–69, Jun. 2012.
G. R. Bradski and A. Kaehler, Learning OpenCV: computer vision with the OpenCV library. O’Reilly, 2011.
S. Khesrani, "Contribution à la modélisation et à la commande des systèmes robotiques," Ph.D. dissertation, University Ferhat Abbas - Sétif 1, Algeria, 2023.
Downloads
How to Cite
License
Copyright (c) 2025 Amar Medjaldi, Yacine Slimani, Nora Karkar
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
