Innovative multi-modal control for surveillance spider robot: An integration of voice and hand gesture recognition
Published in Proceedings of the 2024 9th International Conference on Intelligent Information Technology, 2024
Abstract (excerpt). The spider robot is designed to take on challenging tasks in hazardous conditions. It can move across challenging terrain like walls and rough surfaces, and effectively find lost objects. In this paper, an innovative multi-modal control approach was developed for the Surveillance Spider Robot (SSR) application, integrating voice recognition and hand gesture recognition as control commands. SSR, a six-legged robot, was designed using a Raspberry Pi 4B embedded device, Arduino Uno kit, RC Servo motors (MG996R), 18650 batteries, mini USB microphone (MI-350), Pi camera V1 (OV5647) and PWM generator (PCA9685). The robot can be controlled through voice or hand gesture recognition captured via camera and microphone. SSR is capable of performing ten specific tasks based on these control commands, including forward movement, backward movement, left turns, right turns, complete turns, movements …
Recommended citation: Dang Khoa Phan, Phuong-Nam Tran, Nhat Truong Pham, Tra Huong Thi Le, Duc Ngoc Minh Dang. (2024). "Innovative multi-modal control for surveillance spider robot: An integration of voice and hand gesture recognition." Proceedings of the 2024 9th International Conference on Intelligent Information Technology, 141-148.
Download Paper