Wireless Human-Robot Interaction: Replicating Hand Movements Using OpenCV and Embedded Systems

DOI

10.2991/978-94-6239-768-2_22How to use a DOI?

Keywords

Human-Robot Interaction; Real-time Gesture Replication; OpenCV; 3D-Printed Robotic Hand; Python; ESP8266; Embedded Systems; Wireless Communication

Abstract

The gesture-controlled robotic hand is designed for natural Human-Robot Interaction (HRI) using real-time hand gesture recognition. This aims to provide an intuitive, touchless interface using finger tracking. The proposed system integrates computer vision and embedded systems. Real-time hand gestures are captured using a webcam or camera feed and processed via OpenCV and MediaPipe. They are transmitted through an ESP8266 microcontroller. The robotic hand, built with five MG995 servo motors, mimics finger movements. Two operational modes, live and replay, are implemented. Experiments showed an average accuracy of 95%, with the thumb slightly lower (91%). Response times were typically 120–180 ms, with slight delays under poor lighting or weak signal strength. Replay mode reliably reproduced stored gestures with 95.2% accuracy. This developed system effectively shows contactless robotic control using computer vision and embedded systems, which offers a flexible platform for assistive technologies and teleoperation.

Copyright

© 2026 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits any noncommercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if you modified the licensed material. You do not have permission under this license to share adapted material derived from this chapter or parts of it.

Download article (PDF)

TY  - CONF
AU  - G. Manoj
AU  - Y. Tanmai Sabari
AU  - V. Brunda
AU  - P. Kalyan Babu
AU  - Y. Madhu Babu
AU  - M. Vamshi Krishna
PY  - 2026
DA  - 2026/09/07
TI  - Wireless Human-Robot Interaction: Replicating Hand Movements Using OpenCV and Embedded Systems
BT  - Proceedings of the Third International Conference on Recent Advances in Computing Sciences (RACS 2025)
PB  - Atlantis Press
SP  - 204
EP  - 211
SN  - 1951-6851
UR  - https://doi.org/10.2991/978-94-6239-768-2_22
DO  - 10.2991/978-94-6239-768-2_22
ID  - Manoj2026
ER  -