Smart Hand Gesture based Interface for Mouse Control and Interaction

DOI

10.2991/978-94-6463-866-0_72How to use a DOI?

Keywords

Hand gestures; human-computer interaction; media pipe; real-time gesture control; computer vision; mouse emulating; touchless interface; adaptive input system

Abstract

Hand gesture recognition offers a natural and intuitive mode of human computer interaction by enabling users to control digital systems through physical movements. However, many existing approaches are constrained by the need for complex hardware, large annotated datasets, or computationally intensive deep learning models. This study proposes a lightweight, vision-based interface that enables real time, touchless mouse control using a standard RGB webcam. The system identifies gestures by extracting geometric features such as inter-landmark angles and distances, employing MediaPipe for efficient hand tracking. A rule-based classification model maps these gestures to mouse operations—including cursor movement, clicking, scrolling, and screenshot capture—while minimizing false detections and enhancing usability. Experimental evaluation demonstrates an average gesture recognition accuracy of 92.5% with an overall system latency of less than 150 milliseconds. These results highlight the system’s effectiveness as a practical, cost-efficient alternative for accessibility tools, virtual environments, and general-purpose computing applications, eliminating the need for specialized hardware or extensive training.

Copyright

© 2025 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Chaithra S. Menon
AU  - S. Hemanth Vignesha
AU  - S. Balavignesh
AU  - P. Durgadevi
PY  - 2025
DA  - 2025/10/31
TI  - Smart Hand Gesture based Interface for Mouse Control and Interaction
BT  - Proceedings of the International Conference on Intelligent Systems and Digital Transformation (ICISD 2025)
PB  - Atlantis Press
SP  - 888
EP  - 900
SN  - 2589-4919
UR  - https://doi.org/10.2991/978-94-6463-866-0_72
DO  - 10.2991/978-94-6463-866-0_72
ID  - Menon2025
ER  -