Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)

<Previous Article In Volume
Next Article In Volume>

Gestura: A Voice and Gesture-Controlled System for Seamless Interaction

Authors
G. Surya Mahesh1, *, Bandaru Venkataramana1, Y. David Solomon Raju1, G. Venkata koti reddy1
1Holy Mary Inst. Of Tech. and Science, Hyderabad, TS, India
*Corresponding author. Email: suryamaheshguduri@gmail.com
Corresponding Author
G. Surya Mahesh
Available Online 4 November 2025.
DOI
10.2991/978-94-6463-858-5_111How to use a DOI?
Keywords
Gesture recognition; voice control; hand tracking; speech recognition; human-computer interaction; accessibility; JavaFX; OpenCV; Mediapipe; Vosk; multi-modal interface; hands-free control; software interaction
Abstract

Gestura aims to change the way people interact with technology by employing a control system that combines gesture recognition, speech commands, and voice control to create a fully intuitive interface. OpenCV and Mediapipe offer computer vision and gesture tracking while Vosk provides real time speech recognition, enabling the system to function dynamically. The primary aim is to allow users to access their computer systems without requiring peripherals, thus enhancing ease of access. Gestura demonstrates how multi-modal interaction can redefine computing by improving accessibility for users with disabilities or introducing innovative user interfaces for gaming and productivity. The system is created using JavaFX, which makes the graphical user interfaces more responsive, modular, and easier to use through the unification of gesture and voice recognition, thus enhancing many software packages.

Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)
Series
Advances in Computer Science Research
Publication Date
4 November 2025
ISBN
978-94-6463-858-5
ISSN
2352-538X
DOI
10.2991/978-94-6463-858-5_111How to use a DOI?
Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

risenwbib
TY  - CONF
AU  - G. Surya Mahesh
AU  - Bandaru Venkataramana
AU  - Y. David Solomon Raju
AU  - G. Venkata koti reddy
PY  - 2025
DA  - 2025/11/04
TI  - Gestura: A Voice and Gesture-Controlled System for Seamless Interaction
BT  - Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)
PB  - Atlantis Press
SP  - 1332
EP  - 1343
SN  - 2352-538X
UR  - https://doi.org/10.2991/978-94-6463-858-5_111
DO  - 10.2991/978-94-6463-858-5_111
ID  - Mahesh2025
ER  -