Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)

Live Sign Language Translation System Using Gesture Recognition

Authors
G. M. G. Madhuri1, *, G. Vasavi Varshitha1, P. Sevitha1, S. Hari Sree Pavan Sankar1, Md. Ghouse Samdhani1
1Department of ECE, PSCMR College of Engineering and Technology, JNTUK, Vijayawada, Andhra Pradesh, India
*Corresponding author. Email: gmgmadhuri@pscmr.ac.in
Corresponding Author
G. M. G. Madhuri
Available Online 4 November 2025.
DOI
10.2991/978-94-6463-858-5_156How to use a DOI?
Keywords
Intelligent gesture tracking; sign language visualisation; online interactive platform; visual computing and speech synthesis
Abstract

This paper presents a real-time sign language translator that converts sign gestures into speech and text to facilitate interactive communication. It employs Media Pipe Tracking to detect 21 major landmarks and Open CV for processing gestures. An MLP classifier with deep learning features is used for gesture recognition. The system can accurately recognize and interpret hand gestures (A-Z) from live camera input or image uploads, supporting real-time sign recognition. By incrementally capturing letters, it enables fluent word formation enhances accessibility through speech synthesis. To ensure precise and efficient gesture recognition the system integrates advanced tracking and processing methodologies. With a weighted average F1-score of 94% and a macro-average F1-score of 88% the system’s total accuracy of 93.85% shows how effective it is in practical situations.

Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

Volume Title
Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)
Series
Advances in Computer Science Research
Publication Date
4 November 2025
ISBN
978-94-6463-858-5
ISSN
2352-538X
DOI
10.2991/978-94-6463-858-5_156How to use a DOI?
Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

TY  - CONF
AU  - G. M. G. Madhuri
AU  - G. Vasavi Varshitha
AU  - P. Sevitha
AU  - S. Hari Sree Pavan Sankar
AU  - Md. Ghouse Samdhani
PY  - 2025
DA  - 2025/11/04
TI  - Live Sign Language Translation System Using Gesture Recognition
BT  - Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025)
PB  - Atlantis Press
SP  - 1896
EP  - 1900
SN  - 2352-538X
UR  - https://doi.org/10.2991/978-94-6463-858-5_156
DO  - 10.2991/978-94-6463-858-5_156
ID  - Madhuri2025
ER  -