Live Sign Language Translation System Using Gesture Recognition
- DOI
- 10.2991/978-94-6463-858-5_156How to use a DOI?
- Keywords
- Intelligent gesture tracking; sign language visualisation; online interactive platform; visual computing and speech synthesis
- Abstract
This paper presents a real-time sign language translator that converts sign gestures into speech and text to facilitate interactive communication. It employs Media Pipe Tracking to detect 21 major landmarks and Open CV for processing gestures. An MLP classifier with deep learning features is used for gesture recognition. The system can accurately recognize and interpret hand gestures (A-Z) from live camera input or image uploads, supporting real-time sign recognition. By incrementally capturing letters, it enables fluent word formation enhances accessibility through speech synthesis. To ensure precise and efficient gesture recognition the system integrates advanced tracking and processing methodologies. With a weighted average F1-score of 94% and a macro-average F1-score of 88% the system’s total accuracy of 93.85% shows how effective it is in practical situations.
- Copyright
- © 2025 The Author(s)
- Open Access
- Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
Cite this article
TY - CONF AU - G. M. G. Madhuri AU - G. Vasavi Varshitha AU - P. Sevitha AU - S. Hari Sree Pavan Sankar AU - Md. Ghouse Samdhani PY - 2025 DA - 2025/11/04 TI - Live Sign Language Translation System Using Gesture Recognition BT - Proceedings of International Conference on Computer Science and Communication Engineering (ICCSCE 2025) PB - Atlantis Press SP - 1896 EP - 1900 SN - 2352-538X UR - https://doi.org/10.2991/978-94-6463-858-5_156 DO - 10.2991/978-94-6463-858-5_156 ID - Madhuri2025 ER -