Proceedings of the 8th FIRST 2024 International Conference on Global Innovations (FIRST-ESCSI 2024 )

<Previous Article In Volume
Next Article In Volume>

Intervention Device for Autistic Children’s Tantrum Based on Artificial Intelligence

Authors
Nyayu Latifah Husni1, *, Selfi Nurhaliza1, Dewi Permata Sari1, Masayu Anisah1, Abdurrahman1, Ade Silvia Handayani1, Charina Mutiara Chairunnisa1, Syarif Husin1
1Politeknik Negeri Sriwijaya, Palembang, 30139, Indonesia
*Corresponding author. Email: nyayu_latifah@polsri.ac.id
Corresponding Author
Nyayu Latifah Husni
Available Online 1 May 2025.
DOI
10.2991/978-94-6463-678-9_38How to use a DOI?
Keywords
Autism; Tantrum Behavior; MediaPipe; Mini PC; Speaker; Music; Artificial Intelligence
Abstract

Children with autism often face behavioral challenges, including tantrum behaviors caused by difficulties in communicating their needs or desires. Tantrums are excessive emotional reactions resulting from the inability to control and communicate feelings. Therefore, an Artificial Intelligence (AI)-based system is needed to detect and intervene in tantrum behaviors. The libraries used in developing this system are OpenCV and MediaPipe. OpenCV captures and processes images from the webcam, while MediaPipe analyzes movements using Python-based algorithms. MediaPipe tracks body landmarks in real-time (numbers 15 and 16 for hands; numbers 27 and 28 for feet). If a tantrum is detected, intervention is performed by playing music to soothe the child. It is categorized into several levels (1, 2, and 3). The mini PC will signal the speaker to play music corresponding to the detected tantrum level.

Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the 8th FIRST 2024 International Conference on Global Innovations (FIRST-ESCSI 2024 )
Series
Advances in Engineering Research
Publication Date
1 May 2025
ISBN
978-94-6463-678-9
ISSN
2352-5401
DOI
10.2991/978-94-6463-678-9_38How to use a DOI?
Copyright
© 2025 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

risenwbib
TY  - CONF
AU  - Nyayu Latifah Husni
AU  - Selfi Nurhaliza
AU  - Dewi Permata Sari
AU  - Masayu Anisah
AU  - Abdurrahman
AU  - Ade Silvia Handayani
AU  - Charina Mutiara Chairunnisa
AU  - Syarif Husin
PY  - 2025
DA  - 2025/05/01
TI  - Intervention Device for Autistic Children’s Tantrum Based on Artificial Intelligence
BT  - Proceedings of the 8th FIRST 2024 International Conference on Global Innovations (FIRST-ESCSI 2024 )
PB  - Atlantis Press
SP  - 393
EP  - 405
SN  - 2352-5401
UR  - https://doi.org/10.2991/978-94-6463-678-9_38
DO  - 10.2991/978-94-6463-678-9_38
ID  - Husni2025
ER  -