DSpace Repository

Continuous Sign Language Recognition and Its Translation into Intonation-Colored Speech

Show simple item record

dc.contributor.author Amangeldy, Nurzada
dc.contributor.author Ukenova, Aru
dc.contributor.author Bekmanova, Gulmira
dc.contributor.author Razakhova, Bibigul
dc.contributor.author Milosz, Marek
dc.contributor.author Kudubayeva, Saule
dc.date.accessioned 2024-09-11T06:02:03Z
dc.date.available 2024-09-11T06:02:03Z
dc.date.issued 2023
dc.identifier.citation Amangeldy, N.; Ukenova, A.; Bekmanova, G.; Razakhova, B.; Milosz, M.; Kudubayeva, S. Continuous Sign Language Recognition and Its Translation into Intonation-Colored Speech. Sensors 2023, 23, 6383. https://doi.org/ 10.3390/s23146383 ru
dc.identifier.issn 1424-8220
dc.identifier.other doi.org/10.3390/s23146383
dc.identifier.uri http://rep.enu.kz/handle/enu/16193
dc.description.abstract This article is devoted to solving the problem of converting sign language into a consistent text with intonation markup for subsequent voice synthesis of sign phrases by speech with intonation. The paper proposes an improved method of continuous recognition of sign language, the results of which are transmitted to a natural language processor based on analyzers of morphology, syntax, and semantics of the Kazakh language, including morphological inflection and the construction of an intonation model of simple sentences. This approach has significant practical and social significance, as it can lead to the development of technologies that will help people with disabilities to communicate and improve their quality of life. As a result of the cross-validation of the model, we obtained an average test accuracy of 0.97 and an average val_accuracy of 0.90 for model evaluation. We also identified 20 sentence structures of the Kazakh language with their intonational model. ru
dc.language.iso en ru
dc.publisher Sensors ru
dc.relation.ispartofseries Volume 23;Issue 14
dc.subject sign language recognition ru
dc.subject natural language processing ru
dc.subject intonational speech synthesis ru
dc.subject long short-term memory ru
dc.subject spatiotemporal features ru
dc.title Continuous Sign Language Recognition and Its Translation into Intonation-Colored Speech ru
dc.type Article ru


Files in this item

This item appears in the following Collection(s)

Show simple item record

Search DSpace


Browse

My Account