Combining the user friendliness of SignWriting with the precision of linguistic parameters

Authors Antonio F. G. Sevilla
José María Lahoz-Bengoechea
Sandra Conde González
Alberto Díaz Esteban
Pablo Folgueira Galán
Julia de la Calle Pérez
Published SLTAT 2025: 9th Workshop on Sign Language Translation and Avatar Technologies
Keywords Sign Language, SignWriting, NLP, Computer Vision
Abstract This paper presents TraduSE, a Progressive Web Application designed to bridge the gap between the user-friendliness of SignWriting and the precision required for sign language processing tasks. Capturing sign language complexity is crucial, but parameter-based approaches often have a steep learning curve and require specialized tools. SignWriting offers a more accessible alternative for representing signs, and TraduSE addresses the challenge of making linguistically well-informed systems accessible to signers, learners, and researchers by using SignWriting as an input for a native sign language dictionary: the Spanish Sign Language Signary.It does so by allowing users to upload or draw SignWriting images, which are recognized by an existing artificial vision pipeline. The SignWriting elements found are then converted into a parametric description, recovering along the way the 3D signing space information from the 2D SignWriting. Finally, the resulting parameters are used to search the Spanish Sign Language Signary. Fuzzy matching allows for error resilience and finding similar tokens, enabling users to locate signs even with incomplete or imprecise information. Search results are presented as videos and Spanish glosses, while also displaying and explaining the linguistic parameters, serving as a didactic tool.Our approach not only provides a crucial bridge between visual sign representation and precise linguistic analysis, widening the reach of sign language research, but also demonstrates flexibility in handling the inherent fuzziness and potential errors in everyday language use and user input.
Citation
@inproceedings{sevilla_combining_2025,
    series = {{IVA} {Adjunct} '25},
    title = {Combining the user friendliness of {SignWriting} with the precision of linguistic parameters},
    isbn = {979-8-4007-1996-7},
    url = {https://dl.acm.org/doi/10.1145/3742886.3756740},
    doi = {10.1145/3742886.3756740},
    urldate = {2025-10-03},
    booktitle = {Adjunct {Proceedings} of the 25th {ACM} {International} {Conference} on {Intelligent} {Virtual} {Agents}},
    publisher = {Association for Computing Machinery},
    author = {Sevilla, Antonio F. G. and Lahoz-Bengoechea, José María and Conde González, Sandra and Diaz Esteban, Alberto and Folgueira Galán, Pablo and de la Calle Pérez, Julia},
    month = sep,
    year = {2025},
    pages = {1--6},
}
Links Full text at ACM Digital Library
Full text PDF (hosted here)
SLTAT'25 poster (HTML)
SLTAT'25 poster (PDF)