Abstract |
This paper presents TraduSE, a Progressive Web Application designed to
bridge the gap between the user-friendliness of SignWriting and the
precision required for sign language processing tasks. Capturing sign
language complexity is crucial, but parameter-based approaches often have a
steep learning curve and require specialized tools. SignWriting offers a
more accessible alternative for representing signs, and TraduSE addresses
the challenge of making linguistically well-informed systems accessible to
signers, learners, and researchers by using SignWriting as an input for a
native sign language dictionary: the Spanish Sign Language Signary.It does
so by allowing users to upload or draw SignWriting images, which are
recognized by an existing artificial vision pipeline. The SignWriting
elements found are then converted into a parametric description, recovering
along the way the 3D signing space information from the 2D SignWriting.
Finally, the resulting parameters are used to search the Spanish Sign
Language Signary. Fuzzy matching allows for error resilience and finding
similar tokens, enabling users to locate signs even with incomplete or
imprecise information. Search results are presented as videos and Spanish
glosses, while also displaying and explaining the linguistic parameters,
serving as a didactic tool.Our approach not only provides a crucial bridge
between visual sign representation and precise linguistic analysis, widening
the reach of sign language research, but also demonstrates flexibility in
handling the inherent fuzziness and potential errors in everyday language
use and user input.
|
Citation |
@inproceedings{sevilla_combining_2025,
series = {{IVA} {Adjunct} '25},
title = {Combining the user friendliness of {SignWriting} with the precision of linguistic parameters},
isbn = {979-8-4007-1996-7},
url = {https://dl.acm.org/doi/10.1145/3742886.3756740},
doi = {10.1145/3742886.3756740},
urldate = {2025-10-03},
booktitle = {Adjunct {Proceedings} of the 25th {ACM} {International} {Conference} on {Intelligent} {Virtual} {Agents}},
publisher = {Association for Computing Machinery},
author = {Sevilla, Antonio F. G. and Lahoz-Bengoechea, José María and Conde González, Sandra and Diaz Esteban, Alberto and Folgueira Galán, Pablo and de la Calle Pérez, Julia},
month = sep,
year = {2025},
pages = {1--6},
}
|