Not What a Child Expressed: Auditing the Sign-to-Text Safety Interface in Child-Facing AI

arXiv:2610.07519 · cs.CL, cs.CR, cs.CY · Submitted 2026-10-05 · Read on arXiv

cs.CL, cs.CR, cs.CY

Submitted: 2026-10-05

Updated: 2026-10-05

Comments: 5 pages, 1 figure. Accepted as a poster at the NeurIPS 2026 Workshop on Child Safety in AI (non-archival)

License: http://creativecommons.org/licenses/by/4.0/

The gist: Automatic sign language translation (SLT) has entered consumer products, turning American Sign Language into English text for dictation, messaging, and queries put to a conversational assistant.

Abstract

Automatic sign language translation (SLT) has entered consumer products, turning American Sign Language into English text for dictation, messaging, and queries put to a conversational assistant. Child-facing AI and platform trust-and-safety tooling decide on text, using filters on minor accounts and grooming classifiers that score chat messages. A signing child who uses SLT therefore reaches these safeguards through a translation. We found no publicly documented system in which the two have been jointly evaluated, and the leading deployed SLT model was neither trained nor formally evaluated on signers under 18. Errors that alter negation, participant roles, secrecy, urgency or help-seeking could change a safety decision without disturbing fluency. This paper proposes a Deaf-informed pre-deployment audit of that boundary, with a failure taxonomy, a sanitised scenario schema, four comparison conditions, and four outcome measures. Auslan is the planned first case study.

Sources

Related papers