| Challenge: | Sign Language Production (SLP) is the process of converting complex input text into a real video. |
| Approach: | They propose a new sign language generative model that streamlines redundant structure and optimizes the task objective. |
| Outcome: | The proposed model streamlines redundant structure and optimizes objective . it generates high-quality and multi-style sign language videos with hand gestures . |
Similar Papers
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing vision-based sign language production approaches suffer from out-of-vocabulary (OOV) and test-time generalization problems. |
| Approach: | They propose an avatar-based sign language production system that generates sign language videos from spoken language expressions. |
| Outcome: | The proposed system achieves higher BLEU-4 and higher ROUGE-L scores on a new Korean-Korean sign language dataset. |
Hybrid Autoregressive-Diffusion Model for Real-Time Sign Language Production (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to sign language production use autoregressive or diffusion models that generate one-by-one output tokens but suffer from exposure bias during inference. |
| Approach: | They propose a hybrid autoregressive-diffusion model that combines iterative refinement and sequential dependency modeling for Sign Language production. |
| Outcome: | The proposed model improves sign language production quality and real-time efficiency on PHOENIX14T and How2Sign. |
Modeling Intensification for Sign Language Generation: A Computational Approach (2022.findings-acl)
Copied to clipboard
| Challenge: | End-to-end sign language generation models do not accurately represent prosody in sign language. |
| Approach: | They propose to model intensification in a data-driven manner to improve prosody in generated sign languages by modeling temporal and spatial variations. |
| Outcome: | The proposed models improve the prosody of generated sign languages by using data-driven models. |
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model (2025.acl-short)
Copied to clipboard
| Challenge: | Existing studies focus on translating a single SL into a spoken language (one-to-one SLT) however, multilingual SLT remains unexplored due to language conflicts and alignment difficulties across SLs and spoken languages. |
| Approach: | They propose a multilingual gloss-free model that can be used to translate a single SL into a spoken language and generate a token-level SL identification and spoken text. |
| Outcome: | The proposed model supports 10 SLs and handles one-to-one, many-to-1, and many- to-many SLT tasks. |
Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sign Language Translation evaluations remain largely signer-dependent, with overlapping signers across train/dev/test. |
| Approach: | We conduct signer-fold cross-validation on three leading SLT models . they find that under signer independent evaluation performance drops sharply . |
| Outcome: | a signer-dependent evaluation can substantially overestimate SLT capability, the authors say . they recommend adopting signer independent protocols to ensure generalisation to unseen signers . |
WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language (2022.acl-short)
Copied to clipboard
| Challenge: | Signed Language Processing (SLP) is a major form of NLP, but has been overlooked by the NLP community. |
| Approach: | They leverage existing resources to construct a large-scale dataset of American Sign Language signs annotated with six different phonological properties. |
| Outcome: | The proposed model outperforms existing approaches on signs unobserved during training. |
MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions for sign language production are limited due to phonological differences and data scarcity. |
| Approach: | They propose a unified framework for continuous sign language production that generates sign predictions step by step from text or speech embeddings. |
| Outcome: | The proposed model achieves competitive performance on how2sign and PHOENIX14T datasets. |
Signer Diversity-driven Data Augmentation for Signer-Independent Sign Language Translation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for sign language translation (SLT) rely on signer identity labels, which is often impractical and costly in real-world applications. |
| Approach: | They propose a signer diversity-driven data augmentation method that can generalize to signers not encountered during training. |
| Outcome: | The proposed method achieves state-of-the-art results without relying on signer identity labels. |
Think in Latent Thoughts: A New Paradigm for Gloss-Free Sign Language Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to sign language translation (SLT) assume video segments are directly mappable to spoken-language words. |
| Approach: | They propose a reasoning-driven SLT framework that uses an ordered sequence of latent thoughts as an explicit middle layer between video and generated text. |
| Outcome: | The proposed model improves coherence and faithfulness over existing gloss-free methods. |
PoseStitch-SLT: Linguistically Inspired Pose-Stitching for End-to-End Sign Language Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Sign language translation remains a challenging task due to the scarcity of large-scale, sentence-aligned datasets. |
| Approach: | They propose a pose-based pre-training scheme that is inspired by a linguistic-templates-based sentence generation technique. |
| Outcome: | The proposed pre-training scheme outperforms state-of-the-art methods for pose-based gloss-free translation on two sign language datasets. |