| Challenge: | Sign language segmentation is a crucial task in sign language processing systems. |
| Approach: | They propose to combine two kinds of segmentation: segmentation into individual signs and segmentation to segment into phrases, larger units comprising several signs. |
| Outcome: | The proposed model is based on linguistic cues observed in sign language corpora and replaces the predominant IO tagging scheme with BIO taging to account for continuous signing. |
Similar Papers
Sign Language Video Segmentation Using Temporal Boundary Identification (2025.acl-srw)
Copied to clipboard
| Challenge: | Sign language segmentation focuses on identifying temporal boundaries within video . previous methods have relied on frame-level and phrase-level segmentation. |
| Approach: | They propose to use synchronized subtitle data to facilitate temporal boundary recognition by a sequence-to-sequence model with and without attention for subtitle boundary identification. |
| Outcome: | The proposed model outperforms baseline models on optical flow data and aligned subtitles from BOBSL and YouTube-ASL. |
Segment, Embed, and Align: A Universal Recipe for Aligning Subtitles to Signing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches for aligning spoken language text to sign language videos rely on end-to-end training tied to a specific language or dataset. |
| Approach: | They propose a universal approach for aligning spoken language text with corresponding timestamps to sign language videos using a lightweight dynamic programming procedure. |
| Outcome: | The proposed method can be used on four sign language datasets and is highly efficient on CPU. |
How to Align Multiple Signed Language Corpora for Better Sign-to-Sign Translations? (2025.naacl-long)
Copied to clipboard
| Challenge: | despite the growing need for advanced signing technologies, signed language resources remain scarce. |
| Approach: | They propose a linguistically informed alignment algorithm that matches instances between signed languages . they compare similarities and differences across three signed languages to develop a model . |
| Outcome: | The proposed algorithm performs well on automatic metrics for sign-to-sign translation and generation. |
Including Signed Languages in Natural Language Processing (2021.acl-long)
Copied to clipboard
| Challenge: | Existing research in Sign Language Processing (SLP) rarely explores signed languages . authors urge adoption of an efficient tokenization method and the collection of real-world signed language data . |
| Approach: | They propose to include signed languages as a research area with high social and scientific impact . they review the limitations of current SLP models and identify the open challenges . |
| Outcome: | The proposed model should include signed languages as a research area with high social and scientific impact. |
SignCLIP: Connecting Text and Sign Language by Contrastive Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | SignCLIP is an efficient method of learning useful visual representations for sign language processing from large-scale, multilingual video-text pairs without optimizing for a specific task or sign language of limited size. |
| Approach: | They propose a method for learning visual representations for sign language processing from large-scale video-text pairs without directly optimizing for a specific task or sign language. |
| Outcome: | The proposed model can learn from multilingual video-text pairs without optimizing for a specific task or sign language of limited size. |
Modeling Intensification for Sign Language Generation: A Computational Approach (2022.findings-acl)
Copied to clipboard
| Challenge: | End-to-end sign language generation models do not accurately represent prosody in sign language. |
| Approach: | They propose to model intensification in a data-driven manner to improve prosody in generated sign languages by modeling temporal and spatial variations. |
| Outcome: | The proposed models improve the prosody of generated sign languages by using data-driven models. |
From Words to Pixels: A Comprehensive Survey on Large Language Models in Visual Segmentation (2026.acl-long)
Copied to clipboard
| Challenge: | Visual segmentation with instruction has been a challenging task for many years . large language models and large multimodal models have spurred a new wave of research . |
| Approach: | They review recent works in LLM-based visual segmentation and analyze their architectural innovations, training strategies, and benchmark performance. |
| Outcome: | The present study reviews the most recent works in LLM-driven visual segmentation . it identifies key challenges and promising future directions . |
Subword Segmentation in LLMs: Looking at Inflection and Consistency (2024.emnlp-main)
Copied to clipboard
| Challenge: | Subword segmentation is not linguistically guided and is not currently well understood in LLMs. |
| Approach: | They group words according to their segmentation properties and compare how well a model can solve a linguistic task for these groups using two criteria: adherence to morpheme boundaries and segmentation consistency of inflected forms of a lemma. |
| Outcome: | The results show that the criterion of segmentation consistency can predict the model’s ability to recognize and generate the lemma from an inflected form, providing evidence that subword segmentation is relevant. |
SignAlignLM: Integrating Multimodal Sign Language Processing into Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Deaf and Hard-of-Hearing (DHH) users increasingly utilize Large Language Models (LLMs), yet face significant challenges due to these models’ limited understanding of sign language grammar, multimodal sign inputs, and Deafic cultural contexts. |
| Approach: | They propose to use sign language support in LLMs to integrate sign linguistic rules and conventions into prompting and fine-tuning strategies to address the needs of DHH users. |
| Outcome: | The proposed model can be generalized interfaces for both spoken and signed languages if trained with a multitasking paradigm. |
MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions for sign language production are limited due to phonological differences and data scarcity. |
| Approach: | They propose a unified framework for continuous sign language production that generates sign predictions step by step from text or speech embeddings. |
| Outcome: | The proposed model achieves competitive performance on how2sign and PHOENIX14T datasets. |