Is “moby dick” a Whale or a Bird? Named Entities and Terminology in Speech Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Among rare words, named entities and domain-specific terms are crucial . previous studies have neglected these important words due to limited options . |
| Approach: | They propose a benchmark to evaluate automatic translation systems for rare words . named entities and domain-specific terms are crucial for their translation . |
| Outcome: | The proposed benchmark is based on European Parliament speeches annotated with NEs and terminology. |
Similar Papers
A Deep Analysis of the Impact of Multiword Expressions and Named Entities on Chinese-English Machine Translations (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a study on the impact of multiword expressions and multiword named entities (NEs) on the performance of Chinese-English machine translation systems is presented. |
| Approach: | They propose to use Chinese multiword expressions and multiword named entities (NEs) to evaluate machine translation performance. |
| Outcome: | The proposed methods show that Chinese-English machine translation systems perform significantly worse on Chinese sentences with most kinds of MWEs and NEs. |
CoNLL#: Fine-grained Error Analysis and a Corrected Test Set for CoNLL-03 English (2024.lrec-main)
Copied to clipboard
| Challenge: | a glass ceiling for named entity recognition systems has been suggested for 2021 . however, the performance of the most popular NER benchmarks has plateaued since then . we investigate what NER models are still struggling with . |
| Approach: | They perform a fine-grained evaluation of the model outputs by adding document annotations to the CoNLL-03 English dataset to identify lingering errors. |
| Outcome: | The proposed model is able to correct errors and guide future work. |
Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus (2020.acl-main)
Copied to clipboard
| Challenge: | a growing number of studies have examined the issue of gender bias in speech translation . a gender bias is a systemic problem that reproduces gender stereotypes discriminating women. |
| Approach: | They present the first thorough investigation of gender bias in speech translation . they compare audio technologies for English-Italian/French translations . |
| Outcome: | The proposed method compares different technologies on two languages, English and French. |
Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019) (D19-65)
Copied to clipboard
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |
Different Speech Translation Models Encode and Translate Speaker Gender Differently (2025.acl-short)
Copied to clipboard
| Challenge: | Recent studies on interpreting the hidden states of speech models have shown their ability to capture speaker-specific features, including gender. |
| Approach: | They propose to use probing methods to assess gender encoding across ST models. |
| Outcome: | The proposed models capture speaker-specific features, including gender, while older models do not . low gender encoding capabilities result in systems’ tendency toward a masculine default, a translation bias that is more pronounced in newer architectures. |
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference? (2021.acl-long)
Copied to clipboard
Luisa Bentivogli, Mauro Cettolo, Marco Gaido, Alina Karakanta, Alberto Martinelli, Matteo Negri, Marco Turchi
| Challenge: | a gap between direct approaches to speech translation (ST) and traditional cascade solutions has gradually decreased . a recent study found that the subtle differences observed in their behavior are not sufficient for humans neither to distinguish them nor to prefer one over the other. |
| Approach: | They compare state-of-the-art systems representative of the two paradigms . they find subtle differences observed in their behavior are not sufficient . |
| Outcome: | The proposed system is compared with state-of-the-art systems representative of the two paradigms. |
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations) (2026.eacl-demo)
Copied to clipboard
| Challenge: | EACL 2026 System Demonstration track received 102 submissions, almost doubling the number of submissions compared to the previous edition. |
| Approach: | 102 submissions were accepted for the EACL 2026 System Demonstration track . 44 submissions received acceptance rate of 43.1% . |
| Outcome: | the accepted papers reflect the breadth and vitality of current research in Natural Language Processing . the demonstration papers will be presented in person during the conference, including dedicated poster and demo sessions. |
Proceedings of the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts) (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | NAACL 2025 tutorial sessions are a cornerstone event of the conference . tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Approach: | NAACL 2025 will host a tutorial session on computational linguistics and natural language processing . the tutorials are a cornerstone event of the conference . |
| Outcome: | the tutorial sessions at NAACL 2025 are a cornerstone event of the conference . each submission received a thorough evaluation by a panel of two to three reviewers . |
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) (2023.acl-demo)
Copied to clipboard
| Challenge: | 58 papers were selected for inclusion in the program, while a small number received only two reviews. |
| Approach: | the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) will be held in london from July 9-14, 2023 . 58 submissions were selected for inclusion in the program, with an acceptance rate of 37%) |
| Outcome: | the system demonstration track received a record number of submissions . 58 papers were selected for inclusion in the program . |
Very Large-Scale Lexical Resources to Enhance Chinese and Japanese Machine Translation (L18-1)
Copied to clipboard
| Challenge: | A major issue in machine translation applications is the recognition and translation of named entities. |
| Approach: | They propose to integrate Very Large-Scale Lexical Resources (VLSLR) with lexicons to improve machine translation accuracy. |
| Outcome: | The proposed lexical resources can enhance the quality of MT in general and NMT systems, which currently don't use lexicons. |