Challenge: Simultaneous interpretation data is a task where an utterance is translated in real-time.
Approach: They propose to use an automatically-aligned parallel English-Japanese SI dataset to make it suitable for model training.
Outcome: The proposed model improves translation quality and latency over baselines.

Similar Papers

Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair (2024.emnlp-main)

Copied to clipboard

Challenge: Existing siMT corpora are limited due to high costs and limited annotator capabilities.
Approach: They propose a method to convert ST corpora into interpretation-style corpors by fine-tuning models with Large Language Models.
Outcome: The proposed method reduces latency while achieving better quality compared to other models.
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)

Copied to clipboard

Challenge: Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models.
Approach: They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key .
Outcome: The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key .
Parallel Text Alignment and Monolingual Parallel Corpus Creation from Philosophical Texts for Text Simplification (2021.naacl-srw)

Copied to clipboard

Challenge: Existing methods for text simplification require a lot of annotated data, however there are few suitable tools for this task.
Approach: They propose an unsupervised method for aligning text based on Doc2Vec embeddings and an alignment algorithm capable of aligning texts at different levels.
Outcome: The proposed method can be used to create a monolingual parallel corpus composed of the works of early modern philosophers and their corresponding simplified versions.
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for pretraining cross-lingual models are limited in their size due to the limited amount of parallel corpora.
Approach: They propose a method that encourages the model to align multiple languages with monolingual corpora to overcome the constraint of the parallel corpus size.
Outcome: The proposed method outperforms existing cross-lingual models and delivers new state-of-the-art results in various cross-linguistic downstream tasks.
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment (2022.emnlp-main)

Copied to clipboard

Challenge: Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality.
Approach: They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model.
Outcome: The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs.
JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpus (2020.lrec-1)

Copied to clipboard

Challenge: Recent machine translation algorithms rely on parallel corpora, but only some resource-rich language pairs can benefit from them.
Approach: They construct a parallel corpus for English-Japanese, which has 8.7 million sentence pairs . they use a web crawler to automatically align parallel sentences in the corpus .
Outcome: The proposed corpus includes a broader range of domains and can be trained with a pre-trained model.
Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies show that multilingual generative models exhibit a strong language bias toward high-resource languages.
Approach: They propose a cross-lingual alignment framework exploiting pairs of translation sentences to improve cross-linguistic abilities.
Outcome: The proposed framework improves cross-lingual abilities and mitigates performance gap.
SimAlign: High Quality Word Alignments Without Parallel Training Data Using Static and Contextualized Embeddings (2020.findings-emnlp)

Copied to clipboard

Challenge: Word alignments are useful for statistical and neural machine translation (NMT) and cross-lingual annotation projection.
Approach: They propose to leverage multilingual word embeddings for word alignment.
Outcome: The proposed methods perform better for four languages and comparable for two languages than traditional statistical aligners even with abundant parallel data.
CATS: A Tool for Customized Alignment of Text Simplification Corpora (L18-1)

Copied to clipboard

Challenge: Existing corpora of original sentences and their manual simplifications are very scarce and small in size, hindering automated text simplification systems.
Approach: They propose a language-independent tool for sentence alignment from parallel/comparable TS resources.
Outcome: The proposed tool performs well on English and Spanish corpora and compares sentences based on their semantic overlap.
Effectively Aligning and Filtering Parallel Corpora under Sparse Data Conditions (2020.acl-srw)

Copied to clipboard

Challenge: Parallel corpora are key to developing good machine translation systems, but abundant parallel data is hard to come by for languages with a low number of speakers.
Approach: They propose an unsupervised alignment method that can handle rich morphology by removing incorrect translations and segments containing extraneous data.
Outcome: The proposed method maximizes the number of correctly translated segments in a corpus and minimises noise by removing incorrect translations and segments containing extraneous data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations