Papers with GIZA++
Accurate Word Alignment Induction from Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Prior work suggests that Transformer captures poor word alignments through its attention mechanism. |
| Approach: | They propose two new word alignment induction methods that use attention weights to capture accurate word alignments. |
| Outcome: | The proposed methods outperform baselines on three publicly available datasets and are significantly better than GIZA++. |
EnerGIZAr: Leveraging GIZA++ for Effective Tokenizer Initialization (2025.findings-acl)
Copied to clipboard
| Challenge: | Continual pre-training has long been considered the default strategy for adapting models to non-English languages, but struggles with initializing new embeddings, especially for non-Latin scripts. |
| Approach: | They propose a method that leverages statistical word alignment techniques to improve continual pre-training by leveraging word alignment matrix between source and target tokens. |
| Outcome: | The proposed method outperforms existing methods on key NLP tasks including POS tagging, Sentiment Analysis, NLI, and NER in Hindi, Basque, Arabic and Korean. |
End-to-End Neural Word Alignment Outperforms GIZA++ (2020.acl-main)
Copied to clipboard
| Challenge: | Word alignment was once a core unsupervised learning task in natural language processing . but word alignment still plays an important role in interactive applications of neural machine translation, such as annotation transfer and lexicon injection. |
| Approach: | They propose to use a Transformer model to train an unsupervised word alignment model. |
| Outcome: | The proposed method outperforms GIZA++ on three data sets and is tightly integrated and does not affect translation quality. |
Using English Baits to Catch Serbian Multi-Word Terminology (L18-1)
Copied to clipboard
| Challenge: | a new method for bilingual terminology extraction is proposed for a source language and a target language. |
| Approach: | They propose to use a bilingual terminology extraction approach for a source language and a target language to extract the terminology for sri lanka. |
| Outcome: | The proposed method extracts terminology for a source language and a target language from it. |
Jointly Learning to Align and Translate with Transformer Models (D19-1)
Copied to clipboard
| Challenge: | Existing word alignment models are not accurate for word alignments. |
| Approach: | They propose a method to train a Transformer model to produce accurate translations and alignments. |
| Outcome: | The proposed model outperforms GIZA++ trained models on translation and alignment tasks while maintaining translation accuracy. |