| Challenge: | Experimental results show that our proposed model outperforms all previous approaches for monolingual word alignment. |
| Approach: | They propose a neural semi-Markov CRF alignment model which unifies word and phrase alignments through variable-length spans. |
| Outcome: | The proposed model outperforms existing models on in-domain and out-of-domain evaluations and a QA-based benchmark with human annotations. |
Similar Papers
Neural CRF Model for Sentence Alignment in Text Simplification (2020.acl-main)
Copied to clipboard
| Challenge: | Text simplification systems are based on the quality and quantity of complex-simple sentence pairs extracted by aligning sentences between parallel articles. |
| Approach: | They propose a neural CRF alignment model which leverages the sequential nature of sentences in parallel documents and utilizes a sentence pair model to capture semantic similarity. |
| Outcome: | The proposed model outperforms previous work on monolingual sentence alignment task by more than 5 points in F1. |
Neural Network Alignment for Sentential Paraphrases (P19-1)
Copied to clipboard
| Challenge: | a monolingual alignment system is ill-suited for word- or short phrase-based alignments. |
| Approach: | They propose a monolingual alignment system for long, sentence- or clause-level alignments . they show that systems designed for word- or short phrase-based alignment are ill-suited for longer alignments. |
| Outcome: | The proposed system outperforms state-of-the-art systems on long alignments . it achieves significantly higher recall on aligning phrases of four or more words . |
Deep Generative Model for Joint Alignment and Word Representation (N18-1)
Copied to clipboard
| Challenge: | EmbedAlign model embeds words in their complete observed context and learns by marginalisation of latent lexical alignments. |
| Approach: | They exploit translation as a distributional context and embed words as posterior probability densities, rather than point estimates, which allows them to compare words in context using a measure of overlap between distributions. |
| Outcome: | The proposed model performs on a range of lexical semantics tasks and achieves competitive results on benchmarks including natural language inference, paraphrasing, and text similarity. |
A Discriminative Neural Model for Cross-Lingual Word Alignment (D19-1)
Copied to clipboard
| Challenge: | a novel word alignment model for machine translation has been developed for a number of languages . explicit word-to-word alignments have largely been lost in neural MT systems . |
| Approach: | They propose a discriminative word alignment model which integrates into a Transformer-based machine translation model. |
| Outcome: | The proposed model performs better on Chinese and Arabic alignments than standard models. |
Filtered Semi-Markov CRF (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for sequence labeling tasks such as Named Entity Recognition (NER) suffer from quadratic complexity over sequence length and poor performance compared to CRF. |
| Approach: | They propose a variant of Semi-Markov CRF that incorporates a filtering step to eliminate irrelevant segments, reducing complexity and search space. |
| Outcome: | The proposed method outperforms both CRF and Semi-CRF on several NER benchmarks while being significantly faster. |
Improving Word Alignment Using Semi-Supervised Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing word alignment methods rely on labeled data, but augmenting training with pseudo-labeled data improves performance. |
| Approach: | They propose a semi-supervised framework to improve word alignment methods . they use pseudo-labeled data from multilingual encoder models as word aligners . |
| Outcome: | The proposed framework outperforms the current state-of-the-art binary alignment method on word alignment datasets. |
SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for automatic sentence alignment assume monotonic alignments, but they can handle non-monotonic alignments. |
| Approach: | They propose a method to automatically extract parallel sentences from noisy parallel documents by embeddings and encoding each source and target sentence. |
| Outcome: | The proposed method improves translation accuracy by 4.1 BLEU scores on English-Japanese . it can predict spans in target document from sentences in source document . |
Probabilistic Bilingual Subword Segmentation with Latent Subword Alignment (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing methods do not consider parallel relationships, preventing translation model training. |
| Approach: | They propose a method for learning subword correspondences in parallel sentence pairs using the EM algorithm. |
| Outcome: | The proposed method improves translation accuracy for many tasks. |
Third-Party Aligner for Neural Word Alignments (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work shows that word alignment can be competitive . |
| Approach: | They propose to use word alignments generated by a third-party word aligner to supervise the neural word alignment training. |
| Outcome: | The proposed approach can find more accurate word alignments and delete wrong alignments, leading to better performance than the current best third-party word aligner. |
Mask-Align: Self-Supervised Neural Word Alignment (2021.acl-long)
Copied to clipboard
| Challenge: | Word alignment is an important task in many natural language processing tasks. |
| Approach: | They propose a self-supervised word alignment model that takes advantage of the full context on the target side. |
| Outcome: | The proposed model outperforms previous unsupervised models and obtains state-of-the-art results on four language pairs. |