Exploiting Sentence Order in Document Alignment (2020.emnlp-main)

Copied to clipboard

Challenge: a document alignment method that exploits sentence order information is beneficial even when the end goal is sentence-level bitext.
Approach: They propose a document alignment method that incorporates sentence order information in both candidate generation and candidate re-scoring.
Outcome: The proposed method outperforms the most recent document alignment method on Sinhala–English documents.

Similar Papers

Read Top News First: A Document Reordering Approach for Multi-Document News Summarization (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods for extracting multi-document news summarization neglect relative importance of documents.
Approach: They propose to concatenate all documents into a single meta-document and then summarize it using an SDS model.
Outcome: The proposed approach outperforms state-of-the-art methods with more complex architectures.
SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for automatic sentence alignment assume monotonic alignments, but they can handle non-monotonic alignments.
Approach: They propose a method to automatically extract parallel sentences from noisy parallel documents by embeddings and encoding each source and target sentence.
Outcome: The proposed method improves translation accuracy by 4.1 BLEU scores on English-Japanese . it can predict spans in target document from sentences in source document .
BiMax: Bidirectional MaxSim Score for Document-Level Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Document alignment is necessary for the hierarchical mining of documents across source and target languages.
Approach: They propose a cross-lingual Bidirectional Maxsim score for computing doc-to-doc similarity.
Outcome: The proposed method achieves accuracy comparable to OT with an approximate 100-fold speed increase.
The Power of Summary-Source Alignments (2024.findings-acl)

Copied to clipboard

Challenge: Multi-document summarization (MDS) is a challenging task, often decomposed to subtasks of salience and redundancy detection, followed by text generation.
Approach: They propose to extend the summary-source alignment framework by applying it at the more fine-grained proposition span level and annotating alignment manually in a multi-document setup.
Outcome: The proposed framework can yield several datasets for at least six different tasks.
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)

Copied to clipboard

Challenge: Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models.
Approach: They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key .
Outcome: The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key .
BinaryAlign: Word Alignment as Binary Sequence Labeling (2024.acl-long)

Copied to clipboard

Challenge: State-of-the-art word alignment training methods require a different class depending on the availability of gold data for a particular language pair.
Approach: They propose a novel word alignment technique based on binary sequence labeling that outperforms existing approaches in both scenarios.
Outcome: The proposed method outperforms existing models on non-English language pairs and performs stratified error analysis over alignment error type.
Massively Multilingual Document Alignment with Cross-lingual Sentence-Mover’s Distance (2020.aacl-main)

Copied to clipboard

Challenge: Document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other.
Approach: They propose an unsupervised scoring function that leverages cross-lingual sentence embeddings to compute the semantic distance between documents in different languages.
Outcome: The proposed scoring function outperforms baseline methods on high-resource language pairs, 15% on mid-resourced language pairs and 22% on low-resourcing language pairs.
Document Alignment based on Overlapping Fixed-Length Segments (2024.acl-srw)

Copied to clipboard

Challenge: Existing studies show that web crawling can be used to obtain large-scale parallel corpora for NLP tasks.
Approach: They propose a sentence-based segmentation method for document alignment . they compare it with a fixed-length segmentation technique to handle long-text encoding better.
Outcome: The proposed method improves document alignment and recall by 1% to 10% on a document alignment task for Japanese-English and French-English datasets.
Improving Cross-lingual Transfer through Subtree-aware Word Reordering (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show that multilingual language models are not effective when dealing with less-represented languages.
Approach: They propose a powerful reordering method that learns word-order patterns conditioned on the syntactic context from a small amount of annotated data.
Outcome: The proposed method outperforms baselines on a variety of tasks and is effective in both zero-shot and few-shot scenarios.
SentAlign: Accurate and Scalable Sentence Alignment (2023.emnlp-demo)

Copied to clipboard

Challenge: SentAlign is an automatic sentence alignment tool designed for large documents . it evaluates all possible alignment paths in documents of thousands of sentences .
Approach: They present a sentence alignment tool that evaluates all possible alignment paths in parallel documents of thousands of sentences and uses a divide-and-conquer approach to align documents containing tens of thousands.
Outcome: The proposed tool outperforms five other sentence alignment tools on two evaluation sets and on a downstream machine translation task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations