Challenge: Existing approaches to cross-lingual summarization use limited available cross-linguistic resources.
Approach: They propose a multi-task framework for cross-lingual abstractive summarization that uses a single decoder to generate monolingual and cross-linguistic summaries.
Outcome: Experiments on two CLS datasets show that the proposed model outperforms baseline models in low-resource and full-dataset scenarios.

Similar Papers

ACROSS: An Alignment-based Framework for Low-Resource Many-to-One Cross-Lingual Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies ignore data imbalance in multilingual settings and do not utilize monolingual data.
Approach: They propose a cross-lingual summarization model that aligns cross-linguistic data with high-resource monolingual data via contrastive and consistency loss.
Outcome: The proposed model outperforms baseline models and consistently dominates on 45 language pairs.
Multi-Task Learning for Cross-Lingual Abstractive Summarization (2022.lrec-1)

Copied to clipboard

Challenge: Existing studies use pseudo cross-lingual abstractive summarization data to train neural encoder-decoders.
Approach: They propose a multi-task learning framework for cross-lingual abstractive summarization that attaches a special token to the beginning of the input sentence to indicate the target task.
Outcome: The proposed model achieves better performance than the model trained with only pseudo cross-lingual abstractive summarization data.
Mixed-Lingual Pre-training for Cross-lingual Summarization (2020.aacl-main)

Copied to clipboard

Challenge: Cross-lingual summarization (CLS) aims at producing a summary in the target language for an article in the source language.
Approach: They propose a mixed-lingual pre-training scheme that leverages both cross-lingual tasks such as translation and monolingual tasks like masked language models.
Outcome: The proposed model improves on the translation and masked language models with no task-specific components and saves memory.
Towards Unifying Multi-Lingual and Cross-Lingual Summarization (2023.acl-long)

Copied to clipboard

Challenge: Existing work on multilingual summarization and cross-lingual summmarization has been limited due to their different definitions.
Approach: They propose to unify MLS and CLS into a more general setting, i.e. many-to-many summarization.
Outcome: The proposed model outperforms the state-of-the-art models in the zero-shot directions.
NCLS: Neural Cross-Lingual Summarization (D19-1)

Copied to clipboard

Challenge: Existing approaches to cross-lingual summarization divide the task into two steps: summarizing and translation.
Approach: They propose to integrate two related tasks into the training process of CLS under multi-task learning to improve cross-lingual summarization.
Outcome: The proposed framework improves on English-to-Chinese and Chinese-to English CLS human-corrected test sets.
CATAMARAN: A Cross-lingual Long Text Abstractive Summarization Dataset (2022.lrec-1)

Copied to clipboard

Challenge: Existing studies on cross-lingual summarization rely on pseudo-cross-lingual datasets . such an approach would lead to the loss of information in the original document and introduce noise into the summary .
Approach: They present a high-quality cross-lingual long text abstractive summarization dataset . it contains 20,000 parallel news articles and corresponding summaries written by humans .
Outcome: The proposed model outperforms monolingual systems in the cross-lingual task.
Jointly Learning to Align and Summarize for Neural Cross-Lingual Summarization (2020.acl-main)

Copied to clipboard

Challenge: Existing studies on cross-lingual summarization focus on pipeline methods and training end-to-end models.
Approach: They propose to jointly learn to align and align to train a neural cross-lingual summarization model by using a large-scale corpus.
Outcome: The proposed model outperforms competing models in most cases and can generate cross-lingual summaries without access to any cross-linguistic corpus.
Models and Datasets for Cross-Lingual Summarisation (2021.emnlp-main)

Copied to clipboard

Challenge: Recent years have witnessed increased interest in abstractive summarisation thanks to the popularity of neural network models and the availability of datasets containing hundreds of thousands of document-summary pairs.
Approach: They propose to create a cross-lingual summarisation corpus with long documents in a source language associated with multi-sentence summaries in . target language.
Outcome: The proposed task can be applied to several other languages and covers twelve languages and directions.
Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to summarize documents in multiple languages are not systematically evaluated to ensure semantic coherence across target languages.
Approach: They propose a principled re-ranking approach to ensure semantic coherence in documents in multiple target languages while ensuring semantic similarity across target languages.
Outcome: The proposed model combines the difficulties of monolingual summarization with those of machine translation, such as translation of idiomatic expressions and cultural references.
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs (2023.acl-long)

Copied to clipboard

Challenge: a large-scale cross-lingual summarization dataset is available for free . a cross-linguistic summarizing model can be trained in any target language .
Approach: They propose a multistage data sampling algorithm to train a cross-lingual summarization model capable of summarizing an article in any target language.
Outcome: The proposed model outperforms baseline models on ROUGE and LaSE.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations