Jointly Learning to Align and Summarize for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual summarization focus on pipeline methods and training end-to-end models. |
| Approach: | They propose to jointly learn to align and align to train a neural cross-lingual summarization model by using a large-scale corpus. |
| Outcome: | The proposed model outperforms competing models in most cases and can generate cross-lingual summaries without access to any cross-linguistic corpus. |
Similar Papers
Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual summarization are pipeline-based, but they suffer from error propagation. |
| Approach: | They propose a method that attends to some words in the source text, then translates them into the target language to get the final summary. |
| Outcome: | The proposed method outperforms baseline methods on Chinese-to-English and English-to Chinese summarization tasks. |
Mixed-Lingual Pre-training for Cross-lingual Summarization (2020.aacl-main)
Copied to clipboard
| Challenge: | Cross-lingual summarization (CLS) aims at producing a summary in the target language for an article in the source language. |
| Approach: | They propose a mixed-lingual pre-training scheme that leverages both cross-lingual tasks such as translation and monolingual tasks like masked language models. |
| Outcome: | The proposed model improves on the translation and masked language models with no task-specific components and saves memory. |
NCLS: Neural Cross-Lingual Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization divide the task into two steps: summarizing and translation. |
| Approach: | They propose to integrate two related tasks into the training process of CLS under multi-task learning to improve cross-lingual summarization. |
| Outcome: | The proposed framework improves on English-to-Chinese and Chinese-to English CLS human-corrected test sets. |
Models and Datasets for Cross-Lingual Summarisation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent years have witnessed increased interest in abstractive summarisation thanks to the popularity of neural network models and the availability of datasets containing hundreds of thousands of document-summary pairs. |
| Approach: | They propose to create a cross-lingual summarisation corpus with long documents in a source language associated with multi-sentence summaries in . target language. |
| Outcome: | The proposed task can be applied to several other languages and covers twelve languages and directions. |
A Survey on Cross-Lingual Summarization (2022.tacl-1)
Copied to clipboard
| Challenge: | Cross-lingual summarization is a task of generating a summary in one language for a given document in a different language. |
| Approach: | They present a systematic review of the literature on cross-lingual summarization . they summarize previous efforts and compare them with each other . |
| Outcome: | The proposed approach is compared with previous approaches and summarizes them to provide a deeper analysis. |
Multi-Task Learning for Cross-Lingual Abstractive Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies use pseudo cross-lingual abstractive summarization data to train neural encoder-decoders. |
| Approach: | They propose a multi-task learning framework for cross-lingual abstractive summarization that attaches a special token to the beginning of the input sentence to indicate the target task. |
| Outcome: | The proposed model achieves better performance than the model trained with only pseudo cross-lingual abstractive summarization data. |
Contrastive Aligned Joint Learning for Multilingual Summarization (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing summarization systems for multilingual text summarizing are limited due to the lack of large-scale data in multiple languages. |
| Approach: | They propose a multilingual summarization system that can understand documents in multiple languages and generate summaries in the corresponding language. |
| Outcome: | The proposed model improves over monolingual models in all languages and transferable to other languages. |
ACROSS: An Alignment-based Framework for Low-Resource Many-to-One Cross-Lingual Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies ignore data imbalance in multilingual settings and do not utilize monolingual data. |
| Approach: | They propose a cross-lingual summarization model that aligns cross-linguistic data with high-resource monolingual data via contrastive and consistency loss. |
| Outcome: | The proposed model outperforms baseline models and consistently dominates on 45 language pairs. |
Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies show that multilingual generative models exhibit a strong language bias toward high-resource languages. |
| Approach: | They propose a cross-lingual alignment framework exploiting pairs of translation sentences to improve cross-linguistic abilities. |
| Outcome: | The proposed framework improves cross-lingual abilities and mitigates performance gap. |
Towards Unifying Multi-Lingual and Cross-Lingual Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on multilingual summarization and cross-lingual summmarization has been limited due to their different definitions. |
| Approach: | They propose to unify MLS and CLS into a more general setting, i.e. many-to-many summarization. |
| Outcome: | The proposed model outperforms the state-of-the-art models in the zero-shot directions. |