Zero-Shot Cross-Lingual Abstractive Sentence Summarization through Teaching Generation and Attention (P19-1)
Copied to clipboard
| Challenge: | Abstractive Sentence Summarization (ASSUM) is a monolingual task that focuses on grasping the core idea of the source sentence and presenting it as the summary. |
| Approach: | They propose to use monolingual ASSUM to train a cross-lingual ASL system . they propose to train the system on summary word generation and attention . |
| Outcome: | Experiments show that the proposed method improves on the monolingual ASSUM task. |
Similar Papers
A Robust Abstractive System for Cross-Lingual Summarization (N19-1)
Copied to clipboard
| Challenge: | We present a novel system for cross-lingual summarization that can be applied to low-resource languages. |
| Approach: | They propose a neural abstractive summarization system that can be applied to low-resource languages . they use machine translation and the New York Times summarizing corpus to create a corpus . |
| Outcome: | The proposed system achieves higher fluency than standard summarizers on translated documents . the proposed system can be easily applied to new low-resource languages . |
Multilingual Generation in Abstractive Summarization: A Comparative Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models for multilingual generation lack thorough analysis due to extensive linguistic diversity. |
| Approach: | They propose to classify multilingual generation methodologies into three categories based on their underlying modeling principles . they introduce an automatic metric to mitigate spurious correlations associated with language mixing . |
| Outcome: | The proposed model improves in high-resource, low-resourced, and zero-shot scenarios. |
Cross-Lingual Abstractive Summarization with Limited Parallel Resources (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization use limited available cross-linguistic resources. |
| Approach: | They propose a multi-task framework for cross-lingual abstractive summarization that uses a single decoder to generate monolingual and cross-linguistic summaries. |
| Outcome: | Experiments on two CLS datasets show that the proposed model outperforms baseline models in low-resource and full-dataset scenarios. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Multi-Task Learning for Cross-Lingual Abstractive Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies use pseudo cross-lingual abstractive summarization data to train neural encoder-decoders. |
| Approach: | They propose a multi-task learning framework for cross-lingual abstractive summarization that attaches a special token to the beginning of the input sentence to indicate the target task. |
| Outcome: | The proposed model achieves better performance than the model trained with only pseudo cross-lingual abstractive summarization data. |
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs (2023.acl-long)
Copied to clipboard
| Challenge: | a large-scale cross-lingual summarization dataset is available for free . a cross-linguistic summarizing model can be trained in any target language . |
| Approach: | They propose a multistage data sampling algorithm to train a cross-lingual summarization model capable of summarizing an article in any target language. |
| Outcome: | The proposed model outperforms baseline models on ROUGE and LaSE. |
Mixed-Lingual Pre-training for Cross-lingual Summarization (2020.aacl-main)
Copied to clipboard
| Challenge: | Cross-lingual summarization (CLS) aims at producing a summary in the target language for an article in the source language. |
| Approach: | They propose a mixed-lingual pre-training scheme that leverages both cross-lingual tasks such as translation and monolingual tasks like masked language models. |
| Outcome: | The proposed model improves on the translation and masked language models with no task-specific components and saves memory. |
SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization are limited due to limited training data. |
| Approach: | They propose to re-use existing multilingual summarization and translation pipelines to perform cross-lingual summaries in a sequence. |
| Outcome: | The proposed approach outperforms existing methods in many languages with only 10% of the fine-tuning samples. |
Abstractive Text Summarization Using the BRIO Training Paradigm (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing abstractive summarization models rely heavily on reference summaries and lack control over their performance. |
| Approach: | They propose a BRIO paradigm to reduce the dependence on reference summaries by fine-tuning pre-trained language models and training them with the paradigm. |
| Outcome: | The proposed paradigm outperforms existing models on Vietnamese and CNNDM datasets while maintaining the main content of the original text. |
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning (2022.acl-short)
Copied to clipboard
| Challenge: | Large multilingual pretrained language models such as mBERT and XLM-RoBERTa have been found to be effective for cross-lingual transfer of syntactic parsing models but only between related languages. |
| Approach: | They propose to use multi-task learning to dynamically optimize for parsing performance on outlier languages by using a multi-level learning approach. |
| Outcome: | The proposed method significantly outperforms uniform and size-proportional sampling in the zero-shot setting. |