Papers with CNNDM
Abstractive Text Summarization Using the BRIO Training Paradigm (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing abstractive summarization models rely heavily on reference summaries and lack control over their performance. |
| Approach: | They propose a BRIO paradigm to reduce the dependence on reference summaries by fine-tuning pre-trained language models and training them with the paradigm. |
| Outcome: | The proposed paradigm outperforms existing models on Vietnamese and CNNDM datasets while maintaining the main content of the original text. |
Prompt-Based Length Controlled Generation with Multiple Control Types (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing length control methods focus on a simple control type of “equal to” a target length. |
| Approach: | They propose a prompt-based method to achieve length controlled generation under different control types with high accuracy by using reinforcement learning and sample filtering with the reward signal given by rule-based reward models. |
| Outcome: | The proposed method significantly improves the accuracy of prompt-based length control on popular summarization datasets like CNNDM and NYT under multiple control types. |
Improving Copy-oriented Text Generation via EDU Copy Mechanism (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing extractive models generate texts through word-by-word decoding, causing factual inconsistencies and slow inference. |
| Approach: | They propose a framework that integrates the behavior of copying EDUs into generative models. |
| Outcome: | The proposed framework reduces the number of generated tokens significantly. |
Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | a low-resource natural language generation task requires a large number of examples to generate outputs and outputs. |
| Approach: | They propose a teacher-student pipeline that synthesizes accurate input–output pairs without human labels or parallel data. |
| Outcome: | The proposed pipeline synthesizes accurate input–output pairs without human labels or parallel data. |