SentBS: Sentence-level Beam Search for Controllable Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Structure-controlled summarization is a useful and interesting research direction . current structure-controlling methods have limited effectiveness in enforcing the desired structure. |
| Approach: | They propose a sentence-level beam search generation method to select suitable sentences for subsequent generations. |
| Outcome: | The proposed method significantly reduces structural discrepancies by 68% on a structure-controlled dataset. |
Similar Papers
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | a new text generation dataset is needed to controllable text summarization, but it lacks the domain knowledge. |
| Approach: | They propose to use existing text generation datasets to leverage input and control signals . they propose to annotate each meta-review sentence manually with a control signal . |
| Outcome: | The proposed method can be used to control the structure of a text generation dataset . it can be applied to a variety of tasks, including a task with a large number of meta-review sentences . |
Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects - A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | scholarly attention has turned to the development of text summarization methods that are more closely tailored and controlled to align with specific objectives and user needs. |
| Approach: | They formalize a controllable text summarization task and categorize controllability attributes according to their shared characteristics and objectives. |
| Outcome: | The proposed method is tailored to meet the specific intent and needs of users. |
Plan-then-Generate: Controlled Data-to-Text Generation via Planning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on producing results that are close to the references, i.e. what to generate and in what order (the output structure) cannot be explicitly controlled by the users. |
| Approach: | They propose a Plan-then-Generate framework to improve the controllability of neural data-to-text models. |
| Outcome: | The proposed model can control both the intra-sentence and inter-sentent structure of the generated output. |
Learning Sentence Representations over Tree Structures for Target-Dependent Classification (N18-1)
Copied to clipboard
| Challenge: | Existing work on tree structures uses syntactic parsers or Treebank annotations to perform target-dependent classifications. |
| Approach: | They propose a reinforcement learning based approach which automatically induces target-specific sentence representations over tree structures. |
| Outcome: | The proposed model gives superior performance on two benchmark tasks compared to previous work on parsed trees . |
HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models that treat texts as linear sequences do not include hierarchical structure information. |
| Approach: | They propose to inject hierarchical structure information into an extractive summarization model by combining hierarchically structured text with a pre-trained Transformer language model. |
| Outcome: | The proposed model outperforms a baseline model on PubMed and arXiv datasets and the hierarchical structure information is not injected. |
Generating Summaries with Controllable Readability Levels (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current text generation approaches focus on a specific readability level, resulting in texts that are not customized to readers’ proficiency levels. |
| Approach: | They propose to generate summaries with fine-grained control over their readability by using instruction-based readability control, reinforcement learning and lookahead to estimate readability of upcoming decoding steps. |
| Outcome: | The generated summaries with different readability levels were compared with previous methods that focus on a specific readability level (e.g., lay summarization) and a lookahead approach significantly improved readability control on news summarizing. |
Select and Attend: Towards Controllable Content Selection in Text Generation (D19-1)
Copied to clipboard
| Challenge: | Recent neural network models conflate content selection and surface realization into a black-box architecture, resulting in content to be described in text cannot be explicitly controlled. |
| Approach: | They propose to decouple content selection from the decoder to allow finer-grained control over the generation. |
| Outcome: | The proposed model can be trained end-to-end without human annotations and achieves promising results in data-totext and headline generation tasks. |
Generating Summaries with Topic Templates and Structured Convolutional Decoders (P19-1)
Copied to clipboard
| Challenge: | Existing neural generation approaches create multi-sentence text as a single sequence . Existing approaches create multiple sentences as if they were a sequence based on content structure . |
| Approach: | They propose a structured convolutional decoder that is guided by the content structure of target summaries. |
| Outcome: | The proposed model outperforms existing decoders on three datasets representing different domains. |
Generating Diverse Story Continuations with Controllable Semantics (D19-56)
Copied to clipboard
| Challenge: | a new framework for controllable story continuation generation is proposed . we use frames to generate story continuations based on sentence attributes . |
| Approach: | They propose a framework for controlled generation of multiple, diverse outputs . they use sentiment, length, predicates, frames, and automatically-induced clusters as controllable dimensions . |
| Outcome: | The proposed model produces outputs that match target attributes, the authors show . it also yields higher metric scores than previous models, they show ." |
StructSum: Summarization via Structured Representations (2021.eacl-main)
Copied to clipboard
Vidhisha Balachandran, Artidoro Pagnoni, Jay Yoon Lee, Dheeraj Rajagopal, Jaime Carbonell, Yulia Tsvetkov
| Challenge: | Abstractive summarization models overfit to training corpora, lack of transparency and layout bias . authors propose incorporating latent and explicit dependencies across sentences in source document . |
| Approach: | They propose a framework based on document-level structure induction to address layout bias and lack of transparency in abstractive summarization models. |
| Outcome: | The proposed framework improves coverage of content in the source documents and generates more abstractive summaries by generating more novel n-grams. |