Guided by the Plan: Enhancing Faithful Autoregressive Text-to-Audio Generation with Guided Decoding (2026.eacl-long)
Copied to clipboard
| Challenge: | Autoregressive (AR) models excel at generating temporally coherent audio by producing tokens sequentially, yet they often falter in faithfully following complex textual prompts. |
| Approach: | They propose a lightweight auxiliary model trained with a GAE-inspired objective to predict final instruction-following quality from partial generations. |
| Outcome: | The proposed model achieves 10 points improvement in CLAP score over baseline AR models while maintaining computational parity with best-of-N decoding. |
Similar Papers
PlanRAG-Audio: Planning and Retrieval Augmented Generation for Long-form Audio Understanding (2026.findings-acl)
Copied to clipboard
Masao Someki, Chien-yu Huang, Siddhant Arora, Samuele Cornell, Markus Müller, Nathan Susanj, Rupak Vignesh Swaminathan, Grant Strimel, Jing Liu, Shinji Watanabe
| Challenge: | Long-form audio understanding poses significant challenges due to the extreme length of audio sequences and the need to reason over heterogeneous acoustic cues distributed over time. |
| Approach: | They propose a retrieval-augmented generation framework for scalable long-form audio understanding . planRAG-Audio explicitly plans which modalities and temporal spans are required for a given query . |
| Outcome: | Experiments show that planRAG-Audio reduces the length of inputs for long-form audio models . the proposed framework can efficiently reason over long-term speech data . |
Plan-then-Generate: Controlled Data-to-Text Generation via Planning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on producing results that are close to the references, i.e. what to generate and in what order (the output structure) cannot be explicitly controlled by the users. |
| Approach: | They propose a Plan-then-Generate framework to improve the controllability of neural data-to-text models. |
| Outcome: | The proposed model can control both the intra-sentence and inter-sentent structure of the generated output. |
Plan-then-Seam: Towards Efficient Table-to-Text Generation (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent work explicitly decomposes the generation process into content planning and surface generation stages, employing two autoregressive networks for them respectively. |
| Approach: | They propose a non-parallelelizable table-to-text model that produces outputs in parallel with one network. |
| Outcome: | The proposed model achieves 3.0 5.6 times speedup for inference time, reducing 50% parameters, while maintaining as least comparable performance against strong two-stage table-to-text competitors. |
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback (2025.acl-long)
Copied to clipboard
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
| Challenge: | Text-to-audio (T2A) models still struggle to satisfy human preferences for prompt-following and acoustic quality when generating complex multi-event audio. |
| Approach: | They propose to use AI feedback learning to enhance basic capabilities of text-to-audio models . they use a large audio preference dataset to evaluate the model's capabilities . |
| Outcome: | The proposed model improves in simple and complex scenarios with AI feedback learning. |
Data-to-text Generation with Variational Sequential Planning (2022.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in data-to-text generation have greatly facilitated the task of generating textual output from non-linguistic input. |
| Approach: | They propose a neural model enhanced with a planning component responsible for organizing high-level information in a coherent and meaningful way. |
| Outcome: | The proposed model outperforms baseline models and is sample-efficient in the face of limited training data. |
Data-to-text Generation with Macro Planning (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation adopt the encoder-decoder architecture . however, these models perform poorly at selecting appropriate content and ordering it coherently . |
| Approach: | They propose a neural model with a macro planning stage followed by a generation stage . they use data from databases of records, simulations of physical systems, accounting spreadsheets . |
| Outcome: | The proposed model outperforms baselines on two data-to-text benchmarks . it uses the encoderdecoder architecture and is compared with existing models . |
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing non-AutoRegressive (NAR) text generation models lack proper pre-training, making them far behind pre-trained autoregressive models. |
| Approach: | They propose a novel pre-training task to promote prediction consistency in non-autoregressive (NAR) generation. |
| Outcome: | The proposed model outperforms existing pre-trained models and achieves 17 times speedup in throughput. |
Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generation (N19-1)
Copied to clipboard
| Challenge: | Modern neural generation systems conflate these two steps into a single end-to-end differentiable system. |
| Approach: | They propose to split the generation process into a symbolic text-planning stage that is faithful to the input, followed by a neural generation stage that focuses only on realization. |
| Outcome: | The proposed method improves reliability and adequacy while maintaining fluent output. |
Improving Adversarial Text Generation by Modeling the Distant Future (2020.acl-main)
Copied to clipboard
Ruiyi Zhang, Changyou Chen, Zhe Gan, Wenlin Wang, Dinghan Shen, Guoyin Wang, Zheng Wen, Lawrence Carin
| Challenge: | Recent work has shown excellent performance on text generation tasks by combining reinforcement learning (RL) and generative models. |
| Approach: | They propose a model-based imitation-learning approach to improve text generation performance by focusing on a long horizon. |
| Outcome: | The proposed model improves on a number of text-generation tasks and provides intermediate rewards for generator optimization. |
G2: Guided Generation for Enhanced Output Diversity in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to enhance output diversity but compromise quality of outputs. |
| Approach: | They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality. |
| Outcome: | The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality. |