| Challenge: | Existing approaches to enhance output diversity but compromise quality of outputs. |
| Approach: | They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality. |
| Outcome: | The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality. |
Similar Papers
Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) can be used to generate text data for training and evaluating other models. |
| Approach: | They propose to use logit suppression and temperature sampling to diversify text generation but at the cost of data accuracy. |
| Outcome: | The proposed approach can increase diversity but at the cost of data accuracy. |
Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown proficiency in enhancing the generation quality across various tasks without the need for any fine-tuning. |
| Approach: | They propose a method that diversifies the LLM generations while preserving their quality. |
| Outcome: | The proposed method can be used as training data to improve diversity in existing commonsense generators. |
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation (2023.findings-acl)
Copied to clipboard
Xingdi Yuan, Tong Wang, Yen-Hsiang Wang, Emery Fine, Rania Abdelghani, Hélène Sauzéon, Pierre-Yves Oudeyer
| Challenge: | Large Language Models (LLMs) have demonstrated impressive prowess in natural language generation. |
| Approach: | They propose a method to select high-quality questions from LLM-generated candidates using round-trip and prompt-based scoring. |
| Outcome: | The proposed approach can select high-quality questions from a set of LLM-generated candidates without modification of the underlying model nor rely on human annotations. |
Exploring Precision and Recall to assess the quality and diversity of LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for large language models are limited to specific tasks, but they are now widely available for a wide range of tasks. |
| Approach: | They propose a framework for large language models such as Llama-2 and Mistral that imports precision and recall metrics from image generation to text generation. |
| Outcome: | The proposed framework allows for a nuanced assessment of the quality and diversity of generated text without the need for aligned corpora. |
From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) often output text at a native level of speech, making them difficult to use for contexts where end-users are not fully proficient. |
| Approach: | They propose a framework to control the difficulty level of text generated by Large Language Models for contexts where end-users are not fully proficient. |
| Outcome: | The proposed framework surpasses GPT-4 and other models at fraction of the cost. |
A Plug-and-Play Method for Controlled Text Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for controlling language generation are not able to produce fluent text . current methods require additional models or fine-tuning to ensure specific words are included . |
| Approach: | They propose a plug-and-play decoding method that allows for controlled language generation . they add a shift in the probability distribution over our vocabulary towards semantically similar words . |
| Outcome: | The proposed method outperforms competing methods in human evaluations and does not impact fluency. |
Balancing Diversity and Risk in LLM Sampling: How to Select Your Method and Parameter for Open-Ended Text Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that sampling-based decoding strategies can be used to optimize the output of Large Language Models (LLMs) . previous studies have shown that likelihood-maximization produces degenerate text which contains repetitive loops and incoherent context, especially in open-ended tasks. |
| Approach: | They propose to use a prefix tree to estimate the intrinsic capacity of a truncation sampling method by considering the trade-off between diversity and risk at each decoding step. |
| Outcome: | The proposed method is based on a prefix tree which preserves the context of a full sentence. |
A Simple but Effective Approach to Improve Structured Language Model Output for Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have impressive abilities in generating unstructured natural language . performance inconsistent when tasked with producing text that adheres to structured formats . |
| Approach: | They propose a method to generate unstructured natural language using intermediate responses . they use the intermediate responses to organize the output into the desired structure . |
| Outcome: | The proposed method improves performance on NER and RE tasks with minimal effort. |
VOYAGER: A Training Free Approach for Generating Diverse Datasets using LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used to generate synthetic datasets but lack diversity . prior work has noted that such generated data lacks diversity - a problem that requires domain expertise. |
| Approach: | They propose a principled approach that optimizes a mathematical quantity that optimize the diversity of the dataset using determinantal point processes. |
| Outcome: | The proposed method improves diversity by 1.5-3 times compared to baseline approaches. |
Improving Cross-Domain Low-Resource Text Generation through LLM Post-Editing: A Programmer-Interpreter Approach (2024.findings-eacl)
Copied to clipboard
| Challenge: | Large pre-trained language models such as GPT-3.5 and GPT-4 have gained significant attention in natural language research due to limited computational resources or inaccessible parameters. |
| Approach: | They propose a neural programmer-interpreter approach that preserves the domain generalization ability of LLMs while editing their output. |
| Outcome: | The proposed framework significantly improves GPT-3.5’s performance in logical form-to-text conversion and low-resource machine translation, surpassing other state-of-the-art (SOTA) LLM post-editing methods in cross-domain settings. |