Can LLMs Speak For Diverse People? Tuning LLMs via Debate to Generate Controllable Controversial Statements (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack sufficient controllability to generate statements supporting diverse or even controversial perspectives. |
| Approach: | They develop a pipeline that fine tunes LLMs to generate statements generated via debate. |
| Outcome: | The proposed pipeline improves the controllability of LLMs in generating statements supporting an argument the user defined in the prompt. |
Similar Papers
LLM Tropes: Revealing Fine-Grained Values and Opinions in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to evaluate latent values and opinions in large language models suffer from three notable shortcomings. |
| Approach: | They propose to analyze 156k LLM responses to 62 propositions of the Political Compass Test (PCT) generated by 6 LLMs using 420 prompt variations. |
| Outcome: | The proposed analysis of 156k LLM responses to the Political Compass Test (PCT) generated by 6 LLMs shows that tropes are recurrent and consistent across prompts. |
DebateCoder: Towards Collective Intelligence of LLMs via Test Case Driven LLM Debate for Code Generation (2025.acl-long)
Copied to clipboard
Jizheng Chen, Kounianhua Du, Xinyi Dai, Weiming Zhang, Xihuai Wang, Yasheng Wang, Ruiming Tang, Weinan Zhang, Yong Yu
| Challenge: | Existing debate-based approaches to code generation are limited due to several reasons: 1) Reliance on different instances of the same LLM for debate, 2) under-utilization of test cases, and 3) reliance on third-party moderators for result consolidation and decision-making. |
| Approach: | They propose to use test cases to analyze code and identify bugs while opposing models generate test cases for each other to challenge each other's code during the debate process. |
| Outcome: | The proposed model collects intelligence of LLMs via test case-driven debate for code generation. |
Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) can reveal toxic or offensive content inadvertently or intentionally. |
| Approach: | They propose to control the diversity of both sides according to the number of samples for fine-tuning, which can directly reflect their impact. |
| Outcome: | The proposed approach improves the performance of large language models after fine-tuning. |
Selective Prompting Tuning for Personalized Conversations with LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Personalization in conversational AI requires persona profiles and contextual understanding to create meaningful conversations. |
| Approach: | They propose a method that softly prompts LLMs for personalized conversations in a selective way. |
| Outcome: | The proposed approach improves response diversity by up to 90% on the CONVAI2 dataset. |
How Far Can We Extract Diverse Perspectives from Large Language Models? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances of large language models have gained much interest from researchers to exploit their capability of creative generation for data augmentation with less cost and higher diversity. |
| Approach: | They propose a criteria-based prompting technique to extract maximum diversity from LLMs. |
| Outcome: | The proposed method extracts diverse opinions from large language models iteratively. |
Toward Beginner-Friendly LLMs for Language Learning: Controlling Difficulty in Conversation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Practicing conversations with large language models is a promising alternative to traditional in-person language learning. |
| Approach: | They propose a new token-level evaluation metric, Token Miss Rate, that measures the proportion of incomprehensible tokens per utterance and correlates strongly with human judgments. |
| Outcome: | The proposed methods improve comprehensibility for beginner speakers from 39.4% to 83.3%, compared with prompting alone and a token-level evaluation metric, Token Miss Rate (TMR). |
The Effect of Language Diversity When Fine-Tuning Large Language Models for Translation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research on language diversity in LLM fine-tuning has reported benefits while others find no benefits. |
| Approach: | They find that expanding language diversity during fine-tuning improves translation quality . they also show that increased language diversity creates more language-agnostic representations . |
| Outcome: | The proposed model improves translation quality for unsupervised and supervised pairs . the results plateau or decrease beyond a certain diversity threshold. |
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods focus on single-round inference, but this view is problematic in real-world applications. |
| Approach: | They propose a framework that couples Steering Token Calibration with Semantic Alignment to ensure that LLMs are correctly aligned across gender, race, and sentiment. |
| Outcome: | The proposed framework outperforms baseline methods in achieving precise distributional control in attribute generation tasks. |
G2: Guided Generation for Enhanced Output Diversity in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to enhance output diversity but compromise quality of outputs. |
| Approach: | They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality. |
| Outcome: | The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality. |
Can LLM Agents Maintain a Persona in Discourse? (2025.emnlp-main)
Copied to clipboard
Pranav Bhandari, Nicolas Fay, Michael J Wise, Amitava Datta, Stephanie Meek, Usman Naseem, Mehwish Nasim
| Challenge: | Large language models are often subjected to context-shifting behaviour, resulting in a lack of consistent and interpretable personality-aligned interactions. |
| Approach: | They propose to use two conversation agents to generate a discourse with an assigned personality from the OCEAN framework and then use multiple judge agents to infer original traits. |
| Outcome: | The proposed model is based on two conversation agents with a personality assigned from the OCEAN framework and then multiple judge agents to infer the original traits assigned. |