Towards LLM-powered Attentive Listener: A Pragmatic Approach through Quantity Self-Repair (2025.acl-short)
Copied to clipboard
| Challenge: | Quantity Maxims dictates that human speakers aim for optimal quantity of information during conversation. |
| Approach: | They propose to use heuristic path-finding to enable decoder-only LLMs to travel among multiple "Q-alternatives" and search for optimal quantity in coordination with a conversation goal. |
| Outcome: | The proposed techniques are based on heuristic path-finding and can be used to construct human-like, user-centered conversation agents. |
Similar Papers
Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be prohibitive in terms of feasibility, time, and resources. |
| Approach: | They propose a method for training large language models by enabling "self-talk" they propose supervised fine-tuning of LLMs to improve quality of dialogues . |
| Outcome: | The proposed method generates training data via "self-talk" of LLMs that can be refined and utilized for supervised fine-tuning. |
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment (2024.acl-long)
Copied to clipboard
| Challenge: | Quantization-aware direct preference optimization (QDPO) improves conversational abilities of quantized LLMs . token-flipping is a critical factor for degraded text generation quality . |
| Approach: | They propose a method that aligns quantized LLMs with their full-precision counterparts, improving conversational abilities. |
| Outcome: | The proposed method outperforms established fine-tuning techniques on two instruction-tuned LLMs in various languages and models, setting a new benchmark for conversational chatbot development. |
Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Sampling (2025.naacl-long)
Copied to clipboard
Yiwen Ding, Zhiheng Xi, Wei He, Lizhuoyuan Lizhuoyuan, Yitao Zhai, Shi Xiaowei, Xunliang Cai, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Large language models (LLMs) generate solutions themselves and iteratively train on filtered, high-quality rationales, but performance reaches a ceiling after a few iterations. |
| Approach: | They propose a strategy to improve the efficiency of sampling heavy-tailed data by using Socratic-style guidance signals to help LLMs reasoning with complex queries. |
| Outcome: | The proposed approach is effective on difficult queries and on held-out tasks, while requiring human supervision. |
Enhancing the General Agent Capabilities of Low-Paramter LLMs through Tuning and Multi-Branch Reasoning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Open-source pre-trained Large Language Models exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. |
| Approach: | They propose a method to construct agent-specific data using GPT-4 and supervised fine-tuning . they find that supervised tunning can significantly reduce hallucination outputs and formatting errors in agent tasks . |
| Outcome: | The proposed method improves on five agent tasks of AgentBench. |
Toward Beginner-Friendly LLMs for Language Learning: Controlling Difficulty in Conversation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Practicing conversations with large language models is a promising alternative to traditional in-person language learning. |
| Approach: | They propose a new token-level evaluation metric, Token Miss Rate, that measures the proportion of incomprehensible tokens per utterance and correlates strongly with human judgments. |
| Outcome: | The proposed methods improve comprehensibility for beginner speakers from 39.4% to 83.3%, compared with prompting alone and a token-level evaluation metric, Token Miss Rate (TMR). |
Prospector: Improving LLM Agents with Self-Asking and Trajectory Ranking (2024.findings-emnlp)
Copied to clipboard
Byoungjip Kim, Youngsoo Jang, Lajanugen Logeswaran, Geon-Hyeong Kim, Yu Jin Kim, Honglak Lee, Moontae Lee
| Challenge: | Existing LLMs are limited in their ability to incorporate feedback from an environment. |
| Approach: | They propose an LLM agent that consists of an Actor and a Critic. |
| Outcome: | The proposed agent outperforms existing LLMs on benchmark environments and shows that it can generate diverse trajectories and pick the most rewarding trajectory. |
From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning (2024.naacl-long)
Copied to clipboard
Ming Li, Yong Zhang, Zhitao Li, Jiuhai Chen, Lichang Chen, Ning Cheng, Jianzong Wang, Tianyi Zhou, Jing Xiao
| Challenge: | Large Language Models (LLMs) have revolutionized the landscape of artificial intelligence. |
| Approach: | They propose a self-guided method to identify and select cherry samples from open-source datasets, minimizing manual curation and potential cost for instruction tuning an LLM. |
| Outcome: | The proposed method enables LLMs to identify discrepancies between expected responses and intrinsic generation capability, and a marked uptick in model training efficiency. |
LLM can Achieve Self-Regulation via Hyperparameter Aware Generation (2024.findings-acl)
Copied to clipboard
Siyin Wang, Shimin Li, Tianxiang Sun, Jinlan Fu, Qinyuan Cheng, Jiasheng Ye, Junjie Ye, Xipeng Qiu, Xuanjing Huang
| Challenge: | Existing decoding strategies and hyperparameters may not be optimal for each sample. |
| Approach: | They propose a model that auto-regulates decoding strategies and hyperparameters . this approach eliminates the need for extensive manual tuning, they argue . |
| Outcome: | The proposed model eliminates the need for extensive manual tuning, offering a more autonomous, self-regulate model behavior. |
Sparse Rewards Can Self-Train Dialogue Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models have been driven by supervised fine-tuning and high-quality human feedback. however, acquiring meaningful human feedback has become increasingly challenging and costly. |
| Approach: | They propose a method that empowers LLM agents to enhance their performance without external feedback. |
| Outcome: | The proposed method improves tool-based interactions while preserving general model capabilities across diverse benchmarks. |
Socratic Human Feedback (SoHF): Expert Steering Strategies for LLM Code Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used for generating code solutions, but struggle with complex programming problems without human guidance. |
| Approach: | They use the “Socratic Feedback” paradigm to map observed feedback strategies to five stages of Socratic Questioning to identify failures in LLMs. |
| Outcome: | The proposed models solved 74% of the problems that the models initially failed to solve on their own. |