Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing conversational dense retrieval models view a conversation as a fixed sequence of questions and responses, and these alternate conversations are unrecorded. |
| Approach: | They propose a framework for generalizing Conversational dense retrieval via LLM-cognition data Augmentation (ConvAug) they first generate multi-level augmented conversations to capture the diverse nature of conversational contexts. |
| Outcome: | The proposed framework generalizes Conversational dense retrieval via LLM-cognition data Augmentation on four public datasets. |
Similar Papers
ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | a conversational search system requires accurate interpretation of user intent from complex multi-turn contexts. |
| Approach: | They propose a dual-learning approach that adapts LLMs for retrieval via contrastive learning while enhancing the complex session understanding through masked instruction tuning. |
| Outcome: | The proposed approach outperforms existing retrieval methods on five conversational search benchmarks. |
Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing long-term open-domain dialogue datasets lack complex, real-world personalization and fail to capture implicit reasoning. |
| Approach: | They propose a large-scale long-term dataset with 2,500 examples containing approximately 100 conversation sessions to study implicit reasoning in personalized dialogues. |
| Outcome: | The proposed model improves the ability of LLMs to reason over long-term conversations with implicit contextual dependencies. |
UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations (2025.acl-long)
Copied to clipboard
Fengran Mo, Yifan Gao, Chuan Meng, Xin Liu, Zhuofeng Wu, Kelong Mao, Zhengyang Wang, Pei Chen, Zheng Li, Xian Li, Bing Yin, Meng Jiang
| Challenge: | Existing conversational search systems are usually built with two different models . this separation restricts the system from leveraging the model's intrinsic knowledge simultaneously . Existing studies for developing unified models cannot fully address the aspects of understanding conversational context, managing retrieval independently, and generating responses. |
| Approach: | They propose to unify dense retrieval and response generation for large language models in conversation by fine-tuning and mitigating data discrepancy. |
| Outcome: | The proposed model can outperform existing models on five conversational search datasets and reduce inconsistency risks while mitigating data discrepancy. |
InstructoR: Instructing Unsupervised Conversational Dense Retrieval with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for conversational retrieval only fine-tune on limited supervised data, making it difficult for the retriever to fully grasp the entire conversation. |
| Approach: | They propose a method to instruct unsupervised conversational dense retrieval with large language models (LLMs) they use supervised data to discover the user's query intent from the conversation context . |
| Outcome: | The proposed method can bring significant improvements across various ad-hoc retrievers, surpassing the current state-of-the-art method. |
Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models for language from a social perspective are gaining popularity . we present a generalizable classification approach that leverages Large Language Models . |
| Approach: | They propose a generalizable classification approach that leverages Large Language Models to detect social meaning in conversations. |
| Outcome: | The proposed approach improves on two social meaning detection tasks over 2,340 settings. |
Beyond Single Labels: Improving Conversational Recommendation through LLM-Powered Data Augmentation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing recommendation quality face false negatives . only one "silly cop movie" is labeled as positive, leading to suboptimal recommendations . |
| Approach: | They propose a data augmentation framework that leverages an LLM-based semantic retriever to identify diverse and semantically relevant items and filter them by a relevance scorer to remove noisy candidates. |
| Outcome: | The proposed approach improves performance on two benchmark datasets and user simulators. |
Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement (2025.coling-main)
Copied to clipboard
Chenkai Sun, Ke Yang, Revanth Gangi Reddy, Yi Fung, Hou Pong Chan, Kevin Small, ChengXiang Zhai, Heng Ji
| Challenge: | Existing research has focused on enhancing the retrieval stage and optimizing the representation of the database. |
| Approach: | They propose a framework to improve generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
| Outcome: | The proposed framework improves generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
LA-UCL: LLM-Augmented Unsupervised Contrastive Learning Framework for Few-Shot Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results show that our model exceeds the baseline models due to the lack of cognitive ability. |
| Approach: | They propose a LLM-Augmented Unsupervised Contrastive Learning Framework which introduces a cognition-enabled Large Language Model (LLM) for efficient data augmentation and presents corresponding contrastive learning strategies. |
| Outcome: | The proposed model exceeds baseline models on six datasets. |
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting. |
| Approach: | They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content. |
| Outcome: | The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning. |
Domain Adaptation for Dense Retrieval and Conversational Dense Retrieval through Self-Supervision by Meticulous Pseudo-Relevance Labeling (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have shown that dense retrieval models generalize less well than interaction-based models on out-of-distribution data sets. |
| Approach: | They propose to combine query-generation approach with self-supervision approach in which pseudo-relevance labels are automatically generated on the target domain. |
| Outcome: | The proposed approach is based on a T5-3B model for pseudo-positive labeling and hard negatives on conversational dense retrieval models. |