Challenge: Existing conversational search systems are usually built with two different models . this separation restricts the system from leveraging the model's intrinsic knowledge simultaneously . Existing studies for developing unified models cannot fully address the aspects of understanding conversational context, managing retrieval independently, and generating responses.
Approach: They propose to unify dense retrieval and response generation for large language models in conversation by fine-tuning and mitigating data discrepancy.
Outcome: The proposed model can outperform existing models on five conversational search datasets and reduce inconsistency risks while mitigating data discrepancy.

Similar Papers

UniConv: A Unified Conversational Neural Architecture for Multi-domain Task-oriented Dialogues (2020.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to training dialogue agents separately are not optimized for multi-domain task-oriented dialogues.
Approach: They propose a unified neural architecture for end-to-end conversational systems in multi-domain task-oriented dialogues that jointly trains a bi-level state tracker and a joint dialogue act and response generator.
Outcome: The proposed system outperforms existing systems on the MultiWOZ2.1 benchmark in dialogue state tracking, context-to-text, and end-to end settings.
Plug-and-Play Conversational Models (2020.findings-emnlp)

Copied to clipboard

Challenge: Large conversational models that generate coherent and fluent responses often require large dialogue datasets.
Approach: They propose and evaluate plug-and-play methods for controllable response generation . they demonstrate a high degree of control over the generated conversational responses .
Outcome: The proposed method does not require further computation at decoding time and does not need fine-tuning of a large language model.
InstructoR: Instructing Unsupervised Conversational Dense Retrieval with Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for conversational retrieval only fine-tune on limited supervised data, making it difficult for the retriever to fully grasp the entire conversation.
Approach: They propose a method to instruct unsupervised conversational dense retrieval with large language models (LLMs) they use supervised data to discover the user's query intent from the conversation context .
Outcome: The proposed method can bring significant improvements across various ad-hoc retrievers, surpassing the current state-of-the-art method.
Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentation (2024.acl-long)

Copied to clipboard

Challenge: Existing conversational dense retrieval models view a conversation as a fixed sequence of questions and responses, and these alternate conversations are unrecorded.
Approach: They propose a framework for generalizing Conversational dense retrieval via LLM-cognition data Augmentation (ConvAug) they first generate multi-level augmented conversations to capture the diverse nature of conversational contexts.
Outcome: The proposed framework generalizes Conversational dense retrieval via LLM-cognition data Augmentation on four public datasets.
Contextualized Query Embeddings for Conversational Search (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to conversational search use multiple inference pipelines that require long inference times . despite their effectiveness, such a pipeline often includes multiple neural models that require longer inference time.
Approach: They propose to integrate conversational query reformulation directly into a dense retrieval model . they use a dataset with pseudo-relevance labels to overcome the lack of training data .
Outcome: The proposed model rewrites conversational queries as dense representations in conversational search and open-domain question answering datasets.
UniRetriever: Multi-task Candidates Selection for Various Context-Adaptive Conversational Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for retrieving information from a large corpus of data are sub-optimal and low efficiency.
Approach: They propose a multi-task framework that functions as a universal retriever for three dominant retrieval tasks during the conversation.
Outcome: The proposed framework can perform persona selection, knowledge selection, and response selection tasks simultaneously.
AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models (2023.acl-short)

Copied to clipboard

Challenge: Existing research on information-seeking conversations is stymied by the lack of training data.
Approach: They propose to use autoconv for synthetic conversation generation to capture the characteristics of the information-seeking process and fine tune an LLM with a few human conversations to generate synthetic conversations with high quality.
Outcome: The proposed model improves on two commonly-used datasets and alleviates the dependence on human annotation.
Interpreting Conversational Dense Retrieval by Rewriting-Enhanced Inversion of Session Embedding (2024.acl-long)

Copied to clipboard

Challenge: Conversational dense retrieval models lack interpretability, hindering intuitive understanding of model behaviors . a major limitation of conversational dense search is their lack of interpretability .
Approach: They propose to transform opaque session embeddings into explicit interpretable text . they propose to incorporate external interpretable query rewrites into the transformation process .
Outcome: The proposed approach yields more interpretable text and preserves original retrieval performance over baselines.
Fine-grained Conversational Decoding via Isotropic and Proximal Search (2023.emnlp-main)

Copied to clipboard

Challenge: Existing text decoding methods are not tailoring for dialogue generation.
Approach: They propose a fine-grained conversational decoding method that generates a semantic-concentrated response while maintaining informativeness and discrimination against the context.
Outcome: The proposed method outperforms existing decoding strategies in the dialogue field across both automatic and human evaluation metrics.
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation (2022.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text.
Approach: They propose a posterior-based reweighing and noisy training strategy to exploit generated knowledge in dialogue generation.
Outcome: Empirical results show that the proposed methods outperform the state-of-the-art methods in unsupervised knowledge-grounded conversation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations