Enhancing Knowledge Retrieval with Topic Modeling for Knowledge-Grounded Dialogue (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to knowledge retrieval are limited by the knowledge base encoder, but our work focuses on the knowledge-base encoder. |
| Approach: | They propose an approach that utilizes topic modeling on the knowledge base to improve retrieval accuracy and as a result, improve response generation. |
| Outcome: | The proposed approach can improve retrieval and generation performance on two datasets. |
Similar Papers
Approximation of Response Knowledge Retrieval in Knowledge-grounded Dialogue Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have focused on improving dialogue generation models that include knowledge related to the posts. |
| Approach: | They propose to use a novel method to generate responses from posts and related knowledge by injecting knowledge into dialogue generation models. |
| Outcome: | The proposed method outperforms baseline models in terms of knowledge relevance and quality. |
LLM-Enhanced Query Generation and Retrieval Preservation for Task-Oriented Dialogue (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge retrieval methods for task-oriented dialogues are limited by data scarcity and lack of data to annotate. |
| Approach: | They propose an LLM-enhanced model of query-guided knowledge retrieval for task-oriented dialogue . they propose to select the most relevant knowledge from retrieved top-K records and incorporate them as prompts to guide a generator in response generation. |
| Outcome: | The proposed model outperforms state-of-the-art in three benchmarks on three standard benchmarks. |
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
Exploring In-Context Learning for Knowledge Grounded Dialog Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge grounded dialog generation models are prone to hallucination and produce factually inaccurate outputs. |
| Approach: | They propose a retrieval-based framework which leverages in-context learning and retrieval techniques to enhance LLMs on knowledge grounded dialog generation. |
| Outcome: | The proposed framework outperforms existing training-based models on a large-scale knowledge graph with 1M+ facts and is expected to perform knowledge-intensive tasks. |
Efficient Latent Variable Modeling for Knowledge-Grounded Dialogue Generation (2023.findings-emnlp)
Copied to clipboard
Gunsoo Han, Daejin Jo, Daniel Nam, Eunseop Yoon, Taehwan Kwon, Seungeun Rho, Kyoung-Woon On, Chang Yoo, Sungwoong Kim
| Challenge: | Existing knowledge-grounded dialogue generation algorithms require annotated knowledge to generate a response grounded on the retrieved knowledge. |
| Approach: | They propose an efficient algorithm for latent variable modeling that leverages large amount of dialogue data. |
| Outcome: | The proposed algorithm outperforms the supervised learning algorithm on knowledge-grounded dialogue datasets while maintaining efficiency and scalability. |
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models (2024.findings-acl)
Copied to clipboard
Haoran Luo, Haihong E, Zichen Tang, Shiyao Peng, Yikai Guo, Wentai Zhang, Chenghao Ma, Guanting Dong, Meina Song, Wei Lin, Yifan Zhu, Anh Tuan Luu
| Challenge: | Existing KBQA methods address inefficient knowledge retrieval and semantic parsing errors. |
| Approach: | They propose a generatethen-retrieve KBQA framework that generates logical form and replaces entities and relations with an unsupervised retrieval method to improve both generation and retrieval more directly. |
| Outcome: | Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ. |
TopicGPT: A Prompt-based Topic Modeling Framework (2024.naacl-long)
Copied to clipboard
| Challenge: | TopicGPT uses large language models to uncover latent topics in text . topic models represent topics as bags of words that require "reading the tea leaves" topic models also offer limited control over formatting and specificity of topics . |
| Approach: | TopicGPT uses large language models to uncover latent topics in text . authors propose a prompt-based framework that produces topics that align better with human categorizations . |
| Outcome: | TopicGPT produces topics that align better with human categorizations compared to competing methods. |
Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to task-oriented dialogue systems integrate knowledge retrieval and response generation, which poses scalability challenges when dealing with extensive knowledge bases. |
| Approach: | They propose a retriever-generator architecture that harnesses a retrieval and a generator to generate system responses by using feedback from the generator as pseudo-labels. |
| Outcome: | The proposed architecture shows superior performance on three benchmark datasets. |
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog (2023.acl-long)
Copied to clipboard
| Challenge: | Existing systems blend knowledge retrieval with response generation and optimize them with direct supervision from reference responses. |
| Approach: | They propose a multi-grained knowledge retrieval system that decouples knowledge retrievals from response generation and introduces an entity selector and an attribute selector to acquire multigrained information from the knowledge base. |
| Outcome: | The proposed system performs better on small and large knowledge bases. |