Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts (2025.naacl-short)
Copied to clipboard
| Challenge: | Training conversational question-answering systems requires in-domain data, which is often scarce in practice. |
| Approach: | They propose a bottom-up approach where QA pairs are generated first and combined into a coherent dialogue. |
| Outcome: | The proposed approach produces more realistic and higher-quality dialogues compared to top-down methods. |
Similar Papers
On Synthesizing Data for Context Attribution in Question Answering (2025.acl-long)
Copied to clipboard
Gorjan Radevski, Kiril Gashteovski, Shahbaz Syed, Christopher Malon, Sebastien Nicolas, Chia-Chien Hung, Timo Sztyler, Verena Heußer, Wiem Ben Rim, Masafumi Enomoto, Kunihiro Takeoka, Masafumi Oyamada, Goran Glavaš, Carolin Lawrence
| Challenge: | Large Language Models (LLMs) have a tendency to hallucinate, resulting in false or misleading answers. |
| Approach: | They propose a novel generative strategy for synthesizing context attribution data. |
| Outcome: | The proposed approach is highly effective for fine-tuning small LMs for context attribution in different QA tasks and domains. |
Grounding in social media: An approach to building a chit-chat dialogue model (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing open-domain dialogue models fail to capture and utilize external knowledge, leading to repetitive or generic responses to unseen utterances. |
| Approach: | They propose to use social media comments to improve the raw conversation ability of open-domain dialogue systems. |
| Outcome: | The proposed model improves the raw conversation ability of open-domain dialogue systems by mimicking human responses through casual interactions found on social media. |
A Synthetic Data Generation Framework for Grounded Dialogues (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to train grounded dialogues require large amounts of data. |
| Approach: | They propose a synthetic data generation framework for grounded dialogues that takes knowledge data and heuristics to determine a dialogue flow and incrementally turn it into a dialog. |
| Outcome: | The proposed framework significantly boosts model performance in training data and low-resource scenarios. |
LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues (2024.naacl-srw)
Copied to clipboard
Joe Stacey, Jianpeng Cheng, John Torr, Tristan Guigue, Joris Driesen, Alexandru Coca, Mark Gaynor, Anders Johannsen
| Challenge: | Existing datasets with limited domain coverage and few challenging conversational phenomena are often unlabelled . Existing data is limited in quality and lacks a robust evaluation process . |
| Approach: | They propose a high quality data generation system that generates high quality dialogues using 4,277 conversations across 100 intents. |
| Outcome: | The proposed system produces high quality dialogue data with high quality labels. |
Reason first, then respond: Modular Generation for Knowledge-infused Dialogue (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can produce fluent dialogue but often hallucinate factual inaccuracies. |
| Approach: | They propose a modular model for incorporating knowledge into conversational agents that generates a knowledge sequence and then attends to its own generated knowledge sequence. |
| Outcome: | The proposed model hallucinates less in knowledge-grounded dialogue tasks and has advantages in terms of interpretability and modularity. |
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Question Answering (QA) is a growing area of research . state-of-the-art QA models struggle on out-of domain documents without fine-tuning . |
| Approach: | They propose a pipeline for validating and training QA data and an interface for human annotation. |
| Outcome: | The proposed pipeline improves QA performance on domain-specific datasets while preserving the accuracy of the model. |
Synthetic QA Corpora Generation with Roundtrip Consistency (P19-1)
Copied to clipboard
| Challenge: | Existing methods for generating synthetic question answering corpora are not suitable for QA, but can be constructed from widely available natural text. |
| Approach: | They propose a method for generating synthetic question answering corpora by combining question generation and answer extraction models and filtering the results to ensure roundtrip consistency. |
| Outcome: | The proposed model achieves exact match and F1 at less than 0.1% and 0.4% from human performance on SQuAD2 and NQ. |
DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing research is limited by general or niche datasets that lack sufficient scale for training dialogue systems. |
| Approach: | They propose a synthetic dialogue generation framework that uses Large Language Models and Chain of Thought reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. |
| Outcome: | The proposed framework outperforms existing frameworks on dialogue summarization and quality increases as the size of the LLM increases from 3B to 8B. |
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
PLACES: Prompting Language Models for Social Conversation Synthesis (2023.findings-eacl)
Copied to clipboard
Maximillian Chen, Alexandros Papangelis, Chenyang Tao, Seokhwan Kim, Andy Rosenbaum, Yang Liu, Zhou Yu, Dilek Hakkani-Tur
| Challenge: | Currently, collecting high quality conversational data is expensive and infeasible for many applications . a promising direction is to generate synthetic dialogues by prompting large language models . |
| Approach: | They propose to use expert-written conversations as in-context examples to generate synthetic dialogues by prompting large language models. |
| Outcome: | The proposed approach is generalizable to multi-party conversations, compared to human-collected conversations. |