| Challenge: | a large corpus of 71k English conversations contains on average 8.6 questions . Unlike open domain and task-oriented dialogues, information seeking conversations are driven by the desire to acquire or evaluate knowledge. |
| Approach: | They propose a large corpus of 71k English conversations where each question-answer pair is grounded in a Wikidata fact. |
| Outcome: | The proposed dataset can be used for knowledge-based, conversational question generation . it can also be used to generate single-turn questions from Wikidata triples, question rewriting, question answering from conversation or knowledge graphs and quiz generation. |
Similar Papers
ConvKGYarn: Spinning Configurable and Scalable Conversational Knowledge Graph QA Datasets with Large Language Models (2024.emnlp-industry)
Copied to clipboard
Ronak Pradeep, Daniel Lee, Ali Mousavi, Jeffrey Pound, Yisi Sang, Jimmy Lin, Ihab Ilyas, Saloni Potdar, Mostafa Arefiyan, Yunyao Li
| Challenge: | Knowledge Graphs (KGs) are a powerful tool for capturing structured representations of the world. |
| Approach: | They propose a scalable method for generating up-to-date and configurable conversational KGQA datasets that adheres to human interaction configurations and operates at a significantly larger scale. |
| Outcome: | Qualitative psychometric analyses show that ConvKGYarn produces high-quality data comparable to popular conversational KGQA datasets across various metrics. |
A Dataset for Document Grounded Conversations (D18-1)
Copied to clipboard
| Challenge: | a dataset of document grounded conversations provides information on content of a document . current datasets lacking conversation grounding do not provide this information . |
| Approach: | They propose a document grounded dataset for conversations . they use Wikipedia articles about popular movies to define document grounded conversations based on their results . |
| Outcome: | The proposed dataset provides a source of information and provides benchmark performance on the task of generating the next response. |
Generating Questions from Wikidata Triples (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for question generation from knowledge bases rely on extensive pre- and post-processing of the input triple. |
| Approach: | They revisit KBQG using pre training, a new (triple, question) dataset and taking question type into account and provide a more extended KBqg dataset. |
| Outcome: | The proposed approach outperforms existing methods in a standard and in 'zero-shot' setting. |
WikiConv: A Corpus of the Complete Conversational History of a Large Online Collaborative Community (D18-1)
Copied to clipboard
Yiqing Hua, Cristian Danescu-Niculescu-Mizil, Dario Taraborelli, Nithum Thain, Jeffery Sorensen, Lucas Dixon
| Challenge: | Compared to large-scale collections of conversations from social media, Wikipedia talk pages only capture a subset of all discussions and only accounts for the final form of each conversation. |
| Approach: | They propose to reconstruct a corpus that encompasses the complete history of conversations between Wikipedia contributors. |
| Outcome: | The proposed corpus extracts high quality data in both Chinese and English. |
QAConv: Question Answering on Informative Conversations (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that state-of-the-art pretrained QA systems have limited zero-shot performance and tend to predict our questions as unanswerable. |
| Approach: | They propose a question-answering dataset that uses conversations as a knowledge source. |
| Outcome: | The proposed dataset provides a training and evaluation testbed to facilitate QA on conversations research. |
Automatic Generation of Large-scale Multi-turn Dialogues from Reddit (2022.coling-1)
Copied to clipboard
| Challenge: | Using a set of algorithms, we can generate large dialogue corpus from Reddit. |
| Approach: | They propose to automatically convert posts and their comments from discussion forums such as Reddit into multi-turn dialogues. |
| Outcome: | The proposed methods improve on the baseline method by 36.3% . the best method shows an improvement of 36.6% over the previous one . |
KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing knowledge-driven dialog data is limited due to the lack of dialog data which consists of multi-turn conversations on multiple topics and with knowledge annotations. |
| Approach: | They propose a Chinese multi-domain knowledge-driven conversation dataset which grounds the topics in multi-turn conversations to knowledge graphs. |
| Outcome: | The proposed dataset can be enhanced by introducing background knowledge, but there is still a large space for leveraging knowledge to model multi-turn conversations for further research. |
There Is No Standard Answer: Knowledge-Grounded Dialogue Generation with Adversarial Activated Multi-Reference Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods emphasize selecting one golden knowledge given a particular dialogue context, overlooking the one-to-many phenomenon in dialogue. |
| Approach: | They propose to use a multi-reference dataset to assess the one-to-many efficacy of existing KGC models. |
| Outcome: | The proposed model improves the mapping relationship between multiple knowledge and multiple responses by optimizing the model in a wake-sleep style. |
DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphs (D19-1)
Copied to clipboard
| Challenge: | Existing work has not shown that knowledge-grounded models can zero-shot adapt to updated, unseen knowledge graphs. |
| Approach: | They propose a task to apply dynamic knowledge graphs to neural conversation models . they propose 'dyKgChat' that selects an output from two networks at each time step . |
| Outcome: | The proposed model outperforms existing knowledge-grounded conversation models in evaluation metrics. |
WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for data-to-text generation focus on single-sentence generation or long-form generation. |
| Approach: | They create a dataset that pairs Wikipedia sections with tabular data and various metadata. |
| Outcome: | The proposed dataset can generate fluent and high quality texts but struggle with coherence and factuality. |