Open-Domain Question Answering Goes Conversational via Question Rewriting (2021.naacl-main)
Copied to clipboard
Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, Srinivas Chappidi
| Challenge: | Existing large-scale benchmarks for conversational QA limit the topic of conversation to the content of a single document. |
| Approach: | They propose a dataset for Question Rewriting in Conversational Context (QReCC) the dataset contains 14K conversations with 80K question-answer pairs. |
| Outcome: | The proposed approach shows that the first baseline for the QReCC dataset is 19.10, compared to the human upper bound of 75.45, indicating the difficulty of the setup and a large room for improvement. |
Similar Papers
CoQAR: Question Rewriting on CoQA (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing systems that ask questions in a conversational context may have contextual dependencies that make the understanding difficult. |
| Approach: | They propose to rewrite questions into an out-of-context form to facilitate understanding . they propose to use this form to train and evaluate conversational question answering models . |
| Outcome: | The proposed model can be used in the supervised learning of three tasks: question paraphrasing, question rewriting and conversational question answering. |
Can You Unpack That? Learning to Rewrite Questions-in-Context (D19-1)
Copied to clipboard
| Challenge: | Existing QA datasets lack key NLP problems like coreference and ellipsis resolution. |
| Approach: | They propose a task of question-in-context rewriting to rewrite a context-dependent question into a self-contained question with the same answer. |
| Outcome: | The proposed task is based on a dataset of 40,527 questions based in QuAC . it requires models to link questions together to resolve conversational dependencies . |
SCAI-QReCC Shared Task on Conversational Question Answering (2022.lrec-1)
Copied to clipboard
| Challenge: | evaluating systems for conversational QA remains an open research problem in its own right . evaluating (conversational) QA systems remains an important challenge for developing conversational information retrieval (conversional search) systems. |
| Approach: | They propose to use a conversational question answering task to extend the original conversational QA dataset with alternative correct answers produced by participant systems. |
| Outcome: | The proposed task was based on the SCAI-QReCC 2021 shared task on conversational question answering. |
Open-Domain Conversational Question Answering with Historical Answers (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing approaches to conversational question answering are limited due to the large number of candidate documents. |
| Approach: | They propose a model that leverages historical answers to boost retrieval performance . they propose to use open-domain conversational question answering to solve these problems . |
| Outcome: | The proposed model outperforms baseline models in extractive and generative reader settings on OR-QuAC dataset. |
Integrating Question Rewrites in Conversational Question Answering: A Reinforcement Learning Approach (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing approaches to improve QR performance dependencies among dialogue history dependencies are limited. |
| Approach: | They propose a reinforcement learning approach that integrates QR and CQA tasks without corresponding labeled QR datasets. |
| Outcome: | The proposed approach improves existing pipeline approaches in conversational question answering (QA) existing methods depend on assumption of corresponding QR datasets for every CQA dataset, resulting in poor performance. |
Conversational QA Dataset Generation with Answer Revision (2022.coling-1)
Copied to clipboard
| Challenge: | Existing frameworks for conversational question-answer generation generate a large-scale dataset based on input passages. |
| Approach: | They propose a conversational question-answer generation framework that extracts question-worthy phrases from passages and generates corresponding questions considering previous conversations. |
| Outcome: | The proposed framework improves the quality of synthetic data and can be used for domain adaptation of conversational question answering. |
QAConv: Question Answering on Informative Conversations (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that state-of-the-art pretrained QA systems have limited zero-shot performance and tend to predict our questions as unanswerable. |
| Approach: | They propose a question-answering dataset that uses conversations as a knowledge source. |
| Outcome: | The proposed dataset provides a training and evaluation testbed to facilitate QA on conversations research. |
Reinforced Question Rewriting for Conversational Question Answering (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to CQA involve training new models from scratch . existing approaches are expensive and often not feasible . |
| Approach: | They propose to use QA feedback to supervise the rewriting model with reinforcement learning. |
| Outcome: | The proposed model can improve QA performance over baselines for extractive and retrieval QA. |
Multi-Task Learning of Query Generation and Classification for Generative Conversational Question Rewriting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to identifying ambiguous questions as part of a conversation have not addressed this challenge. |
| Approach: | They propose a multi-task learning approach that uses a text generation model for question rewriting and classification. |
| Outcome: | The proposed approach outperforms single-task learning baselines on three LIF test sets. |
DoQA - Accessing Domain-Specific FAQs via Conversational QA (2020.acl-main)
Copied to clipboard
| Challenge: | a dataset of 2,437 dialogues and 10,917 QA pairs is used to access domain-specific FAQ information. |
| Approach: | They present a dataset with 2,437 dialogues and 10,917 QA pairs for FAQs . they use the Wizard of Oz method with crowdsourcing to create dialogues using the original post and the original reply. |
| Outcome: | The proposed system can access domain-specific FAQ information without training data. |