Papers with QuAC
Capturing Conversational Interaction for Question Answering via Global History Reasoning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have studied history-dependent reasoning for question answering . utilizing global conversation history for enhancement is gaining interest . |
| Approach: | They propose to establish long-distance dependency among global utterances in multi-turn conversation. |
| Outcome: | The proposed method improves on QuAC by 1%, yielding the F1 score of 73.7%. |
RoR: Read-over-Read for Long Document Machine Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for machine reading comprehension are limited to individual chunks due to encoding length constraint. |
| Approach: | They propose a read-over-read method that expands the reading field from chunk to document by predicting regional answers for each chunk. |
| Outcome: | Extensive experiments on QuAC and TriviaQA show that the proposed model performs well for long document reading. |
Interview Evaluation: A Novel Approach for Automatic Evaluation of Conversational Question Answering Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation methods for CQA use pre-collected human-human conversations . previous methods use model-predicted dialogue history instead of ground truth . |
| Approach: | They propose an automatic evaluation approach that uses the model's dialogue history to evaluate models. |
| Outcome: | The proposed method improves on existing models and their evaluations on QuAC and CoQA. |
A Qualitative Comparison of CoQA, SQuAD 2.0 and QuAC (N19-1)
Copied to clipboard
| Challenge: | In response to this development, there have been a flurry of new datasets for question answering. |
| Approach: | They propose to use SQuAD 2.0, QuAC, and CoQA to provide question answering on textual data. |
| Outcome: | The proposed datasets provide complementary coverage of the first two aspects, but weak coverage of third. |
QuAC: Question Answering in Context (D18-1)
Copied to clipboard
Eunsol Choi, He He, Mohit Iyyer, Mark Yatskar, Wen-tau Yih, Yejin Choi, Percy Liang, Luke Zettlemoyer
| Challenge: | a dataset for Question Answering in Context contains 14K information-seeking QA dialogs . questions are often more open-ended, unanswerable, or only meaningful within the dialog context . |
| Approach: | They propose a dataset for Question Answering in Context that contains 14K dialogs . they use a student to ask questions about a Wikipedia section and a teacher to answer them . |
| Outcome: | The proposed dataset underperforms humans in a number of reference models . the dataset contains 14K information-seeking dialogs over sections from Wikipedia . |
Conversational Machine Comprehension: a Literature Review (2020.coling-main)
Copied to clipboard
| Challenge: | Conversational machine comprehension (CMC) is a research track in conversational AI. |
| Approach: | They propose to synthesize a generic framework for CMC models and highlight differences in recent approaches. |
| Outcome: | The proposed model will be used as a compendium for future research. |
Learn to Resolve Conversational Dependency: A Consistency Training Framework for Conversational Question Answering (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches do not explicitly train QA models on how to resolve conversational dependency, and thus these models are limited in understanding human dialogues. |
| Approach: | They propose a framework that generates self-contained questions that can be understood without the conversation history and then trains a QA model with the pairs of original and self-constructed questions using a consistency-based regularizer. |
| Outcome: | The proposed framework improves the models’ performance by up to 1.2 F1 on QuAC, and 5.2 F1 for CANARD, while addressing the limitations of the existing approaches. |
Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model (2023.acl-long)
Copied to clipboard
| Challenge: | Existing research on QG focuses on generating single-turn questions, which are formalized as independent interactions. |
| Approach: | They propose a multi-stage knowledge transfer framework to leverage knowledge from single-turn question generation instances. |
| Outcome: | The proposed framework achieves 14.81 BLEU-4 (88.2% absolute improvement compared to T5) in CoQA with knowledge transferred from three single-turn datasets. |
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to machine reading comprehension (MRC) on long texts typically chunk text into equally-spaced segments without considering information from other segments. |
| Approach: | They propose to let a model learn to chunk in a more flexible way via reinforcement learning. |
| Outcome: | The proposed model extracts a text span from document and query as answer . previous models can only take a fixed-length (e.g., 512) text as input . |
Can You Unpack That? Learning to Rewrite Questions-in-Context (D19-1)
Copied to clipboard
| Challenge: | Existing QA datasets lack key NLP problems like coreference and ellipsis resolution. |
| Approach: | They propose a task of question-in-context rewriting to rewrite a context-dependent question into a self-contained question with the same answer. |
| Outcome: | The proposed task is based on a dataset of 40,527 questions based in QuAC . it requires models to link questions together to resolve conversational dependencies . |