| Challenge: | Existing QA datasets lack key NLP problems like coreference and ellipsis resolution. |
| Approach: | They propose a task of question-in-context rewriting to rewrite a context-dependent question into a self-contained question with the same answer. |
| Outcome: | The proposed task is based on a dataset of 40,527 questions based in QuAC . it requires models to link questions together to resolve conversational dependencies . |
Similar Papers
CoQAR: Question Rewriting on CoQA (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing systems that ask questions in a conversational context may have contextual dependencies that make the understanding difficult. |
| Approach: | They propose to rewrite questions into an out-of-context form to facilitate understanding . they propose to use this form to train and evaluate conversational question answering models . |
| Outcome: | The proposed model can be used in the supervised learning of three tasks: question paraphrasing, question rewriting and conversational question answering. |
A dataset and baselines for sequential open-domain question answering (D18-1)
Copied to clipboard
| Challenge: | Existing question-answering systems focus on answering individual questions, assuming they are devoid of context. |
| Approach: | They propose to ask multiple related questions in a dataset that includes human-authored questions. |
| Outcome: | The proposed system can answer human-authored questions better than existing systems. |
QuAC: Question Answering in Context (D18-1)
Copied to clipboard
Eunsol Choi, He He, Mohit Iyyer, Mark Yatskar, Wen-tau Yih, Yejin Choi, Percy Liang, Luke Zettlemoyer
| Challenge: | a dataset for Question Answering in Context contains 14K information-seeking QA dialogs . questions are often more open-ended, unanswerable, or only meaningful within the dialog context . |
| Approach: | They propose a dataset for Question Answering in Context that contains 14K dialogs . they use a student to ask questions about a Wikipedia section and a teacher to answer them . |
| Outcome: | The proposed dataset underperforms humans in a number of reference models . the dataset contains 14K information-seeking dialogs over sections from Wikipedia . |
Integrating Question Rewrites in Conversational Question Answering: A Reinforcement Learning Approach (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing approaches to improve QR performance dependencies among dialogue history dependencies are limited. |
| Approach: | They propose a reinforcement learning approach that integrates QR and CQA tasks without corresponding labeled QR datasets. |
| Outcome: | The proposed approach improves existing pipeline approaches in conversational question answering (QA) existing methods depend on assumption of corresponding QR datasets for every CQA dataset, resulting in poor performance. |
Open-Domain Question Answering Goes Conversational via Question Rewriting (2021.naacl-main)
Copied to clipboard
Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, Srinivas Chappidi
| Challenge: | Existing large-scale benchmarks for conversational QA limit the topic of conversation to the content of a single document. |
| Approach: | They propose a dataset for Question Rewriting in Conversational Context (QReCC) the dataset contains 14K conversations with 80K question-answer pairs. |
| Outcome: | The proposed approach shows that the first baseline for the QReCC dataset is 19.10, compared to the human upper bound of 75.45, indicating the difficulty of the setup and a large room for improvement. |
Decontextualization: Making Sentences Stand-Alone (2021.tacl-1)
Copied to clipboard
| Challenge: | Taking excerpts of text can be problematic, as key pieces may not be explicit in a local window. |
| Approach: | They define a problem of sentence decontextualization by rewriting a sentence to be interpretable out of context while preserving its meaning. |
| Outcome: | The proposed method can be used in question answering and document understanding tasks. |
Bridging Anaphora Resolution as Question Answering (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on bridging anaphora resolution focus on question answering based on context . briding anaphorisms and their antecedents are linked via various lexico-semantic, frame or encyclopedic relations. |
| Approach: | They propose a question answering framework for bridging anaphora resolution . they propose briding anaphorisms and their antecedents are linked via various lexico-semantic, frame or encyclopedic relations. |
| Outcome: | The proposed method generates state-of-the-art results on two bridging corpora. |
I Could’ve Asked That: Reformulating Unanswerable Questions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models do not assist users in reformulating unanswerable questions . a recent study found that the models failed to reformulate questions based on assumptions that conflict with or cannot be verified with the information available in documents. |
| Approach: | They evaluate open-source and proprietary LLMs on couldAsk to evaluate their performance . they found that GPT-4 and Llama2-7B successfully reformulate questions only 26% and 12% of the time . |
| Outcome: | The proposed model successfully reformulates questions only 26% and 12% of the time . the proposed model is not able to reformulate questions, but it can be improved . |
A Question Answering Framework for Decontextualizing User-facing Snippets from Scientific Documents (2023.emnlp-main)
Copied to clipboard
| Challenge: | snippets are not meant to be read outside their original document. |
| Approach: | They propose a framework that decomposes the task into three stages: question generation, question answering, and rewriting. |
| Outcome: | The proposed framework decomposes the task into three stages: question generation, question answering, and rewriting. |
Contextualized Word Representations for Reading Comprehension (N18-2)
Copied to clipboard
| Challenge: | Reading comprehension (RC) is a high-level task in natural language understanding that requires reading a document and answering questions about its content. |
| Approach: | They propose to provide a standard neural network for reading a document and answering a question about its content. |
| Outcome: | The proposed model improves on the competitive SQuAD dataset by providing rich contextualized word representations and allowing it to choose between context-dependent and context-independent representations. |