Phrase-Indexed Question Answering: A New Challenge for Scalable Document Comprehension (D18-1)
Copied to clipboard
| Challenge: | Existing QA models rely on learning interaction between document and question . current models require explicit attention to the document before or as it reads it . |
| Approach: | They propose a modular question answering task that enforces complete independence of the document encoder from the question encoder. |
| Outcome: | The proposed model achieves reasonable accuracy but significantly underperforms unconstrained QA models. |
Similar Papers
Discourse Comprehension: A Question Answering Framework to Represent Sentence Connections (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems for text comprehension are inadequate for more holistic comprehension of a discourse. |
| Approach: | They propose a new paradigm that captures both discourse and semantic links between sentences in the form of free-form, open-ended questions. |
| Outcome: | The proposed model captures discourse and semantic links between sentences in the form of free-form, open-ended questions. |
AutoEQA: Auto-Encoding Questions for Extractive Question Answering (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Extractive question answering models are reliant on annotations of answer-spans in the corresponding passages. |
| Approach: | They propose a method that auto-encodes a question and generates corresponding questions from it. |
| Outcome: | The proposed method performs well in a zero-shot setting and can provide an additional loss to boost performance for extractive question answering (EQA). |
UNIFIEDQA: Crossing Format Boundaries with a Single QA System (2020.findings-emnlp)
Copied to clipboard
Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, Hannaneh Hajishirzi
| Challenge: | Question answering (QA) tasks have been posed using a variety of formats . a new study aims to develop specialized QA models that can be used to train QA systems . |
| Approach: | They build a pre-trained question answering model that performs well across 19 QA datasets . they argue that format-specialized models can limit the ability to teach reasoning . |
| Outcome: | a new model that trains on QA datasets performs on par with 8 models trained on individual datasets . a single model that trained on UNIFIEDQA performs well on 19 QA data . |
NeuralQA: A Usable Library for Question Answering (Contextual Query Expansion + BERT) on Large Datasets (2020.emnlp-demos)
Copied to clipboard
| Challenge: | Existing tools for Question Answering (QA) have challenges that limit their use in practice. |
| Approach: | They propose a library that integrates with existing infrastructure and offers helpful defaults for QA subtasks. |
| Outcome: | NeuralQA integrates well with existing infrastructure and offers helpful defaults for QA subtasks. |
Contextualized Word Representations for Reading Comprehension (N18-2)
Copied to clipboard
| Challenge: | Reading comprehension (RC) is a high-level task in natural language understanding that requires reading a document and answering questions about its content. |
| Approach: | They propose to provide a standard neural network for reading a document and answering a question about its content. |
| Outcome: | The proposed model improves on the competitive SQuAD dataset by providing rich contextualized word representations and allowing it to choose between context-dependent and context-independent representations. |
Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (P19-1)
Copied to clipboard
| Challenge: | Existing open-domain question answering models require multiple documents on-demand for every input query. |
| Approach: | They propose query-agnostic indexable representations of document phrases that can drastically speed up open-domain question answering. |
| Outcome: | The proposed model can be trained and deployed even in a single 4-GPU server. |
ReQA: An Evaluation for End-to-End Answer Retrieval Models (D19-58)
Copied to clipboard
| Challenge: | Popular QA benchmarks like SQuAD have driven progress on identifying answer spans within a specific passage . retrieving relevant answers from a huge corpus of documents is still a challenging problem . |
| Approach: | They propose a benchmark for evaluating large-scale sentence-level answer retrieval models . they establish baselines using both neural encoding models and classical retrieval techniques . |
| Outcome: | The proposed model outperforms human models on identifying answer spans within a specific passage . the proposed model is scalable and can bypass the typical document retrieval step . |
UQA: Corpus for Urdu Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Urdu is a low-resource language with over 70 million native speakers . expanding the reach of NLP to languages other than English is crucial for advancing multilingual AI systems. |
| Approach: | They introduce a novel dataset for question answering and text comprehension in Urdu . they use a technique called EATS which preserves the answer spans in translated context paragraphs . |
| Outcome: | The proposed dataset preserves answer spans in translated context paragraphs. |
Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehension (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to answer reading comprehension tasks are inefficient since the input is re-encoded within each module. |
| Approach: | They propose a unified question answering model that combines context retrieving, reading comprehension, and answer reranking to predict the final answer. |
| Outcome: | The proposed model outperforms the baseline model and achieves state-of-the-art results on two versions of TriviaQA and two variants of SQuAD. |
Adaptive Document Retrieval for Deep Question Answering (D18-1)
Copied to clipboard
| Challenge: | Existing methods for deep question answering do not understand the exact interplay between document retrieval and machine comprehension. |
| Approach: | They propose an adaptive document retrieval model that learns the optimal document number, conditional on the size of the corpus and the query. |
| Outcome: | The proposed model outperforms state-of-the-art methods on multiple benchmark datasets and in the context of corpora with variable sizes. |