Dan Su, Mostofa Patwary, Shrimai Prabhumoye, Peng Xu, Ryan Prenger, Mohammad Shoeybi, Pascale Fung, Anima Anandkumar, Bryan Catanzaro
| Challenge: | Existing closed-book question answering methods do not fully exploit the parameterized knowledge. |
| Approach: | They propose a closed-book QA framework which uses a coarse-to-fine approach to extract the relevant knowledge and answer a question. |
| Outcome: | The proposed method outperforms open-book QA methods on three QA benchmarks. |
Similar Papers
Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for open-domain question-answering use an open book approach . a recent alternative is to retrieve from a collection of previously-generated question-annwer pairs . |
| Approach: | They propose a new QA system that augments a text-to-text model with a large memory of question-answer pairs and a task for the latent step of question retrieval. |
| Outcome: | The proposed system outperforms closed-book QA and can answer multi-hop questions. |
Can Generative Pre-trained Language Models Serve As Knowledge Bases for Closed-book QA? (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work is limited in using small benchmarks with high test-train overlaps. |
| Approach: | They construct a dataset of closed-book QA using SQuAD and investigate the performance of BART. |
| Outcome: | Experiments show that pre-trained language models can achieve high performance on closed-book QA tasks. |
Leveraging Context Information for Natural Question Generation (N18-2)
Copied to clipboard
| Challenge: | Existing work for natural question generation ignores the input passage or hard-codes answer positions. |
| Approach: | They propose a model that matches the answer with the passage before generating a question. |
| Outcome: | The proposed model outperforms the state-of-the-art model using rich features. |
An Answer is just the Start: Related Insight Generation for Open-Ended Document-Grounded QA (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing QA benchmarks do not explicitly support document-grounded related insight generation . Existing document-based QA efforts focus on answering fact-based questions . |
| Approach: | They propose a task to generate additional insights from a document collection that improves, extends or rethinks an initial answer to an open-ended question. |
| Outcome: | The proposed task improves, extends, or rethinks an answer to an open-ended question. |
Closed-book Question Generation via Contrastive Learning (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent studies on open-book QG have achieved promising progress, but generating natural questions under a more practical closed-book setting remains a challenge. |
| Approach: | They propose a QG model that stores more information in its parameters through contrastive learning and an answer reconstruction module. |
| Outcome: | The proposed model outperforms baselines in automatic evaluation and human evaluation on a public dataset and a new WikiCQA dataset. |
C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References (2022.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to pretrain open-domain question answering systems lack task-specific annotations. |
| Approach: | They propose to pretrain a two-stage open-domain question answering system with strong transfer capabilities by using a dictionary and a large-scale corpus. |
| Outcome: | The proposed approach leads to 2%-10% gains in top-20 accuracy and improves with reader. |
Context Matters: Pushing the Boundaries of Open-Ended Answer Generation with Graph-Structured Knowledge Context (2024.emnlp-industry)
Copied to clipboard
| Challenge: | GraphContextGen outperforms dominant text-based retrieval systems in domain specific community question answering platforms like AskUbuntu, Unix, and ServerFault. |
| Approach: | They propose a framework that combines graph-driven context retrieval with knowledge graphs based enhancement to improve the proficiency of LLMs. |
| Outcome: | The proposed framework outperforms dominant text-based retrieval systems in open-ended questions. |
Improving Question Generation With to the Point Context (D19-1)
Copied to clipboard
| Challenge: | Existing sequence-to-sequence neural models may not be able to identify answer-relevant context words for question generation. |
| Approach: | They propose to model the unstructured sentence and the structured answer-relevant relation for question generation by combining to the point context and unstructure. |
| Outcome: | Experiments show that the proposed model improves on the unstructured sentence and the structured answer-relevant relation. |
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently pushed open-domain question answering (ODQA) to new heights. |
| Approach: | They propose an embedding-level framework that enhances both the retriever and the reader by reordering query representations via lightweight linear layers under an unsupervised contrastive learning objective. |
| Outcome: | The proposed framework outperforms baselines in accuracy and efficiency across three open-source LLMs, three retrieval methods, and four ODQA benchmarks. |
Exploring Hint Generation Approaches for Open-Domain Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing automatic question answering systems rely on contextual information to provide accurate answers. |
| Approach: | They propose a context preparation approach that uses Automatic Hint Generation techniques to generate hints instead of retrieved contexts. |
| Outcome: | The proposed approach surpasses retrieval-based and generation-based methods on three QA datasets. |