Improving Health Question Answering with Reliable and Time-Aware Evidence Retrieval (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing question answering systems rely on pre-selected and annotated evidence documents, thus making them inadequate for addressing novel questions. |
| Approach: | They propose to use the common retrieve-then-read QA pipeline and PubMed as a trustworthy collection of medical research documents to answer health questions from three diverse datasets. |
| Outcome: | The proposed approach improves the macro F1 score by 10% by utilizing the common retrieve-then-read QA pipeline and PubMed as a trustworthy collection of medical research documents. |
Similar Papers
Towards Multi-Document Question Answering in Scientific Literature: Pipeline, Dataset, and Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing QA systems do not strictly enforce cross-document synthesis or exploit the explicit inter-paper structure that links sources. |
| Approach: | They propose a pipeline methodology for constructing a multi-document academic QA dataset . they detect communities based on citation networks and leverage Large Language Models . |
| Outcome: | The proposed method generates QA pairs related to multi-document content automatically and forms coherent communities based on citation networks and large language models. |
Retrieving Support to Rank Answers in Open-Domain Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | a novel question answering architecture retrieves content relevant to the combined pair . previous work on automatic claim verification has shown hallucinations . |
| Approach: | They propose a question-answer architecture that prioritizes supporting evidence . it retrieves paragraphs that directly substantiate the correctness of a with respect to q . |
| Outcome: | The proposed approach can be used by large language models to retrieve explanatory paragraphs that ground their reasoning. |
PubMed Reasoner: Dynamic Reasoning-based Retrieval for Evidence-Grounded Biomedical Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to QA provide inaccurate answers but lack mechanisms to iteratively refine poor queries. |
| Approach: | They propose a biomedical question answering agent that performs self-critic query refinement . they propose re-reflection methods that kick in only after full retrieval is completed . |
| Outcome: | a biomedical question answering agent achieves 78.32% accuracy on PubMedQA . the proposed approach provides practical assistance to clinicians and biomedically researchers . |
Towards semantic reliable clinical QA: Query pipeline optimization for cancer patient question answering systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are promising for medical Question-Answering but suffer from hallucinations that jeopardize patient safety. |
| Approach: | They propose a three-level controllable metadata-aware framework optimized for Cancer Patient QA (CPQA) they propose combining semantic retrieval with real-time Boolean search to overcome metadata blindness. |
| Outcome: | The proposed framework improves the answer accuracy of Claude-3-haiku by 5.24% over chain-of-thought prompting and about 3% over a naive RAG setup. |
SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering (2021.eacl-demos)
Copied to clipboard
| Challenge: | Open-domain question answering (QA) requires large amounts of resources and is difficult to reproduce results due to complex configurations. |
| Approach: | They propose a simple and fair evaluation framework for open-domain question answering (QA) it modularizes the pipeline open- domain QA system, making it easily accessible . |
| Outcome: | The proposed evaluation framework is publicly available and anyone can contribute to the code and evaluations. |
Open-Domain Question Answering (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering (QA) |
| Approach: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering . focus will shift to cutting- edge models proposed for open- domain QA . |
| Outcome: | The tutorial will cover cutting-edge research in open-domain question answering (QA) it will cover two-stage retriever-reader approaches, dense retriever and end-to-end training, and retriever free methods . |
When to Read Documents or QA History: On Unified and Selective Open-domain QA (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work aims to answer factoid questions from an open set of domains using knowledge sources. |
| Approach: | They propose to use QA-pair and document corpora to answer open-domain questions . they propose to apply natural follow-up to both models to find answers . |
| Outcome: | The proposed method is validated on natural questions and TriviaQA. |
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Question Answering (QA) is a growing area of research . state-of-the-art QA models struggle on out-of domain documents without fine-tuning . |
| Approach: | They propose a pipeline for validating and training QA data and an interface for human annotation. |
| Outcome: | The proposed pipeline improves QA performance on domain-specific datasets while preserving the accuracy of the model. |
Question Answering in the Biomedical Domain (P19-2)
Copied to clipboard
| Challenge: | False positive questions require specific knowledge, common sense or a procedure due to ambiguity or the scope of the question. |
| Approach: | False q is a question answering technique that uses natural language to find an answer . Falsity is based on a lexical gap and quality of answer spans . |
| Outcome: | Using the proposed system, patients can self-diagnose without sacrificing quality of answer spans. |
Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision (2022.coling-1)
Copied to clipboard
Khalil Mrini, Harpreet Singh, Franck Dernoncourt, Seunghyun Yoon, Trung Bui, Walter W. Chang, Emilia Farcas, Ndapa Nakashole
| Challenge: | Current medical question answering systems have difficulty processing long, detailed and informally worded questions . a growing number of approaches attempt to enhance the processing of consumer health questions - or medical question understanding . |
| Approach: | They propose a medical question understanding and answering system with knowledge grounding and semantic self-supervision that matches a user question with a trusted medical knowledge base and retrieves a fixed number of relevant sentences from the corresponding answer document. |
| Outcome: | The proposed system retrieves more relevant answers while achieving 20 times faster. |