NGQA: A Nutritional Graph Question Answering Benchmark for Personalized Health-aware Nutritional Reasoning (2025.acl-long)
Copied to clipboard
Zheyuan Zhang, Yiyang Li, Nhi Ha Lan Le, Zehong Wang, Tianyi Ma, Vincent Galassi, Keerthiram Murugesan, Nuno Moniz, Werner Geyer, Nitesh V Chawla, Chuxu Zhang, Yanfang Ye
| Challenge: | Diet plays a critical role in human health, but tailoring dietary reasoning to individual health conditions remains a challenge. |
| Approach: | a new benchmark evaluates dietary reasoning using a national health survey data set. |
| Outcome: | The NGQA benchmark evaluates dietary reasoning across three tasks using a set of question complexity settings and baseline models. |
Similar Papers
NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question answering datasets lack numerical reasoning and reasoning processes . current research on numerical reasoning focuses on simple calculations . |
| Approach: | They propose a conversational and bilingual question answering dataset with numerical reasoning with compound mathematical expressions. |
| Outcome: | The proposed model achieves 55.5 exact match scores while human performance is 89.7. |
ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering (2025.findings-acl)
Copied to clipboard
Ahmed Masry, Mohammed Saidul Islam, Mahir Ahmed, Aayush Bajaj, Firoz Kabir, Aaryaman Kartha, Md Tahmid Rahman Laskar, Mizanur Rahman, Shadikur Rahman, Mehrad Shahmohammadi, Megh Thakkar, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty
| Challenge: | Chart Question Answering systems are limited in their ability to interpret data visually and reason with visual representations. |
| Approach: | They propose a chart-based chart question-answering system that includes 1,341 charts from 99 diverse sources and 1,948 questions in various types. |
| Outcome: | The new benchmark includes 1,341 charts from 99 diverse sources and 1,948 questions in various types. |
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Chart question answering (CQA) is a multimodal task for evaluating the reasoning capabilities of vision-language models. |
| Approach: | They propose a chart question answering benchmark that incorporates multilingual contexts and supports open-domain textual outputs. |
| Outcome: | The proposed framework outperforms the previous three common CQA paradigms: instruction-following, OCR-enhanced, and chain-of-thought. |
Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis (2022.lrec-1)
Copied to clipboard
| Challenge: | Knowledge Graph (KG) Question Answering (QA) is a rapidly growing field in research and industry. |
| Approach: | They propose to create a new leaderboard for any KGQA benchmark dataset as a focal point for the community. |
| Outcome: | The proposed model provides a central and open leaderboard for any KGQA benchmark dataset as a focal point for the community. |
Chart Question Answering from Real-World Analytical Narratives (2025.acl-srw)
Copied to clipboard
| Challenge: | a dataset for chart question answering is constructed from visualization notebooks . data visualizations are an essential modality for communicating complex information about data. |
| Approach: | They propose a dataset for chart question answering constructed from visualization notebooks . they use real-world, multi-view charts paired with natural language questions . |
| Outcome: | The proposed dataset is constructed from student-authored visualization notebooks . it features real-world, multi-view charts paired with natural language questions . initial evaluations highlight significant performance gaps . |
Biomedical Question Answering via Multi-Level Summarization on a Local Knowledge Graph (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work on how to effectively capture multi-document relationships remains an open question . Existing techniques to mitigate this problem include hierarchical summarization of semantically related chunks or integrating Knowledge Graphs (KGs). |
| Approach: | They propose a method which constructs a local knowledge graph from retrieved documents . they use propositional claims to construct a knowledge graph and contextualize a small language model . |
| Outcome: | The proposed method outperforms RAG on biomedical benchmarks and is generalizable and effective. |
DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain (2026.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language models lack fine-grained classification, single-view imagery, and inaccurate metadata. |
| Approach: | They propose a hierarchical, multi-view benchmark to evaluate VLMs across three levels of cognitive complexity. |
| Outcome: | The proposed benchmark evaluates vision-language models across three levels of complexity . it systematically identifies five primary failure modes . the proposed benchmarks are available on https://github.com/meituan/DiningBench. |
AfriMed-QA: A Pan-African, Multi-Specialty, Medical Question-Answering Benchmark Dataset (2025.acl-long)
Copied to clipboard
Charles Nimo, Tobi Olatunji, Abraham Toluwase Owodunni, Tassallah Abdullahi, Emmanuel Ayodele, Mardhiyah Sanni, Ezinwanne C. Aka, Folafunmi Omofoye, Foutse Yuehgoh, Timothy Faniran, Bonaventure F. P. Dossou, Moshood O. Yekini, Jonas Kemp, Katherine A Heller, Jude Chidubem Omeke, Chidi Asuzu Md, Naome A Etori, Aïmérou Ndiaye, Ifeoma Okoh, Evans Doe Ocansey, Wendy Kinara, Michael L. Best, Irfan Essa, Stephen Edward Moore, Chris Fourie, Mercy Nyamewaa Asiedu
| Challenge: | Recent advances in large language models (LLMs) performance on medical multiplechoice question (MCQ) benchmarks have stimulated interest from healthcare providers and patients globally. |
| Approach: | They introduce AfriMed-QA, the first largescale Pan-African English multi-specialty medical Question-Answering (QA) dataset, with 15,000 questions sourced from over 60 medical schools across 16 countries. |
| Outcome: | The proposed model outperforms other models in the medical field and is compared with other models. |
No perspective, no perception!! Perspective-aware Healthcare Answer Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | Healthcare Community Question Answering forums are prone to off-topic discussions and diverse answers can be challenging for readers to sift through. |
| Approach: | They propose a task of perspective-specific answer summarization to identify different perspectives within healthcare-related responses and frame a perspective-driven abstractive summary covering all responses. |
| Outcome: | The proposed model outperforms existing models against five baselines and shows that it is more accurate than existing models. |
Ask the experts: sourcing a high-quality nutrition counseling dataset through Human-AI collaboration (2024.findings-emnlp)
Copied to clipboard
Simone Balloccu, Ehud Reiter, Karen Li, Rafael Sargsyan, Vivek Kumar, Diego Reforgiato, Daniele Riboni, Ondrej Dusek
| Challenge: | Large Language Models (LLMs) are being used by end-users for various tasks, including sensitive ones such as health counseling, disregarding potential safety concerns. |
| Approach: | They use ChatGPT to crowd-source dietary struggles and work with nutrition experts to generate supportive text using ChatGPS. |
| Outcome: | The proposed model outperforms other models on dietary struggles and mental health tasks. |