David vs. Goliath: Cost-Efficient Financial QA via Cascaded Multi-Agent Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable reasoning capabilities, but performance in FQA remains limited. |
| Approach: | They propose a low-cost yet effective framework that enables small LLMs to perform complex reasoning tasks without expensive models. |
| Outcome: | The proposed framework outperforms the best open-source model on BizBench by 10.46% and achieves competitive performance to GPT-3.5 using significantly fewer parameters. |
Similar Papers
Synthesizing question answering data from financial documents: An End-to-End Multi-Agent Approach (2026.eacl-industry)
Copied to clipboard
| Challenge: | Large language models excel at financial reasoning but their deployment for enterprise use cases remains costly and often constrained by latency, privacy, and regulatory requirements. |
| Approach: | They propose a pipeline that extracts and selects relevant content from unstructured financial documents and generates QA pairs from the selected content for SLM fine-tuning. |
| Outcome: | The proposed model outperforms models trained on previous manual models and achieves competitive in-distribution performance. |
BizBench: A Quantitative Reasoning Benchmark for Business and Finance (2024.acl-long)
Copied to clipboard
| Challenge: | Answering questions within business and finance requires reasoning, precision, and a wide-breadth of technical knowledge. |
| Approach: | They propose a benchmark for evaluating models’ ability to reason about realistic financial problems by focusing on question-answering over financial data via program synthesis. |
| Outcome: | The proposed benchmark evaluates models' financial background knowledge, ability to parse financial documents, and capacity to solve complex problems with code. |
FinQA: A Dataset of Numerical Reasoning over Financial Data (2021.emnlp-main)
Copied to clipboard
Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, William Yang Wang
| Challenge: | Popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. |
| Approach: | They propose a large-scale dataset with Question-Answering pairs over financial reports written by financial experts to facilitate analytical progress. |
| Outcome: | The proposed dataset is the first of its kind and is available on github. |
XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) lack advanced capabilities such as temporal reasoning, future forecasting, and numerical modeling. |
| Approach: | They propose a benchmarking tool to evaluate LLMs' ability to solve complex financial problems across diverse graduate-level finance topics with multi-modal context. |
| Outcome: | The proposed model improves on the o1 model but still lags behind human experts in temporal reasoning and scenario planning capabilities. |
Automate Strategy Finding with LLM in Quant Investment (2025.findings-emnlp)
Copied to clipboard
Zhizhuo Kou, Holam Yu, Junyu Luo, Jingshu Peng, Xujia Li, Chengzhong Liu, Juntao Dai, Lei Chen, Sirui Han, Yike Guo
| Challenge: | Experimental results demonstrate robust performance of the strategy in Chinese & US market regimes compared to established benchmarks. |
| Approach: | They propose a framework leveraging Large Language Models within a risk-aware multi-agent system for automate strategy finding in quantitative finance. |
| Outcome: | The proposed framework outperforms all benchmarks in Chinese & US market regimes with 53.17% cumulative return on SSE50. |
FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging (2025.acl-long)
Copied to clipboard
Zichen Tang, Haihong E, Ziyan Ma, Haoyang He, Jiacheng Liu, Zhongjun Yang, Zihua Rong, Rongjin Li, Kun Ji, Qing Huang, Xinyang Hu, Yang Liu, Qianhe Zheng
| Challenge: | Compared to existing benchmarks, FinanceReasoning provides three key advancements: (1) credibility; (2) comprehensiveness; (3) numerical precision; (4) complexity; (5) complexity; and (6) complexity. |
| Approach: | They propose a benchmark to evaluate the reasoning capabilities of large reasoning models (LRMs) in financial numerical reasoning problems. |
| Outcome: | The proposed benchmark exceeds existing benchmarks in 67.8% of financial concepts and formulas and is credible, comprehensive, and challenging. |
FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for numerical reasoning in multilingual Indic languages are inadequate . e.g., FinVQA is a framework for evaluating financial numerical reasoning . |
| Approach: | They propose a framework that combines supervised fine-tuning with constraint-aware decoding to promote faithful numerical reasoning. |
| Outcome: | The proposed framework spans English, Hindi, Bengali, Marathi, Gujarati, and Tamil . it combines supervised fine-tuning with constraint-aware decoding to promote faithful numerical reasoning . |
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)
Copied to clipboard
Junzhe Jiang, Chang Yang, Aixin Cui, Sihan Jin, Yujing Zhang, Yilin Xiao, Ruiyu Wang, Bo Li, Xiao Huang, Danny Dongning Sun, Xinrun Wang
| Challenge: | Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation. |
| Approach: | a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 . |
| Outcome: | a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 . |
LLMs Cannot (Yet) Match the Specificity and Simplicity of Online Communities in Long Form Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have positioned Large Language Models (LLMs) as powerful question answering (QA) tools, shifting users away from interacting in communities towards discourse with AI-driven conversational interfaces. |
| Approach: | They propose to use a QA preference dataset to fine-tune and align Large Language Models (LLMs) from more than 7.4 million submissions and 82 million comments from 2008 to 2022 in Reddit’s 15 largest finance communities. |
| Outcome: | The proposed framework improves on the social quality of the data, and the proposed framework is more accurate and more specific. |
What Factors Affect LLMs and RLLMs in Financial Question Answering? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on large language models and reasoning large language model (RLLMs) however, there are few studies that explore what methods can fully unlock the performance of LLMs and RLLM in the financial domain. |
| Approach: | They examine the effects of prompting methods, agentic frameworks, and multilingual alignment methods on financial question-answering tasks. |
| Outcome: | The results show that prompting methods and agent frameworks improve LLMs' performance . the authors suggest that these frameworks can be used to enhance LLM performance if they are implemented in financial domains. |