Papers by Mengzhang Cai

4 papers
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)

Copied to clipboard

Challenge: Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations .
Approach: They propose a framework to synthesize complex charts and reliable reasoning data from scratch.
Outcome: Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models .
Heterogeneous Adaptive Policy Optimization: Tailoring Optimization to Every Token’s Nature (2026.acl-long)

Copied to clipboard

Challenge: Existing methods that use entropy as a discrete filter or post-hoc regulator are limited in their ability to optimize for reasoning tasks.
Approach: They propose a token-aware algorithm that continuously adapts optimization dynamics based on token-level entropy throughout the entire training process.
Outcome: Extensive experiments on mathematical reasoning, code, and logic tasks across multiple models demonstrate HAPO’s consistent superiority over DAPO.
Middo: Model-Informed Dynamic Data Optimization for Enhanced LLM Fine-Tuning via Closed-Loop Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to improve data quality face limitations in static dataset curation that fail to adapt to evolving model capabilities.
Approach: They propose a self-evolving framework that uses model-aware data selection and context-preserving data refinement to improve LLM performance.
Outcome: The proposed framework improves the quality of seed data and boosts LLM’s performance with improving accuracy by 7.15% on average while maintaining the original dataset scale.
MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer (2025.findings-emnlp)

Copied to clipboard

Challenge: Current paradigms generate CoT and answers directly for a given problem, diverging from human problem-solving strategies to some extent.
Approach: They propose a framework that explicitly prompts LLMs to recall and reflect on meta-problems alongside their CoT solutions before addressing the target problem.
Outcome: The proposed framework outperforms standard CoT-based methods on mathematical benchmarks and significantly improves their reasoning accuracy.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations