Papers by Jiaming Guo

17 papers
Omni-RewardBench: Toward a Comprehensive Evaluation of Generative Reward Models Across Modalities (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for ORMs are largely text-centric or limited to bimodal tasks . a new study examines the effectiveness of Omni-RewardBench for ORms across modalities .
Approach: They propose a hybrid automatic-annotation and human-verification pipeline to construct high-quality evaluation data.
Outcome: The proposed model is the first benchmark for comprehensive evaluation of ORMs across modalities.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to program repair are based on correctness alone.
Approach: They propose a framework that mitigates over-editing and improves repair accuracy by generating buggy programs and re-edits.
Outcome: The proposed framework improves repair precision by 31.4% under fix1@1, a metric that considers repair correctness and extent, and significantly increases decoding throughput when combined with speculative editing.
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)

Copied to clipboard

Challenge: Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0.
Approach: They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes.
Outcome: The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation.
SafeMT: Multi-turn Safety for Multimodal Language Models (2026.acl-long)

Copied to clipboard

Challenge: Multi-turn dialogues pose a greater risk than single prompts, but existing safety benchmarks do not account for this situation.
Approach: They propose a benchmark that features dialogues of varying lengths generated from harmful queries accompanied by images.
Outcome: The proposed model reduces multi-turn Attack Success Rate (ASR) compared to existing guard models.
Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA (2025.findings-acl)

Copied to clipboard

Challenge: Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model.
Approach: They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering.
Outcome: The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies.
ChildTalk: A Multi-Dialect Chinese Child Speech Corpus with Full-Length Child–Caregiver Conversations for Speech Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Automatic speech recognition (ASR) for children remains challenging due to developmental variability and the scarcity of high-quality corpora.
Approach: They propose a large-scale Chinese child speech corpus that contains 112.5 hours of speech from 498 children and 500 caregivers.
Outcome: The proposed model improves in-domain and cross-domain performance on children's speech.
Ex3: Automatic Novel Writing by Extracting, Excelsior and Expanding (2024.acl-long)

Copied to clipboard

Challenge: Generating long-term texts using artificial intelligence has always been a challenge . however, the generated novels exhibit poor logical coherence and appeal in their plots and deficiencies in character and event depiction, ultimately compromising the overall narrative quality.
Approach: They propose a method for extracting excelsior and expanding from novel data to generate arbitrarily long novels using large language models.
Outcome: The proposed method produces high-quality long-form novels with a high level of logical coherence and appeal despite the use of large language models.
Benchmarking Fine-Grained Error Detection in Multimodal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Multimodal Process Reward Models (MPRMs) have emerged as a pivotal framework for enhancing the reasoning capabilities of Multimodal Large Language Models.
Approach: They propose a benchmark specifically designed to evaluate MPRMs’ proficiency in detecting erroneous reasoning steps across diverse error categories.
Outcome: The proposed model achieves up to 4.8% performance improvement through test-time scaling.
MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for AI math tutoring largely overlook these skills.
Approach: They evaluate 12 leading multimodal large language models and find clear performance gaps between them.
Outcome: The proposed benchmarks show that they can solve 770 problems and provide diagnostics and guidance to students step by step.
LegalReasoner: Step-wised Verification-Correction for Legal Judgment Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing legal judgment prediction methods struggle with logical errors when conducting complex legal reasoning.
Approach: They propose a method which enhances LJP reliability through step-wise verification and correction of the reasoning process.
Outcome: The proposed model significantly improves concordance with court decisions from 72.37 to 80.27 on LLAMA-3.1-70B.
PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Using large-scale annotation data, large language models can generate noise, errors and biases, leading to unexpected behaviours.
Approach: They propose a dataset to promote safety alignment in large language models . they separate helpfulness and harmlessness annotations for question-answering pairs .
Outcome: The proposed dataset provides 44.6k prompts and 265k question-answer pairs with safety meta-labels for 19 harm categories and three severity levels, with answers generated by Llama-family models.
SafeLawBench: Towards Safe Alignment of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies indicate that large language models (LLMs) may exhibit risks, including threats to the protection of private data and the generation of hallucinations.
Approach: They propose to evaluate LLMs from a legal perspective using the SafeLawBench benchmark.
Outcome: The proposed framework categorizes safety risks into three levels based on legal standards and includes 24,860 multi-choice questions and 1,106 open-domain question-answering tasks.
When Slower Isn’t Truer: Inverse Scaling Law of Truthfulness in Multimodal Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: a study of slow reasoning models for multimodal reasoning finds that they are more prone to fabricating plausible yet false details when confronted with incomplete or misleading visual inputs.
Approach: They conduct the first systematic study of the inverse scaling law in slow-thinking paradigms for multimodal reasoning.
Outcome: The findings suggest that slower reasoning models are more prone to fabricating false details . the study analyzed 5,000-sample hierarchical prompt dataset by 50 participants .
Benchmarking Multi-National Value Alignment for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on large language models focus on ethical reviews, failing to capture the diversity of national values.
Approach: They propose a national value extraction pipeline to efficiently construct value assessment datasets and a model-based model with instruction tagging to process raw data sources.
Outcome: The proposed benchmark evaluates the alignment of LLMs with the values of five major nations: China, the United States, the UK, France, and Germany.
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain.
Approach: They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators.
Outcome: The proposed model performs better than state-of-the-art models, highlighting its challenging nature.
Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study (2025.emnlp-main)

Copied to clipboard

Challenge: Large Audio-Language Models (LALMs) are increasingly being deployed in real-world applications, yet their robustness against malicious audio injection remains underexplored.
Approach: They quantitatively assess their vulnerabilities and resilience using metrics: the Defense Success Rate, Context Robustness Score, and Judgment Robustic Index.
Outcome: The proposed models demonstrate significant performance disparities across four attack scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations