Papers by Yuyang Ding

7 papers
DUAL RM: Beyond Rule-based Preference Reward Modeling via Meta-Reward (2026.acl-long)

Copied to clipboard

Challenge: Existing preference-based reward modeling methods face a recursive dependency where each verifier requires a meta-verifier, leading to continuous and costly dependence on human annotation.
Approach: They propose a dual RM that couples discriminative and generative reward models under a non-parametric meta-reward.
Outcome: The proposed model achieves strong performance across major preference benchmarks and even when trained exclusively on language modality, it exhibits robust cross-modal transfer on Omni-RewardBench.
Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve the mathematical reasoning capabilities of Large Language Models (LLMs) are limited due to the proprietary nature of the data.
Approach: They propose a data synthesis method that generates large-scale mathematical reasoning datasets using lightweight 7B-scale models.
Outcome: The proposed method outperforms existing open-source datasets in both in-domain and out-of-domain evaluations and shows improvements in code reasoning tasks.
SelfMix: Robust Learning against Textual Label Noise with Self-Mixup Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to handle label noise in text classification tasks are limited to visual data.
Approach: They propose a method to handle label noise in text classification tasks using a Gaussian Mixture Model.
Outcome: The proposed method outperforms baselines on three types of text classification tasks on visual and textual data.
CMD: a framework for Context-aware Model self-Detoxification (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods of text detoxification fail to achieve a decent balance between effectiveness and generation quality.
Approach: They propose a text detoxification framework that pays attention to both context and detoxification process.
Outcome: Experiments on various LLMs show that the proposed framework can yield the best performance compared to baselines.
Rethinking Negative Instances for Generative Named Entity Recognition (2024.findings-acl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) models are constrained by a pre-defined label set and require extensive human annotations, which limits their flexibility and adaptability to unseen tasks.
Approach: They propose a Generative NER system that shows improved zero-shot performance across unseen entity domains by introducing contextual information and delineating label boundaries.
Outcome: The proposed model outperforms state-of-the-art methods in zero-shot evaluation.
Robust Question Answering against Distribution Shifts with Test-Time Adaption: An Empirical Study (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on robustness tuning (RT) methods has found that QA models fail when the test data has a distribution shift compared to the training data.
Approach: They propose to use test-time adaptation methods to improve QA models after deployment to evaluate their model against text corruption and changes in language and domain.
Outcome: The proposed method improves TTA to be more robust to variation in hyper-parameters and test distributions over time.
Escaping the Echo Trap: On Credit Assignment Failure in Multi-turn LLM Self-Reflection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for multi-turn self-reflection are limited by the Echo Trap problem . the model is limited by its inherent capabilities and repeats earlier reflections to preserve reward signals .
Approach: They propose a tree-structured extension of GRPO for multi-turn self-reflection which enables more accurate advantage estimation.
Outcome: The proposed method mitigates behavior collapse and improves performance across benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations