Papers by Yudong Yang

11 papers
An Empirical Study of Position Bias in Modern Information Retrieval (2025.findings-emnlp)

Copied to clipboard

Challenge: a new evaluation framework is used to assess the extent and impact of position bias in information retrieval.
Approach: They introduce a position-aware retrieval benchmark and a diagnostic metric to quantify position bias . they compare models with BM25, dense embedding models, ColBERT-style late-interaction models .
Outcome: The proposed framework evaluates retrieval models for position bias from a worst-case perspective.
Weakly-Supervised Methods for Suicide Risk Assessment: Role of Related Domains (2021.acl-short)

Copied to clipboard

Challenge: Among social media platforms, Reddit has emerged as the most promising one due to its anonymity and its focus on topic-based communities (subreddits) . a challenge for previous work on suicide risk assessment has been the small amount of labeled data.
Approach: They propose to use social media to collect user data from r/SuicideWatch subreddit and annotate it with user-level suicide risk: no-risk, low-risk and high-risk.
Outcome: The proposed model improves by using pseudo-labeling based on related issues around mental health (e.g., anxiety, depression)
MaskTab: Scalable Masked Tabular Pretraining with Scaling Laws and Distillation for Industrial Classification (2026.findings-acl)

Copied to clipboard

Challenge: Tabular data is high-dimensional, riddled with missing entries, and rarely labeled at scale.
Approach: They propose a unified pre-training framework for industrial-scale tabular data . MaskTab encodes missing values via dedicated learnable tokens .
Outcome: The proposed framework outperforms XGBoost and MaskTab-L on industrial-scale . it achieves +5.04% AUC and +8.28% KS over prior art under rigorous scaling .
AgentAsk: Multi-Agent Systems Need to Ask (2026.acl-long)

Copied to clipboard

Challenge: Multi-agent systems fail to consistently outperform strong single-a agent baselines due to error propagation at inter-aggent message handoffs.
Approach: They propose an edge-level error taxonomy that identifies four main errors in multi-agent interactions as data gaps, signal corruption, referential drift and capacity gaps as primary sources of failure.
Outcome: The proposed module outperforms existing systems on five benchmarks and is architecture-agnostic.
Confidence v.s. Critique: A Decomposition of Self-Correction Capability for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve self-correction performance of Large Language Models are based on intrinsic selfcorrectione, which allows the model to check and revise its selfgenerated answers without external feedback.
Approach: They propose to decompose the self-correction capability into confidence and critique capabilities and a metric for overall self-corretion capability evaluation.
Outcome: The proposed method outperforms vanilla SFT and achieves much higher accuracy after self-correction.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
CAR: Empowering Agents with Dynamic Tool Synthesis and Global Trajectory Rectification (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLM agents are brittle in open-ended environments due to two limitations: 1) a closed action space; 2) myopic error recovery.
Approach: They propose a novel architecture that augments the action space and revises global strategies by adding a reflective replanning mechanism to the system.
Outcome: Experiments show that CAR outperforms baselines in a diagnostic benchmark with pruned toolsets to simulate tool scarcity.
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)

Copied to clipboard

Challenge: Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks.
Approach: They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies.
Outcome: The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%.
Parameter-efficient Continual Learning Framework in Industrial Real-time Text Classification System (2022.naacl-industry)

Copied to clipboard

Challenge: Existing continual learning methods use data replay, parameter isolation and regularization to mitigate catastrophic forgetting.
Approach: They propose a parameter-efficient continual learning framework that updates parameters offline and then trains using an online regularization method.
Outcome: The proposed framework reduces catastrophic forgetting and saves the model with the changed parameters instead of all parameters.
Audio-centric Video Understanding Benchmark without Text Shortcut (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multimodal large language models (MLLMs) focus on visual abilities, but audio is essential for video understanding.
Approach: They propose an audio-centric video understanding benchmark to evaluate video comprehension capabilities of multimodal LLMs with a particular focus on auditory information.
Outcome: The proposed video understanding benchmarks evaluate video comprehension capabilities of multimodal models with a particular focus on auditory information.
A Probabilistic Inference Scaling Theory for LLM Self-Correction (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated the capability to refine their generated answers through self-correction, enabling continuous performance improvement over multiple rounds.
Approach: They propose a probabilistic theory to model the dynamics of accuracy change and explain performance improvements observed in multi-round self-correction.
Outcome: The proposed model can predict accuracy curves and improve accuracy over multiple rounds.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations