Papers by Yang Duan

40 papers
Static Models, Dynamic World: A Unified Perspective on Temporal Perception in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models are trained on static corpora but deployed in a dynamic world . a foundational tension remains between time and the ability to understand it .
Approach: They formalize temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers.
Outcome: The proposed framework formalizes temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers . the framework induces four temporal information regimes corresponding to internal reasoning, answer recency, premise anchoring, and genuine world indeterminacy .
README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLP (2024.findings-emnlp)

Copied to clipboard

Challenge: a new task is to generate lay definitions of medical terms in EHRs that are difficult to understand for patients.
Approach: They propose a task of automatically generating lay definitions to simplify medical terms into patient-friendly lay language.
Outcome: The proposed model can match or surpass state-of-the-art closed-source large language models like ChatGPT with high-quality data.
An Evaluation Resource for Grounding Translation Errors (2025.findings-emnlp)

Copied to clipboard

Challenge: Current fine-grained error analyses do not ground the errors to the reasons why the annotated text spans are erroneous.
Approach: They use a bi-directional grounding scheme to ground erroneous text in two directions . if the error spans of both directions are consistent, the explanation is valid .
Outcome: The proposed grounding process improves translation error detection significantly.
BARLE: Background-Aware Representation Learning for Background Shift Out-of-Distribution Detection (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for OOD detection focus on identifying semantic-shift OOD samples . background-shift detection is more practical but challenging .
Approach: They propose a background-aware representation learning approach for background-shift OOD detection in NLP.
Outcome: The proposed method improves background-shift OOD detection while maintaining ID classification accuracy.
Rethinking Depression Prediction from a Fine-Grained Subscore Modeling Perspective via Multi-Task Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for depression assessment rely on standardized ratings, but they are time-consuming and subject to inter-rater variability.
Approach: They propose a fine-grained model for subscore prediction via multi-task learning that can be used to predict depression severity using multiple tasks.
Outcome: The proposed model outperforms baselines and Qwen3-14B direct scoring on the public E-DAIC dataset and to a large-scale private clinical dataset.
Asking Clarification Questions in Knowledge-Based Question Answering (D19-1)

Copied to clipboard

Challenge: Existing clarification datasets with limited annotated examples do not address ambiguous phenomena.
Approach: They propose a dataset that allows users to ask clarification questions using open-domain examples.
Outcome: The proposed model achieves better performance than strong baselines and provides new challenges.
AudioVSR: Enhancing Video Speech Recognition with Audio Data (2024.emnlp-main)

Copied to clipboard

Challenge: Recent work has shown poor performance with non-Indo-European languages . previous work primarily utilizes video information to build VSR models .
Approach: They propose a generative model for data inflation that integrates synthetic data with authentic visual data to enhance the VSR model.
Outcome: The proposed model improves on the audio-visual alignment problem in audio-video tasks.
Forget the Unneeded: Backdooring Large Language Models via Contrastive-enhanced Machine Unlearning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios.
Approach: They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns .
Outcome: The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects.
Revealing the Numeracy Gap: An Empirical Investigation of Text Embedding Models (2026.findings-eacl)

Copied to clipboard

Challenge: Text embedding models are widely used in natural language processing but are often benchmarked on tasks that do not require understanding nuanced numerical information in text.
Approach: They evaluate 13 widely used text embedding models and find they struggle to capture numerical details accurately.
Outcome: The proposed models struggle to capture nuanced numerical details accurately, despite being benchmarked on tasks that do not require understanding nuance.
PlotGen-Bench: Evaluating VLMs on Generating Visualization Code from Diverse Plots across Multiple Libraries (2026.findings-acl)

Copied to clipboard

Challenge: PlotGen-Bench evaluates vision-language models' ability to generate executable visualization code from plots under realistic and complex visualization requirements.
Approach: They propose a benchmark to evaluate plot-to-code generation in vision-language models . they use Matplot, Matplos, Mat3D, Mat4D, and Mat4E to evaluate their performance .
Outcome: The proposed benchmark covers 9 major categories, 30 subcategories, and 3 core tasks . it covers 2D, 3D and animated plots across 5 widely used visualization libraries.
Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models require a balance between efficiency and performance.
Approach: They propose a low-rank compression technique that reduces non-essential parameters by decomposing weight matrices into products of two low-ranked matrici.
Outcome: The proposed method outperforms existing pruning and low-rank compression techniques in maintaining model performance at the same compression ratio.
ObfusLM: Privacy-preserving Language Model Service against Embedding Inversion Attacks (2025.acl-long)

Copied to clipboard

Challenge: Recent studies show that obfuscation techniques for MLaaS are susceptible to embedding inversion attacks (EIAs).
Approach: They propose a model obfuscation framework that protects client inputs from embedding inversion attacks by obliviously obbing models.
Outcome: The proposed framework outperforms existing works in utility by 10% with a nearly 80% resistance rate against embedding inversion attacks.
Tuning Less, Prompting More: In-Context Preference Learning Pipeline for Natural Language Transformation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to natural language transformation (NLT) tasks face significant challenges, such as the computational costs of leveraging large pre-trained models and the limited generalization ability of fine-tuned smaller models.
Approach: They propose a framework that combines prompting with fine-tuning to enhance smaller models by integrating In-Context Examples from retrieval.
Outcome: The proposed framework outperforms existing methods across MT and TST tasks.
CMMLU: Measuring massive multitask language understanding in Chinese (2024.findings-acl)

Copied to clipboard

Challenge: Existing large language models struggle to achieve an accuracy of even 60%, which is the pass mark for Chinese exams.
Approach: They propose to use CMMLU to evaluate Chinese multilingual and Chinese LLMs in a comprehensive benchmark that covers various subjects and settings.
Outcome: The proposed benchmark covers natural sciences, social sciences, engineering, and the humanities and aims to improve on existing models.
Value Compass Benchmarks: A Comprehensive, Generative and Self-Evolving Platform for LLMs’ Value Evaluation (2025.acl-demo)

Copied to clipboard

Challenge: Current evaluation methods for large language models face two key challenges: 1. evaluation validity and 2. Result interpretation reduce the pluralistic and incommensurable values to one-dimensional scores.
Approach: They propose a platform for comprehensive value diagnosis of large language models (LLMs) that provides a generative evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs.
Outcome: The proposed platform provides a framework for comprehensive value diagnosis of large language models (LLMs) with fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, customized comparisons, and visualized analysis of LLM’s alignment with cultural values.
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
Learning Numeracy: A Simple Yet Effective Number Embedding Approach Using Knowledge Graph (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing models for numeracy-intensive applications fail to learn numerability . existing models fail to handle numbers, resulting in performance problems .
Approach: They propose a number embedding approach that embeds numbers into dimensional space . they construct a knowledge graph consisting of number entities and magnitude relations .
Outcome: The proposed method is easy to implement and shows that it performs well on numeracy-related tasks.
ICL-Bandit: Relevance Labeling in Advertisement Recommendation Systems via LLM (2025.findings-emnlp)

Copied to clipboard

Challenge: In-context learning (ICL) is a common practice to enhance LLM performance on domain-specific tasks.
Approach: They propose a method that leverages large language models to enhance query-ad relevance labeling . they identify and provide superior demonstrations for ICL, thereby improving labeling performance .
Outcome: The proposed method improves query-ad relevance labeling performance by providing demonstrations.
MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition (2024.findings-emnlp)

Copied to clipboard

Challenge: emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models.
Approach: They propose a two-stage compression method tailored for Mixture of Experts to reduce the model size and decrease the computational cost.
Outcome: The proposed method reduces model size and improves inference efficiency while maintaining performance in various zero-shot tasks.
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching (2025.acl-long)

Copied to clipboard

Challenge: Existing methods focus on disentangling speakers and content, while others focus on preserving the source's prosody.
Approach: They propose a rhythm-controllable and efficient zero-shot voice conversion model that transforms the source speaker’s timbre into an unseen one while retaining speech content.
Outcome: The proposed model adapts the linguistic content duration to the desired speaking style, facilitating the transfer of the target speaker’s rhythm.
ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to managing context are based on raw accumulation or passive summarization, treating it as static artifact and allowing early errors or misplaced emphasis to persist.
Approach: They propose a framework that treats context as a dynamic internal reasoning state during execution.
Outcome: Experiments on long-horizon information-seeking benchmarks show that ARC outperforms passive context compression methods.
BrainLoc: Brain Signal-Based Object Detection with Multi-modal Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: BrainLoc is a lightweight object detection model guided by fMRI signals.
Approach: They propose a brain-based object detection model guided by fMRI signals . they employ a multi-modal alignment strategy that enhances fmr feature extraction .
Outcome: The proposed model improves fMRI-based object detection accuracy and convenience.
Extending Complex Logical Queries on Uncertain Knowledge Graphs (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on logical queries on knowledge graphs overlook the incompleteness of KGs.
Approach: They propose an ML-based approach to answer soft queries on uncertain knowledge . they propose to use forward inference and backward calibration to avoid catastrophic errors .
Outcome: The proposed method ensures there are no catastrophic cascading errors while maintaining the same complexity as state-of-the-art inference algorithms for first-order queries.
High-order Joint Constituency and Dependency Parsing (2024.lrec-main)

Copied to clipboard

Challenge: Syntactic parsing aims to reveal how sentences are syntactically structured.
Approach: They propose to produce compatible constituency and dependency trees simultaneously for input sentences . they adopt a much more efficient decoding algorithm and explore joint modeling at training phase .
Outcome: The proposed model significantly improves matching ratio of whole trees compared to separate models . the proposed model adopts a much more efficient decoding algorithm .
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)

Copied to clipboard

Challenge: XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios .
Approach: They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora.
Outcome: The proposed dataset is labeled in English and includes only natural language understanding tasks.
Exploring the Relationship between In-Context Learning and Instruction Tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: In-Context Learning (ICL) and Instruction Tuning (IT) are two primary paradigms of adopting Large Language Models (LLMs) to downstream applications, but they are significantly different.
Approach: They examine how the hidden states of Large Language Models change in these two paradigms by examining how they differ in implementation.
Outcome: The proposed model changes the hidden states of LLMs as if its accompanying demonstrations were used to instructionally tune the model.
Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on correctness, overlooking optimality . large language models excel at math, coding, logic and puzzles .
Approach: They propose a framework for training and evaluating Large Language Models on NP-hard optimization problems through quality-aware RLVR.
Outcome: The proposed framework outperforms existing benchmarks on math, coding, logic and puzzles.
MetaFill: Text Infilling for Meta-Path Generation on Heterogeneous Information Networks (2022.emnlp-main)

Copied to clipboard

Challenge: Existing meta-path generation methods cannot fully exploit rich textual information in HINs.
Approach: They propose a text-infilling-based approach to generate meta-paths from textual information in HINs.
Outcome: The proposed approach can classify edges in the zero-shot setting, where existing methods cannot generate meta-paths.
Submodular-based In-context Example Selection for LLMs-based Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Prior studies have focused on the role of well-chosen examples in in-context learning .
Approach: They propose to use multiple translational factors for in-context example selection by using monotone submodular function maximization.
Outcome: The proposed approach outperforms random selection and robust single-factor baselines across various NLP tasks.
Gold-Medal-Level Olympiad Geometry Solving with Efficient Heuristic Auxiliary Constructions (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for geometry theorem proving in Euclidean geometry are challenging and require a neural network to perform.
Approach: They propose a method for adding auxiliary points in geometry that runs on CPUs without relying on neural network-based inference.
Outcome: The proposed method achieves silver-medal-level human performance on IMO-30 benchmark.
Basic Reading Distillation (2025.acl-long)

Copied to clipboard

Challenge: Large language models require high computational resources which limits their deployment in real-world applications.
Approach: They propose to distill large language models into smaller language models by either knowledge distillation or task distillation.
Outcome: The proposed model outperforms or performs comparable to over 20x bigger LLMs on language inference benchmarks and BIG-bench tasks.
Execution as Verification: Fine-Grained Self-Correcting Reasoning for Complex KBQA (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable.
Approach: They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback.
Outcome: The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets.
Compare to The Knowledge: Graph Neural Fake News Detection with External Knowledge (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for fake news detection rely on linguistic and semantic features from news content and do not exploit external knowledge.
Approach: They propose a graph neural model which compares news to knowledge base through entities for fake news detection.
Outcome: The proposed model significantly outperforms state-of-the-art methods on two benchmark datasets.
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing work generates long videos segment by segment sequentially, which is inefficient.
Approach: They propose a Diffusion over Difference architecture for eXtremely Long video generation.
Outcome: The proposed architecture reduces the average inference time from 7.55min to 26s (94.26%) and generates high-quality long videos with both global and local coherence.
MultiAgentESC: A LLM-based Multi-Agent Collaboration Framework for Emotional Support Conversation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on generating responses directly and neglect integration of domain-specific reasoning and expert interaction.
Approach: They propose a training-free multi-agent collaboration framework for ESC to emulate human-like process of providing emotional support through dialogue analysis, strategy deliberation, and response generation.
Outcome: The proposed framework excels at providing emotional support and diversifying support strategy selection.
Thinking Beyond the Local: Multi-View Instructed Adaptive Reasoning in KG-Enhanced LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for large language models adopt query-driven iterative reasoning from a local perspective, limiting efficiency and accuracy for complex multi-hop tasks.
Approach: They propose a multi-view instructed adaptive reasoning of LLM on Knowledge Graphs that allows LLMs to plan, evaluate, and adapt reasoning paths from a global perspective.
Outcome: The proposed model overcomes the limitations of local exploration by enabling LLMs to plan, evaluate, and adapt reasoning paths from a global perspective.
Allies: Prompting Large Language Model with Beam Search (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to build LLMs with stacking are limited by their information coverage and low fault tolerance.
Approach: They propose a method that leverages large language models to iteratively generate new queries from an input query.
Outcome: The proposed method outperforms baselines on open-domain question answering benchmarks.
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)

Copied to clipboard

Challenge: Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows .
Approach: They propose a repository-level evaluation benchmark to assess security of AI-generated code.
Outcome: The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation.
Graph Neural News Recommendation with Unsupervised Preference Disentanglement (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to learn informative user and news representations fail to consider high-order connectivity underlying the user-news interactions.
Approach: They propose a novel Graph Neural News Recommendation model with Unsupervised Preference Disentanglement which can encode high-order relationships into user and news representations by information propagation along the graph.
Outcome: The proposed model can encode high-order relationships into user and news representations by information propagation along the graph and disentangle latent preference factors by a neighborhood routing algorithm.
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Existing open-source multi-modal large language models (MLLMs) focus on enhancing foundational capabilities, leaving a significant gap in human preference alignment.
Approach: They propose a dataset of 200K high-quality training samples featuring diverse images, complex questions, and varied response formats to improve MLLMs’ alignment with human preferences.
Outcome: The proposed dataset of 200K high-quality training samples improves human preference alignment while maintaining or enhancing performance on standard VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations