Papers by Zhenyu Yang

17 papers
L2Dir: Integrating L_2-Norm and Directional Alignment for Unsupervised Contrastive Representation Learning in Multimodal Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to multimodal representation learning focus on directional alignment and embedding magnitudes (L2-norm) however, these methods often fail to account for the intrinsic role of L2-norm in the contrastive process.
Approach: They propose a plug-and-play framework that optimizes L2-norm alignment and Directional consistency jointly.
Outcome: The proposed framework achieves consistent and significant performance gains over established baselines across 95 tasks using UniIR and VLM2Vec-V2 frameworks.
Robust Machine Reading Comprehension by Learning Soft labels (2020.coling-main)

Copied to clipboard

Challenge: Neural models have achieved great success on the task of machine reading comprehension, which are typically trained on hard labels.
Approach: They propose a robust training method for machine reading comprehension models to address label sparseness problem by using three strategies to train models on soft labels.
Outcome: The proposed method improves the baseline model performance and achieves state-of-the-art performance on NewsQA and QUOREF.
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)

Copied to clipboard

Challenge: Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK).
Approach: They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK.
Outcome: The proposed model outperforms state-of-the-art methods on two popular datasets.
Accelerating Dense LLMs via L0-regularized Mixture-of-Experts (2025.acl-short)

Copied to clipboard

Challenge: Existing methods for accelerating large language models (LLMs) suffer from slow and costly inference.
Approach: They propose a lightweight MoE approach using cluster confusion matrix and dynamic batching to accelerate dense LLMs.
Outcome: The proposed method achieves 2.5x speedup over dense models while maintaining competitive performance.
Enhanced Language Representation with Label Knowledge for Span Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to extract text spans from plain text do not fully exploit label knowledge.
Approach: They propose a model to integrate label knowledge into text representations by encoding texts and annotations independently and then integrating label knowledge with an elaborate-designed semantics fusion module.
Outcome: The proposed model achieves state-of-the-art performance on four benchmarks and reduces training time and inference time by 76% and 77% on average compared with the existing paradigm.
LaMemo: Language Modeling with Look-Ahead Memory (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to model long-term dependencies are limited to long texts with thousands of words.
Approach: They propose a look-ahead memory that augments the recurrence memory by attending to the right-side tokens and interpolating with the old memory states to maintain long-term information in the history.
Outcome: Experiments on widely used language modeling benchmarks show that LaMemo outperforms baseline models with recurrence memory.
A Versatile Adaptive Curriculum Learning Framework for Task-oriented Dialogue Policy Learning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing training paradigms for dialogue policy learning with brute-force random sampling are expensive and lack reliable evaluation of difficulty scores.
Approach: They propose a flexible adaptive curriculum learning framework that integrates curriculum learning with a generic global curriculum.
Outcome: The proposed framework improves learning performance and efficiency on three public dialogue datasets.
SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution (2026.findings-acl)

Copied to clipboard

Challenge: SWE-Swiss-32B demonstrates strong generalization to other common LLM benchmarks.
Approach: They propose a two-phase training recipe that decomposes issue resolution into three core skills: Localization, Repair, and Unit Test Generation.
Outcome: The proposed model achieves a 60.2% score on the SWE-bench Verified benchmark and is in the top-tier performance bracket of much larger models.
OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) lack visual-aware tutorial retrieval and historical visual context curation and pruning.
Approach: They propose a framework that integrates an orchestrator and a Reflection-Memory Agent for robust automation.
Outcome: Experimental results show that OS-Symphony delivers substantial performance gains across model scales.
PUPPET: Neural-Symbolic Standardized Patients for Mental Health (2026.acl-long)

Copied to clipboard

Challenge: Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback.
Approach: They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states.
Outcome: The proposed model outperforms baselines in faithfulness and pedagogical value.
DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents (2026.findings-acl)

Copied to clipboard

Challenge: Mobile Phone Agents (MPAs) have attracted huge attention due to their practicability in a multitude of scenarios.
Approach: They propose a data mixture optimization solution that extrapolates optimal data mixtures from a trainable network.
Outcome: The proposed model outperforms existing methods on open-source benchmarks and on open source benchmarks.
ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to managing context are based on raw accumulation or passive summarization, treating it as static artifact and allowing early errors or misplaced emphasis to persist.
Approach: They propose a framework that treats context as a dynamic internal reasoning state during execution.
Outcome: Experiments on long-horizon information-seeking benchmarks show that ARC outperforms passive context compression methods.
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems.
Approach: They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems.
Outcome: The proposed approach achieves significant performance improvements over the state-of-the-art methods.
MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments (2026.acl-long)

Copied to clipboard

Challenge: AndroidWorld is the dominant mobile GUI agent evaluation benchmark, but its success rates are low . despite reproducible emulator environment, it lacks key application categories such as e-commerce and enterprise communication.
Approach: They propose a benchmark for mobile GUI agents that reflects real-world usage through long-horizon, cross-application workflows.
Outcome: The proposed framework achieves over 90% success rates, while AndroidWorld is the dominant benchmark.
Submodular-based In-context Example Selection for LLMs-based Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Prior studies have focused on the role of well-chosen examples in in-context learning .
Approach: They propose to use multiple translational factors for in-context example selection by using monotone submodular function maximization.
Outcome: The proposed approach outperforms random selection and robust single-factor baselines across various NLP tasks.
MalayMMLU: A Multitask Benchmark for the Low-Resource Malay Language (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Large Vision Language Model (LVLMs) exhibit advanced proficiency in language reasoning and comprehension across a wide array of languages.
Approach: They propose to use a multitask language understanding benchmark specifically designed for the Malay language to assess their proficiency.
Outcome: The proposed model performs well in well-resourced languages, but in low-resource languages such as Bahasa Melayu, they are less studied due to a lack of studies and benchmarks.
Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to increasing effective depth of LLMs rely on parameter reuse, extending computation through recursive execution.
Approach: They propose a training-time sparse depth allocation framework that progressively increases depth for a small subset of parameters as training evolves.
Outcome: The proposed model outperforms existing approaches to increasing the effective depth of language models while reducing training FLOPs overhead from approximately 16–20% to only 1–3% relative to a standard Transformer backbone.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations