Papers by Yifei He

13 papers
Semi-Supervised Reward Modeling via Iterative Self-Training (2024.findings-emnlp)

Copied to clipboard

Challenge: Reward models capture values and preferences of humans and are used in Reinforcement Learning with Human Feedback (RLHF) Traditionally, training large language models relies on extensive human-annotated preference data, which poses significant challenges in terms of scalability and cost.
Approach: They propose a method that enhances RM training using unlabeled data.
Outcome: The proposed approach improves reward models without incurring additional labeling costs on unlabeled datasets.
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Copied to clipboard

Challenge: Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach: They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome: The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.
WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets rely on human demonstrations, limiting scalability.
Approach: They propose a scalable data synthesis pipeline that transforms noisy rollouts into reliable supervision without human annotation.
Outcome: The proposed pipeline transforms noisy rollouts into reliable supervision without human annotation.
Towards Comprehensive Patent Approval Predictions:Beyond Traditional Document Classification (2022.acl-long)

Copied to clipboard

Challenge: a new framework for patent approval prediction is proposed to address this problem . novelty scores are based on comparing an application with millions of prior arts .
Approach: They propose a framework that unifies the document classifier with handcrafted features, particularly time-dependent novelty scores.
Outcome: The proposed framework unifies the document classifier with handcrafted features, particularly time-dependent novelty scores.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies focus on monosemanticity on its basic units.
Approach: They propose to revisit monosemanticity from the feature decorrelation perspective and advocate for its encouragement.
Outcome: The proposed method improves representation diversity and activation sparsity and improves preference alignment performance.
Beyond Cross-Modal Alignment: Measuring and Leveraging Modality Gap in Vision-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: a recent study shows that vision-language models have modality gaps that persist even in well-aligned models.
Approach: They propose a modality-dominance score to measure and leverage modality gaps . they propose automatic interpretability metrics to evaluate these features in a scalable manner .
Outcome: The proposed framework allows for training-free probing and editing methods for understanding model perception across genders and generating adversarial examples.
Scaling Laws for Multilingual Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing scaling laws for language models are limited to a limited number of languages, but they can be applied to arbitrary number of different languages.
Approach: They propose a scaling law for general-purpose decoder-only language models trained on multilingual data that shifts focus from individual languages to language families.
Outcome: The proposed scaling law can be applied to models trained on multilingual data . it can be used to predict performance across multiple languages and models .
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have expanded their potential applications in finance.
Approach: They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions.
Outcome: The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios.
Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language-Action models ground high-level semantic instructions into executable physical actions.
Approach: They propose a Coarse-to-Fine Dual-System VLA architecture that decouples learning complexity into a coarse-to fine hierarchy while leveraging structural modularity to implement an asynchronous execution strategy.
Outcome: The proposed architecture decouples learning complexity into a coarse-to-fine hierarchy while leveraging structural modularity to implement an asynchronous execution strategy.
Semantic-Eval : A Semantic Comprehension Evaluation Framework for Large Language Models Generation without Training (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have emerged as key drivers of progress in the field of natural language processing.
Approach: They propose a framework that assesses LLM-generated text based on semantic understanding.
Outcome: The proposed framework surpasses traditional evaluation metrics and lags behind GPT-4.
Efficiently Editing Mixture-of-Experts Models with Compressed Experts (2025.findings-emnlp)

Copied to clipboard

Challenge: Mixture-of-Experts models allow for efficient scaling of large language models . fewer experts reduce computational costs, while more experts improve performance .
Approach: They propose to activate only a subset of experts during training and inference . they propose compressed experts that preserve the most important experts .
Outcome: The proposed approach preserves the most important experts while replacing other auxiliary activated experts with compressed experts.
Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in Large Language Models have sparked concerns about their safety.
Approach: They propose a method to identify safety-related information in the model parameter space . they propose to use a few adversarially chosen examples to fine-tune LLMs .
Outcome: The proposed method can break safety alignment in multilingual LLMs using a few examples . it also shows that the proposed method jailbreaks LLM models adapted to new languages .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations