Papers by Ye He

39 papers
ExecVerify: White-Box RL with Verifiable Stepwise Rewards for Code Execution Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for code execution reasoning are limited by the difficulty of the training data.
Approach: They propose a model that uses reinforcement learning to reward correct answers from execution traces.
Outcome: The proposed model improves pass@1 by up to 5.9% on code generation tasks over strong baselines.
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for code retrieval struggle to balance scalability and annotation quality.
Approach: They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context.
Outcome: The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities.
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation (2021.acl-long)

Copied to clipboard

Challenge: Existing studies have shown that adapter-based tuning is more parameter-efficient than fine-tuning.
Approach: They propose to add adapter modules to a pretrained language model and update the parameters of adapter module when learning on a downstream task.
Outcome: The proposed method outperforms fine-tuning on low-resource and cross-lingual tasks and settings.
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models (2023.emnlp-demo)

Copied to clipboard

Challenge: MusicAgent integrates numerous music-related tools and an autonomous workflow to address user requirements.
Approach: a new system is built to integrate music-related tools and an autonomous workflow . the system is based on large language models (LLMs) that can be used to organize and decompose requests .
Outcome: the proposed system integrates numerous music-related tools and an autonomous workflow to address user requirements.
On Learning to Summarize with Large Language Models as References (2024.naacl-long)

Copied to clipboard

Challenge: Recent studies have found that summaries generated by large language models (LLMs) are favored by human annotators when compared to reference summary from widely used summarization datasets.
Approach: They propose to use large language models (LLMs) as reference learning settings for smaller text summarization models to investigate whether their performance can be substantially improved.
Outcome: The proposed model outperforms standard supervised fine-tuning and human evaluations while retaining human-level performance.
Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering (2025.acl-long)

Copied to clipboard

Challenge: Existing retrieval-augmented generation methods are insufficient for multi-hop question answering . however, they tend to generate hallucinations due to semantic mismatching .
Approach: They propose to optimize question semantic space for dynamic retrieval-augmented multi-hop question answering by optimizing the semantic embeddings.
Outcome: The proposed method outperforms existing RAG methods in both in- and out-of-domain settings.
Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach: They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome: The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.
C3LPGCN:Integrating Contrastive Learning and Cooperative Learning with Prompt into Graph Convolutional Network for Aspect-based Sentiment Analysis (2024.findings-naacl)

Copied to clipboard

Challenge: Recent studies have shown that graph convolutional networks (GCNs) can model syntactic information but incorrect syntaktic structure may introduce additional noise.
Approach: They propose a graph convolutional network which integrates Contrastive Learning and Cooperative Learning with Prompt into GCN to alleviate the noise when modeling syntactic information.
Outcome: The proposed model outperforms state-of-the-art models on three datasets and significantly outperformed existing models.
RMSSinger: Realistic-Music-Score based Singing Voice Synthesis (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for singing voice synthesis are limited to fine-grained music scores . manual adjustment destroys regularity of note durations, making fine-grain music scores "crushed"
Approach: They propose a method to synthesize singing voices given realistic music scores . they use real-music-score-based Singing Voice Synthesis to generate high-quality voices .
Outcome: The proposed method eliminates manual annotation and simplifies phoneme-level mel-note alignment.
Anchor-based Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) require massive GPU memory due to their size and parameter count.
Approach: They propose to use anchor-based self-attention network and anchor-basic inference strategy to compress sequence information into an anchor token, reducing the keys/values cache and enhancing inference efficiency.
Outcome: The proposed model reduces the key/value cache and improves inference efficiency by 99% while maintaining similar accuracy levels.
A Novel Matching Paradigm: Unified Generative and Discriminative LLM with Prompt Compression for Relevance Learning (2026.acl-industry)

Copied to clipboard

Challenge: Existing approaches to matching use Large Language Models as feature extractors, underutilizing their full modeling capabilities.
Approach: They propose a matching paradigm that integrates two-tower, single-towing, and generative tasks within a unified LLM framework via attention-mask partitioning.
Outcome: The proposed model achieves superior performance and strong practical value in an industrial search engine.
Traffic Light or Light Traffic? Investigating Phrasal Semantics in Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Phrases are fundamental linguistic units through which humans convey semantics.
Approach: They assess the capacity of API-based large language models to comprehend phrase semantics . they use three human-annotated datasets to analyze their results .
Outcome: The proposed model outperforms embedding-based methods in phrase semantic reasoning tasks . the proposed model does not show significant advantage over fine-tuned methods .
Towards Hierarchical Multi-Step Reward Models for Enhanced Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing Process Reward Models (PRMs) are vulnerable to reward hacking and require expensive, large-scale annotation of reasoning steps.
Approach: They propose a reward model approach which evaluates both individual and consecutive reasoning steps from fine-grained and coarse-grounded level.
Outcome: Empirical results show that the proposed model performs better than existing PRMs and is more robust than existing models.
Beyond Text: Incorporating Metadata and Label Structure for Multi-Label Document Classification using Heterogeneous Graphs (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-label document classification ignore the heterogeneous graphical structures of metadata and labels.
Approach: They propose a neural network based approach to multi-label document classification that uses two heterogeneous graphs to model metadata and labels.
Outcome: The proposed approach outperforms state-of-the-art models on two benchmark datasets.
Lunar-Bench: Towards Evaluating Task-Oriented Reasoning of LLMs in Lunar Exploration Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on static, context-independent reasoning tasks and fail to capture constraints and dependencies of lunar missions.
Approach: They propose a benchmark to assess the task-oriented reasoning and decision-making performance of large language models through 3,000 tasks derived from mission procedures and documentation.
Outcome: The proposed model achieves 47.8% accuracy compared with 65.1% for human experts on 36 representative missions.
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies for visually-situated language understanding have shown shallow zero-shot visual text recognition ability when fed a low-resolution image with salient text information.
Approach: They propose a model for universal OCR-free visually-situated language understanding based on the Multimodal Large Language Model (MLLM) their model is jointly finetuned on a wide range of visually situated language understanding tasks via a unified instruction format.
Outcome: The proposed model achieves state-of-the-art ocr-free performance in 8 out of 10 visually-situated language understanding tasks across 5 domains: documents, tables, charts, natural images, and webpage screenshots.
RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysis (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models focus on simple, flat table structures.
Approach: They propose a benchmark to evaluate the performance of both Large Language Models and Multimodal LLMs across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG.
Outcome: The proposed benchmark evaluates the performance of LLMs and Multimodal LLM models across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG.
SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) improves LLMs but faces high prefill latency during long contexts.
Approach: They propose a method that uses deep-layer hidden-state norms to guide token selection . they propose to use deep-layered hidden-status norms as a proxy to guide the token selection.
Outcome: The proposed SpecCache outperforms state-of-the-art (SOTA) benchmarks.
SimPBL: A Multi-Agent Framework for Project-Based Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing LLMs provide partial assistance without modeling these roles, and overly comprehensive help can reduce learner autonomy.
Approach: They propose a multi-agent framework with an orchestrator agent that provides adaptive scaffolding from interaction logs and collaborator agents that support project work through boundary-aware collaboration.
Outcome: The proposed framework improves learner examination scores by 14% . it is based on a multi-agent framework with an orchestrator agent .
Unsupervised Text Style Transfer for Controllable Intensity (2026.findings-eacl)

Copied to clipboard

Challenge: Unsupervised Text Style Transfer (UTST) aims to transfer the stylistic properties of a given text without parallel text pairs.
Approach: They propose a SFT-then-PPO paradigm to fine-tune an LLM with parallel data and reward functions for distinguishing stylistic intensity in hierarchical levels.
Outcome: The proposed system can transfer stylistic properties without parallel text pairs even for adjacent levels of intensity.
Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation (2026.acl-long)

Copied to clipboard

Challenge: a benchmark is designed to evaluate the capability of Large Multimodal Models (LMMs) in converting complex, structured digital graphics into executable code.
Approach: They propose a benchmark to evaluate the capability of Large Multimodal Models to convert digital graphics into executable code.
Outcome: The proposed benchmark exposes the performance gap among leading LMMs . the benchmark features 1130 meticulously curated samples .
Beyond Self-Report: Bridging the Intention-Behavior Gap in Critical Thinking Assessment via Interpretable Multi-Agent System (2026.acl-long)

Copied to clipboard

Challenge: Accurate assessment of critical thinking is limited by the Intention Behavior Gap in psychology . evaluators that measure self-reported competence are limited by multiagent architectures .
Approach: They propose a framework that operationalizes cognitive assessment into an interpretable multi-agent workflow with Assessment Chain-of-Thought.
Outcome: The proposed framework aligns better with human expert ratings than gold-standard inventories on large-scale simulations and human participants.
TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies show that advanced LLMs produce text indistinguishable from human writing.
Approach: They propose a benchmark to assess persona simulation across diverse contexts by decomposing the evaluation into six fundamental capabilities including opinion consistency, memory recall, logical reasoning, persona tone, and syntactic style.
Outcome: The proposed model achieves moderate accuracy but falls short of the basic capabilities needed to simulate personas in real-world contexts.
Towards Imperceptible Document Manipulations against Neural Ranking Models (2023.findings-acl)

Copied to clipboard

Challenge: Current approaches to detect vulnerabilities in neural ranking models often introduce noticeable errors and require a well-imitated surrogate NRM to guarantee the attack effect.
Approach: They propose a framework called Imperceptible DocumEnt Manipulation to produce adversarial documents that are less noticeable to both algorithms and humans.
Outcome: The proposed framework outperforms strong baselines while maintaining fluency and correctness of the target documents.
Rethinking Table Pruning in TableQA: From Sequential Revisions to Gold Trajectory-Supervised Parallel Search (2026.acl-long)

Copied to clipboard

Challenge: Existing pruning methods rely on sequential revisions and unreliable critique signals . Existing methods fail to detect the loss of answer-critical data .
Approach: They propose a table pruning framework which transforms table pruning to gold trajectory-supervised parallel search.
Outcome: The proposed framework outperforms the strongest baseline pruning framework by 3.2% on various tabular reasoning tasks.
UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing query augmentation methods face knowledge update lag and hallucinations in large language models (LLMs) Existing methods face two key challenges: (1) separation of query augmented and encoding tasks, which hinders information sharing and introduces cumulative errors; (2) difficulty of selecting optimal augmentation strategy for different scenarios.
Approach: They propose a unified framework for query understanding in RAG that integrates internal and external knowledge to enhance query augmentation and encoding tasks.
Outcome: The proposed framework outperforms traditional query augmentation methods in five knowledge-intensive benchmark tasks in both closed and open domain question answering.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for summarizing semantic graph structure from raw text are cumbersome and inefficient for long-text documents.
Approach: They propose a Transformer-based pre-trained model with multi-granularity sparse attentions for long-text extractive summarization.
Outcome: The proposed model performs state-of-the-art on single- and multi-document summarization tasks while using less memory and fewer parameters.
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services (2025.emnlp-industry)

Copied to clipboard

Challenge: Social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement.
Approach: They propose a domain-specific LLM to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for social networking services.
Outcome: The proposed model achieves an average improvement of 14.02% across 8 major tasks and 7.56% in bilingual evaluation benchmark, compared with baseline models.
AutoVecCoder: Teaching LLMs to Generate Explicitly Vectorized Code (2026.findings-acl)

Copied to clipboard

Challenge: Current development practices face a dichotomy between automation and performance.
Approach: They propose a framework to empower LLMs with the capability of automated explicit vectorization.
Outcome: The proposed framework achieves state-of-the-art performance on the SSE and AVX subsets of SimdBench.
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained vision-language models suffer from inefficiency and linguistic signal overwhelmed by long visual sequences in cross-modal alignment.
Approach: They propose a vision-language foundation model with cross-modal skip-connections that can be pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives.
Outcome: The proposed model achieves state-of-the-art results on a wide range of vision-language downstream tasks, including image captioning, image-text retrieval, visual grounding and visual question answering.
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for expressive text-to-speech only implicitly learn prosody with masked token reconstruction tasks.
Approach: They propose a cross-modal contrastive pre-training framework that learns from prosody variance of the same text token under different contexts.
Outcome: The proposed framework can learn from prosody variance of a text token under different contexts.
HeteroSpec: Leveraging Contextual Heterogeneity for Efficient Speculative Decoding (2026.acl-long)

Copied to clipboard

Challenge: Autoregressive decoding limits the inference throughput of Large Language Models due to its sequential dependency.
Approach: They propose a framework that allocates verification effort in proportion to candidate uncertainty.
Outcome: Speculative decoding achieves an average speedup over state-of-the-art methods . a small subset of high-confidence predictions accounts for most successful verifications .
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training (2020.emnlp-main)

Copied to clipboard

Challenge: Adapting pre-trained language models (PrLMs) to new domains has gained much attention . Adaptation of PrLMs to newdomains is important, but requires fine-tuning .
Approach: They propose to use PrLMs to adapt to new domains without fine-tuning . they use class-aware feature self-distillation to learn discriminative features .
Outcome: The proposed model can learn discriminative features from pre-trained language models without fine-tuning.
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing models for speech-to-speech translation suffer from distinct degradation in noisy environments and fail to translate visual speech.
Approach: They propose a text-based audio-visual speech-to-speech translation model that integrates visual information with audio-only data to improve system robustness.
Outcome: The proposed model outperforms models trained on audio-only corpus in two languages . it also improves with low-resource audio-visual data, compared with baselines .
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
R3-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL (2024.findings-emnlp)

Copied to clipboard

Challenge: Adapting existing approaches for converting natural language to SQL encounters hurdles due to distinct nature of GQL compared to SQL.
Approach: They propose a method that integrates both small and large Foundation Models for ranking, rewriting, and refining tasks.
Outcome: The proposed approach integrates both small and large Foundation Models for ranking, rewriting, and refining tasks while capitalizing on the superior generalization and query generation prowess of larger models for the final transformation of natural language queries into GQL formats.
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS).
Approach: They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features.
Outcome: The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization.
Neural Topic Modeling with Bidirectional Adversarial Training (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that neural topic models for automatic topic extraction avoid complicated mathematical derivations for model inference.
Approach: They propose a bidirectional adversarial topic model which uses a generator and an encoder to infer topic distribution.
Outcome: The proposed model outperforms baselines and competitive models in three benchmark corpora.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations