Papers by Yuchen Yang

38 papers
ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction (2026.findings-acl)

Copied to clipboard

Challenge: ProUIE improves universal information extraction (UIE) without external information . many LLM-based methods rely on extra schema cues, external resources or complex alignment and verification pipelines .
Approach: They propose a Macro-to-Micro progressive learning approach that improves UIE without external information.
Outcome: ProUIE outperforms instruction-tuned baselines on average for NER and RE while using a smaller backbone.
HSDreport: Heart Sound Diagnosis with Echocardiography Reports (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for heart sound diagnosis are limited to a few fixed categories and do not utilize echocardiography reports, the gold standard in the diagnosis of related diseases.
Approach: They propose a benchmark that mandates the direct utilization of heart sounds obtained from auscultation to predict echocardiography reports.
Outcome: The proposed method outperforms existing methods and existing multimodal LLMs in detecting key abnormalities in heart sounds.
Do Large Language Models excel in Complex Logical Reasoning with Formal Language? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on LLMs have focused on formal language, but evaluations of their performance are limited.
Approach: They propose to use a formal language to evaluate LLMs across logical reasoning problems using formal languages.
Outcome: The proposed model outperforms Instruct models in three dimensions, taxonomy of tasks, and format of trajectories, and achieves the best generalization performance across other languages.
RippleCOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learning (2024.findings-emnlp)

Copied to clipboard

Challenge: et al., 2022: ripple effect challenges knowledge editing for large language models.
Approach: They propose a method to improve the accuracy of large language models by integrating Chain-of-Thought reasoning into the ICL editing approach.
Outcome: RIPPLE-COT outperforms the state-of-the-art on the ripple effect, with gains ranging from 7.8% to 87.1%.
Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach: They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome: The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.
Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation (2025.acl-long)

Copied to clipboard

Challenge: Experimental results show that our model significantly outperforms existing multimodal MT and text-only MT.
Approach: They propose a stable diffusion-based imagination network into a multimodal large language model to generate an image for each source sentence.
Outcome: The proposed model outperforms existing multimodal and text-only MT and achieves an average improvement of 14 BLEU points on Multi30K and MSCOCO multimodal MT benchmarks.
MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have improved generation and reasoning capabilities compared to traditional BERT-sized models due to massive number of parameters and extensive pre-training on vast textual corpora.
Approach: They propose a unified post-hoc adapter for test-time adaptation of large language models . they propose to fine-tune only a small BERT-sized adapter to rank candidate LLMs .
Outcome: The proposed adapter improves performance on four biomedical tasks without requiring computational resources or sharing data with third parties.
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers (2024.emnlp-main)

Copied to clipboard

Challenge: Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedically tasks but still challenging due to the lack of sufficient publicly annotated biomedic data and computational resources.
Approach: They propose a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedically corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs.
Outcome: Experiments on 5 biomedical tasks across 11 datasets confirm the performance of the retrieval model on various biomedically demanding tasks.
Are AI-Generated Text Detectors Robust to Adversarial Perturbations? (2024.acl-long)

Copied to clipboard

Challenge: Existing detectors for AI-generated text lack robustness against adversarial perturbations, with even minor changes in characters or words causing a reversal in distinguishing between human-created and AI-generated text.
Approach: They propose a siamese calibration technique to train the model to make equally confident predictions under different noise, which improves the model’s robustness against adversarial perturbations.
Outcome: The proposed detector outperforms baseline methods on four datasets and is more generalizable in cross-domain, cross-genre, and mixed-source scenarios.
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)

Copied to clipboard

Challenge: Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability.
Approach: They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs .
Outcome: The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks.
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records (2024.emnlp-main)

Copied to clipboard

Challenge: EHRAgent enables clinicians to interact with EHRs using natural language . reliance on rule-based conversion systems often necessitates additional training or effort from data engineers.
Approach: They propose a large language model agent that generates and executes code in natural language to facilitate clinicians in directly interacting with EHRs.
Outcome: The proposed agent outperforms the strongest baseline by up to 29.6% in success rate on three real-world EHR datasets.
On Fake News Detection with LLM Enhanced Semantics Mining (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detecting fake news use only news embeddings to capture the lexical semantics between tokens.
Approach: They propose a topic-based model with prompts to extract news embeddings from LLMs and a generalized page-rank model to extract local and global semantics.
Outcome: The proposed model shows superior performance on five benchmark datasets over seven baseline methods.
DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics (2024.findings-acl)

Copied to clipboard

Challenge: Structured data processing is a complex and complex process.
Approach: They propose a framework that captures heterogeneity of structured data using large language models . they propose group positional encoding, hierarchical attention bias and optimal transport alignment layer .
Outcome: The proposed framework outperforms baseline methods and few-shot GPT-4 on a medical lab report dataset.
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have stepped forward the development of multilingual speech and machine translation by its reduced representation errors and incorporated external knowledge.
Approach: They propose a generative paradigm for translation tasks that integrates the diverse translation versions in N-best list.
Outcome: The proposed model outperforms the state-of-the-art model on speech and machine translation benchmarks on various languages.
Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency (2024.lrec-main)

Copied to clipboard

Challenge: Negation understanding is crucial to many downstream tasks such as sentiment analysis, question answering, Web search and natural language inference.
Approach: They propose a novel negation triplet extraction task which aims to extract negation subject along with negation cue and scope.
Outcome: The proposed model is based on a generative pretrained language model with a multi-task learning framework and achieves the best performance compared to baselines.
SDA: Semantic Discrepancy Alignment for Text-conditioned Image Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for textconditioned image retrieval are limited due to the scale of training and the complexity of attributes in modification texts.
Approach: They propose a general boosting framework to address these issues by employing semantic discrepancy alignment by formulating distance consistency and neighbor consistency between the image and text domains.
Outcome: The proposed framework improves retrieval performance on three prominent datasets with state-of-the-art results.
LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning (2025.acl-long)

Copied to clipboard

Challenge: LogicPro is a data synthesis method that uses LeetCode-style algorithm problems and their corresponding Program solutions to generate complex logic data.
Approach: They propose a new method which leverages LeetCode-style algorithm Problems and their corresponding Program solutions to synthesize complex logic data in text format.
Outcome: The proposed method outperforms existing models for BBH27, LogicBench, DROP, AR-LSAT, and GSM8K, and a wide range of reasoning datasets.
DSVD: Dynamic Self-Verify Decoding for Faithful Generation in Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to reliability of large language models often lack self-correction or use costly post-hoc verification.
Approach: They propose a decoding framework that enhances generation reliability through real-time hallucination detection and efficient error correction.
Outcome: Extensive experiments across five benchmarks show the proposed framework improves truthfulness and factual accuracy.
MultiCodeAttack: Iterative Jailbreak Attacking on LLMs with Multi-Code Prompt Injection (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to jailbreak rely on fixed template design and a single programming language . however, existing approaches do not consider language diversity or adaptive template evolution .
Approach: They propose a structured jailbreak framework that explores and optimizes multi-language code templates.
Outcome: The proposed framework outperforms existing jailbreak baselines and produces higher harmful outputs than baseline methods.
Skeletons Matter: Dynamic Data Augmentation for Text-to-Query (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on a single query language, resulting in limited generalizability . a new task paradigm is proposed to unify semantic parsing tasks across different query languages .
Approach: They propose a task paradigm that unifies parsing tasks across query languages . they identify query skeletons as a shared optimization target of Text-to-Query tasks .
Outcome: The proposed method achieves state-of-the-art performance using only a small amount of synthesized data.
CF-TCIR: A Compositor-Free Framework for Hierarchical Text-Conditioned Image Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to text-conditioned image retrieval use attention-driven compositors . instead, we reformulate the retrieval process as a cross-modal interaction between a synthesized image feature and its corresponding text descriptor.
Approach: They propose a compositor-free framework for text-conditioned image retrieval . they propose combining a reference image and modification text to form a query tuple .
Outcome: The proposed framework offers advantages in terms of computational efficiency, scalability, and performance.
Jailbreaking Safeguarded Text-to-Image Models via Large Language Models (2026.findings-eacl)

Copied to clipboard

Challenge: Text-to-image models generate harmful content when unsafe prompts are submitted . authors propose a method to jailbreak text-to image models with safety guardrails .
Approach: They propose a method to jailbreak text-to-image models with safety guardrails . they use a fine-tuned large language model to generate adversarial prompts based on unsafe prompts.
Outcome: The proposed method bypasses safety guardrails and outperforms existing no-box attacks . the proposed method generates adversarial prompts efficiently after fine-tuning the model .
StableToolBench-MirrorAPI: Modeling Tool Environments as Mirrors of 7,000+ Real-World APIs (2025.findings-acl)

Copied to clipboard

Challenge: Existing tool environments face challenges in balancing stability, scale, and realism, especially for benchmarking purposes.
Approach: They propose a framework that trains specialized LLMs to accurately simulate real API responses by supervised fine-tuning and chain-of-thought reasoning.
Outcome: The proposed framework achieves superior accuracy and stability compared to state-of-the-art methods on the newly constructed MirrorAPI-Bench and its integration into StableToolBench.
RAP-ID: Mechanistic Prompt Injection Detection via Impostor Behavior Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Existing defenses rely on externally deployed guardrail models or response inspection . current defenses depend on external guardrails or response inspecting .
Approach: They propose a mechanistic, train-free detection framework that operates exclusively on internal state dynamics during the initial forward pass.
Outcome: The proposed framework achieves competitive performance with significant overall improvements compared to heuristic methods.
ToNER: Type-oriented Named Entity Recognition with Generative Language Model (2024.lrec-main)

Copied to clipboard

Challenge: Input too many potential entity types would distract the model inevitably.
Approach: They propose to use a generative model to exploit entity types' merit on promoting NER task by appending a type matching model to identify the entity types most likely to appear in the sentence.
Outcome: The proposed framework exploits entity types' merit on promoting NER task by adding auxiliary task to the model to discover the entity types.
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in GPT-4V have demonstrated remarkable multi-modal capabilities in processing image inputs and following open-ended instructions.
Approach: They propose a plug-and-play technique to enhance multi-modal LLMs . they propose 'lynx' to train multi-modal LLM models .
Outcome: The proposed training strategy improves understanding accuracy and instruction-following proficiency of multi-modal models.
BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation (2022.naacl-main)

Copied to clipboard

Challenge: Standard evaluation metrics, e.g., BLEU, TER and METEOR, focus on the quality of translations at the sentence level and do not consider discourse-level features.
Approach: They propose to use a metric to take discourse coherence into consideration by categorizing discourse-related spans and calculating the similarity-based F1 measure of categorized spans.
Outcome: The proposed metric possesses better selectivity and interpretability at the document-level, and is more sensitive to document- level nuances.
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations.
Approach: They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation.
Outcome: The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement.
InfiAgent: An Infinite-Horizon Framework for General-Purpose Autonomous Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs break down on long-horizon tasks due to unbounded context growth and accumulated errors.
Approach: They propose a framework that externalizes persistent state into a file-centric state abstraction and keeps the agent’s reasoning context strictly bounded regardless of task duration.
Outcome: Experiments on DeepResearch and an 80-paper literature review show that the proposed framework maintains higher long-horizon coverage than baseline models without task-specific fine-tuning.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Clinical natural language processing (NLP) is a subfield that requires the extraction, analysis, and interpretation of unstructured clinical text.
Approach: They propose a model which infuses knowledge into clinical text generation with LLMs for clinical NLP tasks.
Outcome: The proposed model improves performance across 8 clinical NLP tasks and 18 datasets by 7.7%-8.7% on average.
RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records (2024.acl-short)

Copied to clipboard

Challenge: Existing deep learning models for EHRs rely on knowledge from a single source and do not capture the semantic information for medical codes.
Approach: They propose a Retrieval AugMentation pipeline to augment clinical prediction on EHRs . they use multiple knowledge sources to convert them into text and use consistency regularization to capture complementary information from patient visits and summarized knowledge.
Outcome: Experiments on two EHR datasets show that RAM-EHR improves clinical prediction tasks.
AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting (2025.findings-acl)

Copied to clipboard

Challenge: Keyword spotting (KWS) is a useful mechanism to identify spoken commands in voice-enabled systems, but catastrophic forgetting is causing models to lose their ability to recognize earlier keywords.
Approach: They propose an exemplar-free method that updates model parameters without revisiting earlier data.
Outcome: The proposed method outperforms existing continual learning methods on a variety of datasets and settings.
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks .
Approach: They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience.
Outcome: The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning.
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) struggle with structural ambiguity in optimization problems, where a single problem admits multiple related but conflicting modeling paradigms, hindering effective solution generation.
Approach: They propose to use memory to leverage historical solutions in a training-free manner to enhance performance by leveraging generalizable guidance knowledge.
Outcome: The proposed agent achieves an average performance improvement of 11%-21% over previous agents.
CARE-STaR: Constraint-aware Self-taught Reasoner (2025.findings-acl)

Copied to clipboard

Challenge: Recent research on instruction following has demonstrated that LLMs can handle complex instructions.
Approach: They propose to assign constraints to different levels of constraints in instructions . they use chain-of-thought and self-taught reasoner methods to identify constraints .
Outcome: The proposed method outperforms supervised fine-tuning (SFT) on three instruction-following benchmarks.
UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing alignment paradigms for creative writing use static reward signals and supervised data.
Approach: They propose a constraint-aware reward model that synthesizes query-specific criteria to provide fine-grained preference judgments.
Outcome: The proposed framework aligns models with human preferences across content quality and structural paradigms without supervised fine-tuning and ground-truth references.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations