Papers by Yufei Chen

35 papers
Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing large language model (LLM) agents are unable to adapt to changing domain knowledge and rules.
Approach: They propose an LLM agent framework that continuously learns updated domain knowledge at test time.
Outcome: The proposed agent improves on a customer due diligence name screening task on . the agent learns updated domain knowledge at test time.
DRBO: Mitigating Short Board Effect via Dynamic Reward Balancing in Multi-reward LLM Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: a new framework to optimize large language models (LLMs) for evaluation metrics is needed to balance weaker metrics.
Approach: They propose a Dynamic Reward Balancing Optimization framework to mitigate the "short-board effect" they apply it to single-task and multi-type task scenarios .
Outcome: The proposed framework improves performance and balances performance across multiple metrics.
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation.
Approach: They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation.
Outcome: The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics.
Self-Renewal Prompt Optimizing with Implicit Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in NLP have been driven by the development of Large Language Models (LLMs).
Approach: They propose a self-renewal approach to optimize LLM outputs to better align with human preferences without supervised fine-tuning.
Outcome: The proposed approach improves outputs to better align with human preferences across LLMs and tasks without supervised fine-tuning.
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge .
Approach: They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging .
Outcome: The proposed framework outperforms baseline models on two benchmark datasets with better interpretability.
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised Data (2023.acl-short)

Copied to clipboard

Challenge: Existing approaches to extract entity pairs and their relations from labeled data are noisy and expensive.
Approach: They propose a bootstrap learning approach that is motivated by intuition that the higher the uncertainty of an instance, the more likely the model confidence is inconsistent with the ground truths.
Outcome: The proposed method outperforms baselines and related methods on two large datasets.
Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction (2026.findings-acl)

Copied to clipboard

Challenge: Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions.
Approach: They propose a prompt injection defense method that suppresses the model's instruction-following tendencies rather than suppressing them.
Outcome: The proposed method outperforms prompt-engineering-based approaches and fine-tuning methods and reduces the ASR to nearly 0% in some scenarios.
CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to search for images using single-modality are limited by representation space fragmentation.
Approach: They propose a unified representation framework that achieves efficient query-target alignment . they introduce a multi-level Chain-of-Thought prompting strategy that guides MLMs to generate discriminative, semantically compatible captions for target images .
Outcome: The proposed framework achieves efficient query-target alignment through synergistic components.
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence.
Approach: They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary.
Outcome: Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training.
Can Indirect Prompt Injection Attacks Be Detected and Removed? (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have developed various detection mechanisms to protect against prompt injection attacks.
Approach: They investigate the feasibility of detecting and removing indirect prompt injection attacks . they use two methods to evaluate their performance and train detection models .
Outcome: The proposed method is based on a benchmark dataset and is available on github . it evaluates the performance of existing models and open-source detection models .
Are Large Language Models Capable of Generating Human-Level Narratives? (2024.emnlp-main)

Copied to clipboard

Challenge: a recent HCI study has pointed to gaps in machine storytelling ability at the global level . authors show that LLMs have less suspense and less tension than human stories .
Approach: They propose a computational framework to analyze narratives through three discourse-level aspects.
Outcome: The proposed framework analyzes narratives through three discourse-level aspects . it shows that LLMs fall short of human abilities in discourse understanding .
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing.
Approach: They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning.
Outcome: The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability.
Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances on prompting and post-training have enabled LLMs to perform step-wise reasoning tasks, but they tend to explore unproductive solution paths without effective backtracking or strategy adjustment.
Approach: They propose a framework that empowers LLMs to “think about how to think” and dynamically adapts reasoning strategies in real-time.
Outcome: The proposed framework outperforms previous SOTA methods by 9-12% in accuracy while reducing inference time by 28-35% under the same compute budget.
UIOrchestra: Generating High-Fidelity Code from UI Designs with a Multi-agent System (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in large language models have significantly improved automated code generation . however, the translation of complex mobile UI designs into high-fidelity front-end code remains a challenge .
Approach: They propose a collaborative multi-agent system to reconstruct static single-page apps from mockups.
Outcome: The proposed system outperforms existing methods in reconstructing complex app pages . the code and data will be released upon paper acceptance .
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge (2025.acl-long)

Copied to clipboard

Challenge: Existing methods rely on majority voting or criteria expansion to capture detailed and detailed details, often leading to incomplete outcomes.
Approach: They propose a method which introduces additional crowd responses to compare with the candidate responses, thereby exposing deeper and more comprehensive details within the candidate answers.
Outcome: Experiments show that the proposed method improves evaluation reliability and achieves an average gain of 6.7% across five benchmarks.
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts (2022.naacl-main)

Copied to clipboard

Challenge: Existing systems that generate *flashbacks* are monotonic and lack explicit guidance on how to insert them.
Approach: They propose to use event temporal orders to encode events as temporal prompts . they leverage a Plan-and-Write framework enhanced by reinforcement learning to generate storylines .
Outcome: The proposed method generates more interesting stories with *flashbacks* while maintaining textual diversity, fluency, and temporal coherence.
Program Enhanced Fact Verification with Verbalization and Graph Attention Network (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fact verification based on structured data are challenging and require further study.
Approach: They propose a program-enhanced verbalization and a graph attention network to integrate programs and execution into textual inference models.
Outcome: The proposed framework achieves a new state-of-the-art accuracy on a benchmark dataset . it is compared with existing frameworks on symbolic and informal inference models .
Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion (2022.coling-1)

Copied to clipboard

Challenge: Knowledge Graph Completion (KGC) has been extended to multiple knowledge graph (KG) structures, initiating new research directions, e.g. static KGC, temporal KGC and few-shot KGC.
Approach: They propose a generative framework that could tackle different verbalizable graph structures by unifying the representation of KG facts into "flat" text.
Outcome: The proposed framework outperforms many competitive baselines and sets new state-of-the-art performance on five benchmarks.
Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on prompt engineering have focused on optimizing models for performance under stylistic perturbations.
Approach: They conduct the first analysis of n-gram token-level mechanisms . they find that higher average performance is inherently associated with lower variance and greater stability.
Outcome: The proposed model reduces the variance of the generated code by 40% . the proposed model is based on a large-scale dataset of 132,000 prompt variants .
EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs (2025.coling-main)

Copied to clipboard

Challenge: Existing approaches that integrate LLMs and KGs either underutilize the reasoning abilities of LLM or suffer from prohibitive computational costs due to tight coupling.
Approach: They propose a framework that can strike a balance between performance and efficiency via an iterative paradigm.
Outcome: The proposed framework can strike a balance between performance and efficiency via an iterative paradigm.
Parsing into Variable-in-situ Logico-Semantic Graphs (2020.acl-main)

Copied to clipboard

Challenge: a new type of graph-based meaning representation allows analysis for scope-related phenomena.
Approach: They propose variable-in-situ logico-semantic graphs to bridge gap between semantic graph and logical form parsing.
Outcome: The proposed graph-based meaning representation achieves 92.39% accuracy in terms of elementary dependency match . the output of the proposed parser is highly coherent .
Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation (2026.findings-acl)

Copied to clipboard

Challenge: Multi-agent systems (MAS) are increasingly used for open-ended idea generation . when and why collective interaction expands the solution space remains unclear .
Approach: They propose to study diversity in multi-agent systems across three bottom-up levels: model intelligence, agent cognition, and system dynamics.
Outcome: The proposed model yields diminishing diversity despite higher quality . the proposed model fails to expand diversity and causes it to collapse .
NILE: Internal Consistency Alignment in Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances show that the world knowledge in the Instruction Fine-Tuning (IFT) dataset, which is incompatible with LLMs’ internal knowledge, can greatly hurt the IFT performance.
Approach: They propose a framework to optimize the effectiveness of IFT by carefully aligning the world and internal knowledge of LLMs.
Outcome: The proposed framework can significantly improve performance across multiple LLM ability evaluation datasets.
Pre- and In-Parsing Models for Neural Empty Category Detection (P18-1)

Copied to clipboard

Challenge: Existing studies on empty category detection have shown positive effects on syntactic parsing . empty categories are used to indicate long-distance dependencies, discontinuous constituents, and certain dropped elements.
Approach: They propose to use ECD to detect empty categories without syntactic analysis.
Outcome: The proposed models outperform the prior state-of-the-art by significant margins.
Thinking Long, but Short: Stable Sequential Test-Time Scaling for Large Reasoning Models (2026.findings-eacl)

Copied to clipboard

Challenge: Inducing models to think for longer can increase accuracy, but as the length of reasoning is further extended, it has also been shown to result in accuracy degradation and model instability.
Approach: They propose a sequential test-time scaling method which induces models to think for longer, but which also generates an increasingly long output.
Outcome: The proposed method improves model accuracy significantly over a wide range of induced thoughts, stabilizing the accuracy of sequential scaling, and eliminating the need for reasoning length fine-tuning.
Accurate SHRG-Based Semantic Parsing (P18-1)

Copied to clipboard

Challenge: Graph-structured semantic representations can encode rich semantic information of natural language sentences.
Approach: They propose a SHRG-based parser that relates synchronous production rules to syntacto-semantic composition processes.
Outcome: The proposed model improves on the best existing model by 4.87 points . it relates synchronous production rules to syntacto-semantic composition process .
Beyond Length Scaling: Synergizing Breadth and Depth for Generative Reward Models (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Generative Reward Models have demonstrated that scaling the length of Chain-of-Thought reasoning enhances reliability of evaluation.
Approach: They propose a framework that reconfigures raw rationales into structured Breadth-CoT and Depth-Co T through a modular synthesis pipeline.
Outcome: The proposed framework surpasses open-source RMs by an average of 8.2%.
BioGraphia: A LLM-Assisted Biological Pathway Graph Annotation Platform (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing methods for obtaining pathway information from biomedical literature rely on simplifying assumptions that limit their ability to capture true complexity of biological reactions.
Approach: They propose a web-based platform to facilitate collaborative pathway graph annotation.
Outcome: The platform supports multi-user collaboration with real-time monitoring, curation, and interactive pathway graph visualization.
Is Your LLM Outdated? A Deep Look at Temporal Generalization (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods to evaluate large language models are limited due to their inherent dynamic nature and the inherent dynamicity of language and information.
Approach: They introduce a new evaluation framework that employs fresh text and event prediction for assessing LLMs’ temporal adaptability.
Outcome: The proposed framework shows significant temporal biases and a decline in performance over time.
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) frameworks struggle with identifying whether retrieved documents meaningfully contribute to answer generation.
Approach: They propose a document-related metric to quantify the contribution of retrieved documents to correct answer generation.
Outcome: The proposed framework outperforms existing approaches on both single and multiple retrieval paradigms.
BOSCH: Black-Box Binary Optimization for Short-Context Attention-Head Selection in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing hybridization schemes use sliding-window attention (SWA) to reduce KV cache usage and improve latency.
Approach: They propose a training-free method that decomposes a large neighborhood search problem into three subproblems and a method that uses black-box binary optimization for short-context head selection.
Outcome: Extensive experiments on 4 LLMs show that BOSCH outperforms layer-level heuristics and 6 strong static head-level methods with larger gains at higher SWA ratios.
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)

Copied to clipboard

Challenge: Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use.
Approach: They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools.
Outcome: The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities.
ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use (2025.acl-long)

Copied to clipboard

Challenge: Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models.
Approach: They propose a dataset that provides rigorous evaluation of multi-hop tool use.
Outcome: The proposed model achieves 49.04% accuracy across five model families.
MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve efficiency often enforce rigid structural constraints such as local attention windows.
Approach: They propose a framework that augments sparse-attention mechanisms with dynamically integrated in-context information through an efficient retrieval system.
Outcome: Empirical results show that MATCH significantly improves the performance of sparse-attention models on synthetic and real-world natural-language tasks.
Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Prompting (2023.findings-acl)

Copied to clipboard

Challenge: Knowledge Graph Completion (KGC) often requires both KG structural and textual information to be effective.
Approach: They propose a system which tunes the parameters of Conditional Soft Prompts generated by entities and relations representations to maintain a balance between textual and structural knowledge.
Outcome: The proposed components outperform baseline models on three static and temporal benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations