Papers by Yu Cui

48 papers
EvoEdit: Evolving Null-space Alignment for Robust and Efficient Knowledge Editing (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to modifying large language models require continual updates to rectify outdated or erroneous knowledge.
Approach: They propose a model editing strategy that mitigates catastrophic interference through sequential null-space alignment.
Outcome: EvoEdit achieves better or comparable performance than prior state-of-the-art techniques with up to 3.53 speedup.
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)

Copied to clipboard

Challenge: Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations .
Approach: They propose a framework to synthesize complex charts and reliable reasoning data from scratch.
Outcome: Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models .
Selective Differential Privacy for Language Modeling (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods to protect sensitive data from leaking are over-pessimistic and undifferentiated.
Approach: They propose a new privacy notion, selective differential privacy, to provide rigorous privacy guarantees on the sensitive portion of the data to improve model utility.
Outcome: The proposed privacy-preserving mechanism achieves better utility while remaining safe under various privacy attacks compared to baselines.
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)

Copied to clipboard

Challenge: Structured Query Language (SQL) is the cornerstone for data-driven decision-making.
Approach: They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework.
Outcome: The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework.
CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Recent years have witnessed remarkable progress achieved by large language models in both natural language understanding and generation.
Approach: They propose a large benchmark CMoralEval for moral evaluation of Chinese LLMs . they use a Chinese TV program discussing Chinese moral norms and Chinese moral anomies based on various sources .
Outcome: The proposed dataset is characterized by diversity and authenticity.
OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety (2024.acl-demos)

Copied to clipboard

Challenge: a rapid development of Chinese large language models poses big challenges for efficient LLM evaluation.
Approach: They propose an evaluation testbed that benchmarks Chinese LLMs across capability, alignment and safety.
Outcome: The evaluation platform OpenEval benchmarks Chinese LLMs across capability, alignment and safety.
Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to review scientific papers are limited by their content or quality . SEA is a framework for automated scientific review, but its contents are generic or partial.
Approach: They propose a framework for automated scientific review using large language models . they propose to use a standardized review dataset to fine-tune an LLM to generate high-quality reviews.
Outcome: The proposed framework can generate high-quality reviews from standardized datasets and improves on the existing feedback mechanisms.
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) often experience “contextual hallucination” where they prioritize self-generated content over input context, leading to a disregard for pertinent details.
Approach: They propose a method that dynamically adjusts attention maps to enhance contextual relevance by using a trained classifier to identify attention maps likely to induce hallucinations.
Outcome: The proposed approach reduces hallucinations across open-source models on summarization and open-book QA tasks.
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for dialogue generation use an external knowledge base to generate appropriate responses.
Approach: They propose to use an external knowledge base to generate appropriate responses for unseen entities.
Outcome: Experiments on two dialogue corpus show that pre-trained models perform poorly with unseen entities.
AUGUST: an Automatic Generation Understudy for Synthesizing Conversational Recommendation Datasets (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on conversational recommendation systems lacks high-quality data . existing datasets lack large-scale and high-level data based on human annotators .
Approach: They propose an automatic dataset synthesis approach that generates large-scale recommendation dialogues using structured graphs based on user-item information from the real world.
Outcome: The proposed approach can generate large-scale and high-quality recommendation dialogues . it exploits user preferences, knowledge graphs, and conversation ability from existing datasets based on real-world data .
Towards Database-Free Text-to-SQL Evaluation: A Graph-Based Metric for Functional Correctness (2025.coling-main)

Copied to clipboard

Challenge: Existing metrics for evaluating functional correctness of SQL queries are prone to false positives due to inadequately prepared test databases.
Approach: They propose a graph-based metric that uses a relational operator tree to extract rich semantic information from the logical execution plan of SQL queries and embed it into a diagram.
Outcome: The proposed method eliminates the need for extensive test database preparation and performs graph matching on unseen SQL queries.
MuTual: A Dataset for Multi-Turn Dialogue Reasoning (2020.acl-main)

Copied to clipboard

Challenge: Existing non-task oriented dialogue systems can yield a relevant and fluent response, but sometimes make logical mistakes because of weak reasoning capabilities.
Approach: They propose a dataset for multi-turn dialogue reasoning that uses annotated dialogues to train a machine to handle various reasoning problems.
Outcome: Empirical results show that state-of-the-art methods only reach 71%, far behind human performance of 94%.
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to train a stronger and smaller model with the help of large models are limited by the model size and performance.
Approach: They propose to learn competent initial points for smaller models by fusing parameters from larger models and introduce controllable receptive fields to model prior parameter characteristics.
Outcome: The proposed method outperforms baselines in terms of effectiveness and efficiency.
On Commonsense Cues in BERT for Solving Commonsense Tasks (2021.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models can capture syntactic features, semantic information and factual knowledge, but structured commonsense knowledge is not captured well.
Approach: They quantitatively investigate the presence of structural commonsense cues in BERT when solving commonsensense tasks and the importance of such cue for the model prediction.
Outcome: The presence of commonsense knowledge is positively correlated to the model accuracy.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach: They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome: The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.
Template-Based Named Entity Recognition Using BART (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for fewshot NER do not make full use of knowledge transfer in NER model parameters.
Approach: They propose a template-based method for NER that treats NER as a language model ranking problem in a sequence-to-sequence framework.
Outcome: The proposed method achieves 92.55% F1 score on the CoNLL03 task and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 scores on the MIT Movie, the ATIS, and the MATLAB task.
Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation (2020.findings-emnlp)

Copied to clipboard

Challenge: Event detection (ED) is a key subtask of information extraction.
Approach: They propose an architecture that exploits syntactic structure and typed dependency label information to perform event detection.
Outcome: The proposed architecture exploits syntactic structure and typed dependency label information to perform ED.
INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results show that INTERVENOR surpasses baseline models, exhibiting improvements of approximately 18% and 4.3% over GPT-3.5 in code generation and code translation tasks.
Approach: They propose a system that prompts Large Language Models to play distinct roles during the code repair process, functioning as both a Code Learner and a code teacher.
Outcome: The proposed system surpasses baseline models in code generation and code translation tasks and improves on syntax errors and assertion errors.
NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) with extended context windows are expensive and infeasible on fixed memory hardware due to the surprisingly large memory consumption of KV Cache.
Approach: They propose a general framework for long-context KV cache eviction that achieves more optimal and efficient evict in a single operation during the encoding phase.
Outcome: The proposed framework improves performance on short- and long-text tasks by 80% and 76% respectively, reducing KV Cache by up to 5 with over 95% performance maintenance.
UniGeM: Unifying Data Selection and Mixing via Geometric Exploration and Mining (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) scaling is limited by data quality and domain mixing and instance selection are two separate problems.
Approach: They propose a framework that unifies mixing and selection without training proxy models or relying on external reference datasets.
Outcome: The proposed framework achieves 2.0 data efficiency over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization.
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)

Copied to clipboard

Challenge: GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages.
Approach: They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement.
Outcome: The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3.
Self-Supervised Sentence Polishing by Adding Engaging Modifiers (2023.acl-demo)

Copied to clipboard

Challenge: a typical way to polish sentences is to add engaging modifiers, which enhance the meaning of the sentence.
Approach: They propose a task that requires polishing sentences while maintaining fluency . they remove engaging modifiers from public resources and fine-tune LongLM to reconstruct original sentences from corrupted ones.
Outcome: The proposed model generates more engaging sentences with suitable modifiers than strong baselines while keeping fluency.
Recent Advances in Speech Language Models: A Survey (2025.acl-long)

Copied to clipboard

Challenge: Text-based Large Language Models (LLMs) are a promising solution for end-to-end speech interaction.
Approach: They propose to build a framework that allows users to input text and translate it into speech . they propose to use a text-only LLM and a "textto-speech" framework to generate a response based on this transcription .
Outcome: The survey offers an overview of recent approaches to building SpeechLMs . it outlines core architectural components, training methodologies, evaluation strategies and challenges .
CITE: Benchmarking Heterogeneous Text-Attributed Graph Models (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models and text-aware graph learning have increased interest in reasoning over text-attributed graphs.
Approach: They propose a large-scale heterogeneous text-attributed graph benchmark for catalytic materials that contains over 438K nodes and 1.2M edges . they establish standardized evaluation protocols for node classification and link prediction and conduct ablation studies to assess the impact of graph heterogenity and textual attributes.
Outcome: The proposed benchmarks are compared to existing methods and provide a baseline for the evaluation of four classes of learning paradigms.
VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy (2026.findings-eacl)

Copied to clipboard

Challenge: Large language models (LLMs) have been widely deployed in Conversational AIs . however, the methods proposed in the study rely on a white-box setting .
Approach: They propose an indirect prompt injection attack that induces privacy extraction in LLMs . they use token-efficient data containing false memories to inject LLM data .
Outcome: The proposed method outperforms baselines and achieves state-of-the-art performance.
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to extract relationships from texts depend on memory size and replay these memorized samples in subsequent tasks.
Approach: They propose to use a model to extract relations between entities from texts where the samples of different relations are delivered into the model continuously.
Outcome: The proposed model outperforms the state-of-the-art models and avoids catastrophic forgetting.
FastSeq: Make Sequence Generation Faster (2021.acl-demo)

Copied to clipboard

Challenge: Transformer-based models have made tremendous impact in natural language generation, but inference speed is still a bottleneck due to large model size and intensive computing involved in auto-regressive decoding process.
Approach: They propose an attention cache optimization, an efficient algorithm for detecting repeated n-grams, and an asynchronous generation pipeline with parallel I/O to accelerate sequence generation without loss of accuracy.
Outcome: The proposed framework can accelerate the sequence generation by 4x to 9x with a simple one-line code change for a set of widely used and diverse models.
Non-autoregressive Text Editing with Copy-aware Latent Alignments (2023.emnlp-main)

Copied to clipboard

Challenge: Seq2Edit approaches still face several challenges such as inflexibility in generation and difficulty in generalizing to other languages.
Approach: They propose a non-autoregressive text editing method that models the edit process with latent CTC alignments and introduces the copy operation into the edit space.
Outcome: The proposed method outperforms existing Seq2Edit models and achieves similar or even better results than Seq1Edit with over 4 speedup.
ReaGeo: Reasoning-Enhanced End-to-End Geocoding with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods rely on text retrieval and geographic knowledge bases to generate coordinates, and they are prone to error propagation and dependency on structured knowledge bases.
Approach: They propose to use large language models to convert geographic coordinates into geohash sequences and introduce a Chain-of-Thought mechanism to enhance the model’s reasoning over spatial relationships.
Outcome: The proposed framework can handle explicit address queries in single-point predictions and effectively resolve vague relative location queries.
UltraIF: Advancing Instruction Following from the Wild (2025.emnlp-main)

Copied to clipboard

Challenge: a lack of transparency has resulted in a gap between research community and leading companies . large language models have demonstrated remarkable capabilities in following complex instructions .
Approach: They propose a method to build large language models that can follow complex instructions with open-source data.
Outcome: The proposed approach can synergize complex instructions and filter responses with evaluation questions.
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs (2021.findings-acl)

Copied to clipboard

Challenge: Existing pre-trained models for knowledgegraph-to-text generation ignore graph structure during encoding and lack elaborate pre-training tasks to explicitly model graph-text alignments.
Approach: They propose a graph-text joint representation learning model called JointGT which incorporates a structure-aware semantic aggregation module into each Transformer layer to preserve the graph structure.
Outcome: The proposed model achieves state-of-the-art performance on various KG-to-text datasets.
Few-Shot Event Detection with Prototypical Amortized Conditional Random Field (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches to event detection ignore the trigger discrepancy and cause errors.
Approach: They propose a unified model which converts a few-shot tagging problem into a single-shot model by using a Gaussian distribution.
Outcome: The proposed model performs better than existing identifythen-classify models on a few-shot tagging problem with a double-part taging scheme.
Improving Autoformalization Using Direct Dependency Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for hallucinate formal dependencies lack scalability and precision to leverage ever-growing public datasets.
Approach: They propose a retrieval-augmented framework based on Direct Dependency Retrieval to generate formal dependencies from natural-language mathematical descriptions and verify their existence via an efficient Suffix Array Check (SAC).
Outcome: The proposed framework outperforms state-of-the-art methods in retrieval precision and recall and can be used to validate formal representations in a public dataset.
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)

Copied to clipboard

Challenge: Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges .
Approach: They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions.
Outcome: The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset .
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to fine-tune deep pretrained language models face catastrophic forgetting problems.
Approach: They propose a recall and learn mechanism which integrates pretraining and downstream tasks into a single mechanism.
Outcome: The proposed method achieves state-of-the-art performance on the GLUE benchmark and better average performance than directly fine-tuning of BERT-large.
Explanation Graph Generation via Generative Pre-training over Synthetic Graphs (2023.findings-acl)

Copied to clipboard

Challenge: Existing frameworks for explanation graph generation are limited due to the large number of datasets available.
Approach: They propose a text-to-graph generative task to pre-train a model to bridge the text-graph gap.
Outcome: The proposed framework surpasses all baseline systems with remarkable margins on ExplaGraphs and CommonsenseQA.
AIDER: a Robust and Topic-Independent Framework for Detecting AI-Generated Text (2025.coling-main)

Copied to clipboard

Challenge: Current fine-tuned detectors lack robustness against adversarial attacks and struggle with out-of-distribution topics, limiting their practical applicability.
Approach: They propose a topic-independent framework for detecting AI-generated text . it leverages the ALBERT model for topic content disentanglement, enhancing transferability to unseen topics.
Outcome: The proposed framework outperforms state-of-the-art methods in detecting human-written and AI-generated content under adversarial and topic-varied conditions.
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Clinical natural language processing (NLP) is a subfield that requires the extraction, analysis, and interpretation of unstructured clinical text.
Approach: They propose a model which infuses knowledge into clinical text generation with LLMs for clinical NLP tasks.
Outcome: The proposed model improves performance across 8 clinical NLP tasks and 18 datasets by 7.7%-8.7% on average.
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory (2025.acl-long)

Copied to clipboard

Challenge: Existing ground VLN agents struggle in aerial VLLN due to the lack of predefined navigation graphs and the exponentially expanding action space in long-horizon exploration.
Approach: They propose a large language model-empowered aerial VLN agent that decomposes the long-horizon task into sub-goals with different semantic levels.
Outcome: The proposed method achieves state-of-the-art performance with significant improvement in continuous city environments.
Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to decode a given context-candidate pair are expensive and time-consuming.
Approach: They propose a new paradigm that keeps full attention over each pair while only encoding the context once.
Outcome: The proposed paradigm achieves new state-of-the-art results on four benchmark datasets with high computational efficiency.
The Best of Both Worlds: Combining Parallel and Sequential Inference Scaling via Aggregation Fine-Tuning (2026.findings-acl)

Copied to clipboard

Challenge: Empirical results show that AFT-trained models achieve substantial gains with test-time scaling.
Approach: They introduce a supervised fine-tuning paradigm where models synthesize multiple draft responses into a single, refined answer.
Outcome: Empirical results show that AFT-trained models outperform baseline models while eliminating external guidance.
Self Promotion in US Congressional Tweets (2021.naacl-main)

Copied to clipboard

Challenge: Prior studies have found that women self-promote less than men due to gender stereotypes.
Approach: They built a BERT-based NLP model to predict whether a Congressional tweet shows self-promotion and then used it to examine whether he gender gap exists among Congressional Tweets.
Outcome: The model predicts whether a Congressional tweet shows self-promotion and then tests it against 2 million tweets from 2017 to 2021.
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)

Copied to clipboard

Challenge: Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words.
Approach: They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings.
Outcome: The proposed method outperforms state-of-the-art methods on four benchmark datasets.
RevCore: Review-Augmented Conversational Recommendation (2021.findings-acl)

Copied to clipboard

Challenge: Existing conversational recommendation systems lack item information when conducted on short dialogue history and unfamiliar items.
Approach: They propose a framework where reviews are seamlessly incorporated into conversational recommendation systems.
Outcome: The proposed framework yields better performance on recommendation and conversation responding.
CodeM: Less Data Yields More Versatility via Ability Matrix (2024.findings-acl)

Copied to clipboard

Challenge: Recent efforts to train code large language models have been booming recently . however, this will incur significant costs in constructing data and training model considering the countless downstream scenarios.
Approach: They propose a data construction strategy which decouples code LLMs’ abilities into two dimensions and constructs a lightweight training corpus that only covers a subset of target scenarios.
Outcome: The proposed model can train a multilingual multitasking model using less data and training data.
Free-MAD: Consensus-Free Multi-Agent Debate (2026.findings-acl)

Copied to clipboard

Challenge: Existing multi-agent debate methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is decided by majority voting in the last round.
Approach: They propose a multi-agent debate framework that eliminates the need for consensus among agents and reconstructs the debate phase by introducing anti-conformity.
Outcome: Experiments on eight benchmark datasets show that Free-MAD significantly improves reasoning performance while requiring only a single-round debate and thus reducing token costs.
BERT-BC: A Unified Alignment and Interaction Model over Hierarchical BERT for Response Selection (2024.lrec-main)

Copied to clipboard

Challenge: Recent performance boosting for dialogue response selection task achieved by Cross-Encoder based models is limited and the learned models have poor generalization capability in realistic scenarios.
Approach: They propose a model that combines the representation-based Bi-Encoder and interaction-based Cross-Encoding to achieve better semantic representation.
Outcome: The proposed model can achieve state-of-the-art performance on three benchmark datasets for multi-turn response selection.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations