Papers by Yue Xu

90 papers
Leveraging Local and Global Patterns for Self-Attention Networks (P19-1)

Copied to clipboard

Challenge: Existing approaches to integrate local and global information into self-attention networks have been criticized for overlooking neighboring information.
Approach: They propose a hybrid attention mechanism to leverage local and global information . they use a gating scalar to integrate both sources of information based on local contexts .
Outcome: The proposed approach improves on translation tasks and shows that the two types of contexts are complementary.
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for Referring Expression Comprehension (REC) lack specific domain abilities for precise local visual perception and visual-language alignment.
Approach: They propose a framework for Parameter-Efficient Transfer Learning to localize a visual region via natural language using a prior-guided prior.
Outcome: The proposed framework achieves the best accuracy compared to the current methods with only 1.41% tunable backbone parameters.
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation.
Approach: They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting.
Outcome: The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods.
Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language Processing (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have revolutionized general natural language preprocessing tasks, but their performance in financial domains is not evaluated comprehensively.
Approach: They propose a framework to evaluate financial language models on financial tasks . they compare performance of auto-encoding language models and ChatGPT .
Outcome: The proposed framework compares the performance of auto-encoding language models and the LLM ChatGPT on financial tasks.
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
Small Models Struggle to Learn from Strong Reasoners (2025.findings-acl)

Copied to clipboard

Challenge: a small learning gap exists between large and small language models . long CoT data and large model responses are not beneficial for small models - a problem that may be due to the small student model's ability to handle distribution shifts.
Approach: They propose a mix distillation strategy that balances reasoning complexity by combining long and short CoT examples or reasoning from both larger and smaller models.
Outcome: The proposed strategy outperforms training on large and small models on short CoT and small model CoT.
BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks (2026.acl-long)

Copied to clipboard

Challenge: Existing supervised defense methods rely on labeled malicious agents to train a supervised model of malicious behavior.
Approach: They propose an unsupervised defense method that learns without requiring any attack-specific labels or prior knowledge of malicious behaviors.
Outcome: The proposed method detects diverse attack types across MAS with various communication patterns while maintaining superior generalizability compared to baselines.
SecFormer: Fast and Accurate Privacy-Preserving Inference for Transformer Models via SMPC (2024.findings-acl)

Copied to clipboard

Challenge: a growing number of cloud-based inference services are relying on SMPC to protect data privacy.
Approach: They propose a framework for Privacy-Preserving Inference for Transformer models that eliminates exponential and maximum operations in PPI without sacrificing model performance.
Outcome: The proposed framework outperforms MPCFormer in terms of performance and efficiency . it is 3.57 and 3.58 times faster than PUMA for BERTBASE and BERTLARGE .
The APVA-TURBO Approach To Question Answering in Knowledge Base (C18-1)

Copied to clipboard

Challenge: Existing query languages for question answering over knowledge bases are not capable of processing queries presented in human language directly.
Approach: They advocate a new model architecture that includes a verification mechanism for checking the correctness of predicted relations.
Outcome: The proposed approach dramatically improves the question answering performance.
POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing chart understanding benchmarks are overwhelmingly English-centric, limiting their accessibility and relevance to global audiences.
Approach: They propose a multilingual chart question answering benchmark that enables efficient multilingual generation via data translation and code reuse.
Outcome: The proposed benchmark systematically evaluates multilingual chart understanding on state-of-the-art LVLMs and shows a significant performance gap between English and other languages.
Multi-modal Stance Detection: New Datasets and Model (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for stance detection for pure texts have limited results to multi-modal content.
Approach: They propose a multi-modal stance detection framework that leverages target information to learn multi-modal stance features from textual and visual modalities.
Outcome: The proposed framework achieves state-of-the-art in multi-modal stance detection on five datasets based on Twitter .
Red-Teaming LLM Multi-Agent Systems via Communication Attacks (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Model-based Multi-Agent Systems (LLM-MAS) have revolutionized complex problem-solving capability by enabling agent collaboration through message-based communications.
Approach: They propose an attack that exploits communication mechanisms in Large Language Model-based Multi-Agent Systems (LLM-MAS) by intercepting and manipulating inter-agent messages.
Outcome: The proposed attack exploits communication mechanisms in large language model-based multi-agent systems by intercepting and manipulating inter-agencies.
Expectation Confirmation Preference Optimization for Multi-Turn Conversational Recommendation Agent (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have propelled the development of Conversational Recommendation Agents (CRAs).
Approach: They propose a multi-turn preference optimization paradigm that leverages Expectation Confirmation Theory to explicitly model the evolution of user satisfaction throughout multi-turned dialogues.
Outcome: The proposed paradigm eliminates the significant sampling overhead of existing MTPO methods while ensuring the optimization process drives meaningful improvements.
ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multi-turn dialogues lack contextual consistency and dependencies, and models struggle to maintain factual faithfulness as interaction turns increase.
Approach: They propose an adaptive context refactoring framework that monitors and reshapes the interaction history to mitigate contextual inertia and state drift.
Outcome: The proposed model outperforms baselines while reducing token consumption.
Adaptive Attentional Network for Few-Shot Knowledge Graph Completion (2020.emnlp-main)

Copied to clipboard

Challenge: Recent attempts to learn static representations of entities and references ignore their dynamic properties.
Approach: They propose to learn static representations of entities and references ignoring their dynamic properties . a neighbor encoder learns entities' roles while a query-aware aggregator learns references' contributions .
Outcome: The proposed approach achieves state-of-the-art results with different few-shot sizes.
Gentopia.AI: A Collaborative Platform for Tool-Augmented LLMs (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing frameworks for Augmented Language Models lack flexibility, democratization, and holistic evaluation.
Approach: They propose a lightweight and extensible framework for Augmented Language Models called Gentopia.
Outcome: The proposed framework integrates language models, task formats, prompting modules, and plugins into a unified paradigm.
Revisiting Data Reconstruction Attacks on Real-world Dataset for Federated Natural Language Understanding (2024.lrec-main)

Copied to clipboard

Challenge: Existing DRA methods fail to accurately recover the original text of real-world privacy data.
Approach: They propose to use a real-world privacy dataset to examine the performance of federated learning (FL) methods.
Outcome: The proposed method improves on a real-world privacy dataset and shows that the tokens within a recovery sentence are disordered and intertwined with tokens from other sentences in the same training batch.
AdaTooler-V: Adaptive Tool-Use for Images and Videos (2026.findings-acl)

Copied to clipboard

Challenge: Existing models exhibit blind tool-use reasoning patterns, which significantly increases inference overhead and degrades model performance.
Approach: They propose an MLLM that performs adaptive tool-use by determining whether a visual problem truly requires tools.
Outcome: The proposed model outperforms existing methods in visual reasoning tasks.
MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have improved generation and reasoning capabilities compared to traditional BERT-sized models due to massive number of parameters and extensive pre-training on vast textual corpora.
Approach: They propose a unified post-hoc adapter for test-time adaptation of large language models . they propose to fine-tune only a small BERT-sized adapter to rank candidate LLMs .
Outcome: The proposed adapter improves performance on four biomedical tasks without requiring computational resources or sharing data with third parties.
Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made significant strides towards Artificial General Intelligence, but training them from scratch is prohibitively expensive.
Approach: They propose to continuously pre-train LLMs from existing pre-trained LLM models by using a set of parameters instead of randomly initializing them.
Outcome: The proposed approach saves significant resources and accelerates convergence and performance.
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers (2024.emnlp-main)

Copied to clipboard

Challenge: Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedically tasks but still challenging due to the lack of sufficient publicly annotated biomedic data and computational resources.
Approach: They propose a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedically corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs.
Outcome: Experiments on 5 biomedical tasks across 11 datasets confirm the performance of the retrieval model on various biomedically demanding tasks.
PairCFR: Enhancing Model Training on Paired Counterfactually Augmented Data through Contrastive Learning (2024.acl-long)

Copied to clipboard

Challenge: Recent research shows that training with CAD may lead models to overly focus on modified features while ignoring other important contextual information.
Approach: They propose to use contrastive learning to promote global feature alignment and learning counterfactual clues to improve model performance.
Outcome: The proposed method outperforms the state-of-the-art on out-of distribution (OOD) datasets.
RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings.
Approach: They propose a robust RAG framework for large language models via Margin-aware Preference Optimization to enhance the accuracy and reliability of SLMs.
Outcome: The proposed framework surpasses state-of-the-art benchmarks on three open-domain question answering tasks.
3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection (2025.emnlp-main)

Copied to clipboard

Challenge: Effective domain adaptation typically involves supervised fine-tuning on carefully selected instruction-tuned data.
Approach: They propose a model-centric data selection framework that aligns data selection with the model’s knowledge distribution to improve model performance.
Outcome: The proposed framework outperforms existing methods by up to 2.97% accuracy in the healthcare domain.
ReTRE: Benchmarking LLM Transfer Robustness with Structure-Preserving Variants (2026.acl-long)

Copied to clipboard

Challenge: Learning transfer theory emphasizes that applying acquired knowledge to novel manifestations is a key signal of deep understanding
Approach: They propose a benchmark that probes transfer robustness along two rewrite levels: Near Transfer and Far Transfer.
Outcome: The proposed benchmark demonstrates that large language models are robust when faced with novel manifestations of the same problem.
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space (2025.emnlp-main)

Copied to clipboard

Challenge: Embodied Question Answering (EQA) tasks are primarily focused on indoor environments, leaving the complexities of urban settings unexplored.
Approach: They propose a task where an embodied agent answers open-vocabulary questions in dynamic city spaces.
Outcome: The proposed agent achieves 60.7% of human-level answering accuracy compared to baselines . the proposed agent outperforms existing agents in open-ended city spaces .
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records (2024.emnlp-main)

Copied to clipboard

Challenge: EHRAgent enables clinicians to interact with EHRs using natural language . reliance on rule-based conversion systems often necessitates additional training or effort from data engineers.
Approach: They propose a large language model agent that generates and executes code in natural language to facilitate clinicians in directly interacting with EHRs.
Outcome: The proposed agent outperforms the strongest baseline by up to 29.6% in success rate on three real-world EHR datasets.
HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification (2024.naacl-long)

Copied to clipboard

Challenge: Existing self-supervised methods in natural language processing rely on augmentation rules to generate contrastive samples.
Approach: They propose a hierarchy-aware information lossless contrastive learning scheme that uses syntactic information reserved in the input sample and fused during the learning process.
Outcome: The proposed learning scheme is superior to existing methods in hierarchical text classification . the proposed learning system is based on a structure encoder and a text encoder .
Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs? (2024.naacl-long)

Copied to clipboard

Challenge: Existing large language models lack knowledge of nuanced, domain-specific details and are susceptible to hallucinations.
Approach: They construct a benchmark that measures head, torso, and tail facts in terms of popularity.
Outcome: The proposed model is based on 18K question-answer pairs regarding head, torso, and tail facts in terms of popularity.
CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fingerprinting model ownership traces are vulnerable to illegal plagiarism and are not reliable.
Approach: They propose a rule-driven fingerprinting framework that encodes contextual correlations across multiple dialogue turns.
Outcome: The proposed framework achieves stronger stealth and robustness than previous work.
Query-Aware Graph Attention for Precise Subgraph Retrieval in Knowledge-Augmented Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) systems insufficiently model the interaction between query semantics and relation types, resulting in imprecise subgraph retrieval and unstable reasoning.
Approach: They propose a retrieval framework that integrates query semantics and relation embeddings directly into the attention mechanism.
Outcome: Experiments on WebQSP and CWQ establish new state-of-the-art results in both Triple Recall and Answer Recall.
HyKGE: A Hypothesis Knowledge Graph Enhanced RAG Framework for Accurate and Reliable Medical LLMs Responses (2025.acl-long)

Copied to clipboard

Challenge: Recent approaches suffer from insufficient and repetitive knowledge retrieval, tedious and time-consuming query parsing, and monotonous knowledge utilization.
Approach: They propose a retrieval-augmented generation framework which leverages LLMs’ powerful reasoning capacity to compensate for the incompleteness of user queries.
Outcome: The proposed framework improves the accuracy and reliability of Large Language Models (LLMs) by combining the rich knowledge of LLMs with Hypothesis Outputs.
DIDS: Domain Impact-aware Data Sampling for Large Language Model Training (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches for optimizing domain-level sampling strategies struggle with maintaining intra-domain consistency and accurately measuring domain impact.
Approach: They propose to use a Fisher-Information Matrix-guided metric to measure domain impact to ensure intra-domain consistency and accuracy.
Outcome: The proposed model achieves 3.4% higher average performance while maintaining comparable training efficiency.
Cold-Start Data Selection for Better Few-shot Language Model Fine-tuning: A Prompt-based Uncertainty Propagation Approach (2023.acl-long)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) have achieved competitive performance with limited labeled data for many NLP tasks.
Approach: They propose a prompt-based data selection method for pre-trained language models fine-tuning under cold-start scenarios.
Outcome: The proposed method outperforms the strongest cold-start data selection baselines on six text classification datasets with 128 labels.
AlignBench: Benchmarking Chinese Alignment of Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Effective evaluation of alignment for emerging Chinese LLMs is still significantly lacking, calling for real-scenario grounded, open-ended, challenging and automatic evaluations tailored for alignment.
Approach: They propose a multi-dimensional benchmark for evaluating LLMs’ alignment in Chinese with 8 main categories, 683 real-scenario rooted queries and corresponding human verified references.
Outcome: The benchmark uses a human-in-the-loop data curation pipeline, 683 real-scenario rooted queries and human verified references.
SOLAR: Serendipity Optimized Language Model Aligned for Recommendation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have shown strong potential in recommendation tasks . however, their application to serendipity-oriented recommendations remains challenging .
Approach: They propose a domain-adaptive instruction tuning method that aligns Large Language Models with recommendation tasks.
Outcome: The proposed framework bridges the domain gap between LLMs and recommendation tasks.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Answering Narrative-Driven Recommendation Queries via a Retrieve–Rank Paradigm and the OCG-Agent (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generate narrative-driven recommendation are based on large language models (LLMs) but the RAG paradigm is inherently ill-suited for such special queries.
Approach: They propose a novel retrieve-rank paradigm that generatively retrieves structurally adaptive and semantically aligned candidates, ensuring both extensive candidate coverage and high-quality information.
Outcome: The proposed paradigm outperforms the existing paradigm and the existing one under real-world scenarios.
Cross-modality Information Check for Detecting Jailbreaking in Multimodal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are susceptible to jailbreak attacks, authors say . multimodal information increases the risk of attacks, but also provides additional data .
Approach: They propose a jailbreaking detector that detects maliciously perturbed image inputs . cross-modality information detector is designed to detect cross-modal similarity between harmful queries and adversarial images.
Outcome: a new tool can detect maliciously perturbed image inputs without modification or computation cost.
FedPETuning: When Federated Learning Meets the Parameter-Efficient Tuning Methods of Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing research on federated learning (FL) for pre-trained language models (PLMs) with increasing concerns about data privacy, enterprises or institutions are not allowed to collect data from end devices or local clients to a centralized server for fine-tuning PLMs.
Approach: They investigate the parameter-efficient tuning of pre-trained language models (PLMs) and develop a federated benchmark for four representative PETuning methods .
Outcome: The proposed method can defend against privacy attacks and maintain acceptable performance with reducing heavy resource consumption.
Exploring Memorization in Fine-tuned Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing studies have shown that pre-trained langauge models tend to memorize and regenerate segments of their pre-training corpus when prompted appropriately.
Approach: They conduct the first comprehensive analysis to explore language models’ memorization during fine-tuning across tasks.
Outcome: The proposed analysis shows that memorization presents a strong disparity among different fine-tuning tasks.
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach: They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome: The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .
The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model generation with proprietary and private data, where data privacy is . a privacy issue that is currently under-explored, is posed by RAG.
Approach: They propose to use retrieval-augmented generation (RAG) to facilitate language model generation with proprietary and private data where data privacy is a pivotal concern.
Outcome: The proposed attack methods demonstrate that RAG can mitigate the old risks, i.e., leakage of the LLMs’ training data.
COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)

Copied to clipboard

Challenge: Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback.
Approach: They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences.
Outcome: The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment.
Data Poisoning for In-context Learning (2025.findings-naacl)

Copied to clipboard

Challenge: In-context learning (ICL) has emerged as a capability of large language models (LLMs) but there is limited understanding of its vulnerability against data poisoning attacks.
Approach: They propose an attack method that exploits ICL’s unique learning mechanisms by identifying discrete text perturbations that influence LLM hidden states.
Outcome: The proposed attack method exploits ICL’s learning mechanisms by identifying discrete text perturbations that influence LLM hidden states.
Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show remarkable success in end-to-end task-oriented dialog systems . however, most models rely on large training data, which is difficult to scalable for new domains with limited labeled data.
Approach: They propose a shared-private network which exploits the relevance between the target domain and each domain.
Outcome: The proposed model outperforms existing methods on multi-domain dialogue by 13.9% on average.
Exploiting Abstract Meaning Representation for Open-Domain Question Answering (2023.findings-acl)

Copied to clipboard

Challenge: Existing work attempts to address these challenges using Pretrained Language Models (PLMs) but the diversity of surface form expressions can hinder the model’s ability to capture accurate correlations, especially when the context is lengthy and complex.
Approach: They propose a method known as Graph-as-Token (GST) to incorporate AMRs into PLMs to assist the model in understanding complex semantic information.
Outcome: The proposed method outperforms existing methods and significantly improves performance on both Natural Questions and TriviaQA.
AD-LLM: Benchmarking Large Language Models for Anomaly Detection (2025.findings-acl)

Copied to clipboard

Challenge: Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring.
Approach: They propose a benchmark that evaluates how large language models (LLMs) can help with NLP anomaly detection.
Outcome: The proposed model can perform zero-shot detection without tasks-specific training, data augmentation and model selection, and it can suggest unsupervised AD models.
DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for decoding target language are degenerate, hallucinating or empty.
Approach: They propose a method that tunes down the Softmax temperature to reduce autoregressive over-smoothness by label smoothing the output distributions.
Outcome: The proposed method improves MBR in various settings.
CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on indoor or street settings, overlooking challenges of open-ended urban spaces.
Approach: They propose a benchmark to probe cross-view spatial reasoning capabilities of current VLMs in urban settings.
Outcome: The citycube benchmark examines the performance of current vision-language models in urban environments.
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation.
Approach: They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model.
Outcome: Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training .
UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization (2023.acl-long)

Copied to clipboard

Challenge: a new benchmark summarization model is being developed to train few-shot summarizers . a large number of summarizing tasks are required to perform well in heterogeneous datasets.
Approach: They propose a few-shot summarization model pre-trained with multiple summarizing tasks . they propose 'uniSumm' to be prefix-tuned to excel at any few-shot summarisation task .
Outcome: The proposed model outperforms baseline models under automatic and human evaluations and achieves comparable results in human evaluation.
Knowledge-Centric Hallucination Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown impressive capabilities but a tendency to hallucinate.
Approach: They propose a framework that introduces claim-triplets to represent claims in LLM responses and evaluates them against a reference.
Outcome: The proposed framework outperforms prior methods by 18.2 to 27.2 points on a benchmark spanning various NLP tasks and annotated 11k claim-triplets from 2.1k responses by seven LLMs.
Causal Reasoning of Entities and Events in Procedural Texts (2023.findings-eacl)

Copied to clipboard

Challenge: Existing work on entity state tracking or event reasoning is limited to procedural texts.
Approach: They propose a benchmark for causal reasoning of event plausibility and entity states . they represent entities as programming languages while prompting language models .
Outcome: The proposed model outperforms existing models on human reasoning and event reasoning.
MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering (2024.findings-acl)

Copied to clipboard

Challenge: Existing MVQA models ignore multi-level progressive capabilities due to unspecific data and plain architecture.
Approach: They propose a multi-level visual language model for medical visual question answering (MVQA) which covers multi- level questions and answers as well as reasoning processes from visual clues to semantic cognition.
Outcome: The proposed model outperforms existing medical multimodal large language models on a multi-level instruction dataset and a feature alignment module.
GLAMR: Augmenting AMR with GL-VerbNet Event Structure (2024.lrec-main)

Copied to clipboard

Challenge: Abstract Meaning Representation (AMR) is a general-purpose semantic encoding for language.
Approach: They propose an AMR interpretation of Generative Lexicon semantic components using a verb-net-encoded verb-node graph.
Outcome: The proposed extension is compatible with current AMR specification and can be automated.
Boosting Data Utilization for Multilingual Dense Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on fine-tuning multilingual dense retrieval models, but data scarcity for low-resource languages makes it difficult to align representations in a shared vector space.
Approach: They propose to obtain high-quality hard negative samples and effective mini-batch data to boost data utilization for multilingual dense retrieval by obtaining high-quality negative samples.
Outcome: The proposed method outperforms existing baselines on a multilingual retrieval benchmark, MIRACL, with 16 languages.
Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents.
Approach: They propose to leverage hidden representations into existing jailbreak targets to move the attacks along the acceptance direction.
Outcome: The proposed methods are validated using the objective of existing jailbreak attacks.
AwarenessBench: Assessing Cognitive Capabilities of Language Models (2026.acl-long)

Copied to clipboard

Challenge: Language models exhibit increasingly consciousness-like behaviors, requiring a baseline to evaluate their cognitive abilities.
Approach: They propose a benchmark to assess the cognitive abilities of language models (LMs) they compare 18 state-of-the-art LMs to human models in metacognition, self-awareness, social awareness and situational awareness .
Outcome: Evaluating 18 state-of-the-art LMs, they find they consistently surpass baselines . but most models fall short in metacognition and self-awareness, the study finds .
PREE: Towards Harmless and Adaptive Fingerprint Editing in Large Language Models via Knowledge Prefix Enhancement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing black-box fingerprinting techniques rely on overfitting high-perplexity trigger patterns . experimental results show that model editing in the fingerprint domain exhibits unique advantages .
Approach: They propose a prefix-enhanced fingerprint editing framework that encodes copyright information into parameter offsets through dual-channel knowledge edit to achieve covert embedding of fingerprint features.
Outcome: The proposed model editing framework achieves 90% trigger precision in mainstream architectures . the proposed model editor achieves the 90% accuracy in mainstream models .
RSDA: Restoring Stale Data Affinity via Dynamic Renovation Strategy for Mitigating Data Scarcity (2026.acl-long)

Copied to clipboard

Challenge: High-quality data is the cornerstone of advancing large language models, but the supply of premium data is nearing depletion, while vast stale corpora remain underutilized.
Approach: They propose a framework to restore stale data affinity by quantifying the latent value of samples and employing a dynamic renovation strategy selection mechanism to determine the optimal component-level strategy.
Outcome: The proposed framework achieves performance improvements using less than 10% of the data volume, underscoring that the latent potential of stale corpora remains largely untapped.
Linguistically Conditioned Semantic Textual Similarity (2024.acl-long)

Copied to clipboard

Challenge: Semantic textual similarity (STS) is a fundamental NLP task that measures the semantic similarity between two sentences.
Approach: They propose to use a conditional STS dataset to measure sentences’ similarity conditioned on a certain aspect to reduce the inherent ambiguity posed by the sentences.
Outcome: The proposed method improves the performance over baselines on the C-STS dataset with over 80% F1 score.
RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing research on Retrieval Augmented Generation (RAG) does not address the problem of hallucinations and real-time updating of knowledge.
Approach: They propose a modular open-source library to equip LLMs with external knowledge.
Outcome: The proposed approach reduces the need for expensive open-source tools and lacks fair comparisons between novel RAG algorithms.
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)

Copied to clipboard

Challenge: Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses.
Approach: They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times .
Outcome: CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance.
SConU: Selective Conformal Uncertainty in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing frameworks fail to identify outliers that violate the exchangeability assumption, leading to unbounded miscoverage rates and unactionable prediction sets.
Approach: They propose a method that implements significance tests to determine whether a given sample deviates from the uncertainty distribution of the calibration set.
Outcome: The proposed approach facilitates rigorous management of miscoverage rates across single-domain and interdisciplinary contexts, and enhances the efficiency of predictions.
MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments (2026.acl-long)

Copied to clipboard

Challenge: AndroidWorld is the dominant mobile GUI agent evaluation benchmark, but its success rates are low . despite reproducible emulator environment, it lacks key application categories such as e-commerce and enterprise communication.
Approach: They propose a benchmark for mobile GUI agents that reflects real-world usage through long-horizon, cross-application workflows.
Outcome: The proposed framework achieves over 90% success rates, while AndroidWorld is the dominant benchmark.
Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success in Natural Language Processing, yet their cross-lingual consistency remains a significant challenge.
Approach: They propose a method to identify cross-lingual weaknesses in Large Language Models . they construct bilingual question pairs that expose performance discrepancies between English and target languages .
Outcome: The proposed method uncovers over 50% accuracy drops in target languages across models.
Knowledge Conflicts for LLMs: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: This survey examines knowledge conflicts for large language models (LLMs) this survey aims to shed light on strategies for improving the robustness of LLMs .
Approach: They focus on three categories of knowledge conflicts: context-memory, inter-context, and intra-membry conflict.
Outcome: The findings highlight the challenges faced by large language models when blending contextual and parametric knowledge.
Temporal Sampling for Forgotten Reasoning in LLMs (2026.acl-long)

Copied to clipboard

Challenge: a new metric measures the percentage of questions that were answered incorrectly during fine-tuning .
Approach: They propose a decoding strategy that draws outputs from multiple checkpoints along the training trajectory.
Outcome: The proposed method improves reasoning performance and consistency across benchmarks.
KCVR: Knowledge-Centric Video Reconstruction for Structured Pedagogical Summarization via Dynamic Graph Planning (2026.acl-long)

Copied to clipboard

Challenge: Existing summarization methods compress content for gist browsing, but they break prerequisite logic in instructional videos.
Approach: They propose a framework that decouples epistemic planning from content generation.
Outcome: The proposed framework outperforms strong end-to-end baselines on Knowledge Progression Consistency and Learning Objective Coverage.
The Strength of the Weakest Supervision: Topic Classification Using Class Labels (N19-3)

Copied to clipboard

Challenge: a topic classifier can understand only class labels when training for tasks that require a large amount of labeled documents.
Approach: They propose an algorithm that can initialize a topic classifier using only class labels . they propose a method that combines word embedding and naive Bayes classification .
Outcome: The proposed approach saves significant initial labeling effort by providing a "warm start" the proposed approach can be fine-tuned with more labeled documents to reach a certain performance level.
Mitigating the Privacy Issues in Retrieval-Augmented Generation (RAG) via Pure Synthetic Data (2025.emnlp-main)

Copied to clipboard

Challenge: Existing literature suggests that RAG systems may face privacy issues when the retrieval process involves private data.
Approach: They propose a two-stage synthetic data generation paradigm that uses attributes to preserve contextual information from the original data.
Outcome: The proposed approach preserves key contextual information from the original data while reducing privacy risks.
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Clinical natural language processing (NLP) is a subfield that requires the extraction, analysis, and interpretation of unstructured clinical text.
Approach: They propose a model which infuses knowledge into clinical text generation with LLMs for clinical NLP tasks.
Outcome: The proposed model improves performance across 8 clinical NLP tasks and 18 datasets by 7.7%-8.7% on average.
A Simple and Efficient Learning-Style Prompting for LLM Jailbreaking (2026.findings-eacl)

Copied to clipboard

Challenge: Learning-style queries can reliably elicit harmful responses, highlighting a critical safety blind spot in modern LLMs.
Approach: They propose a new reframing paradigm that hides intention by learning from LLMs and uses 4 conceptual components to construct learning-style queries.
Outcome: The proposed framework achieves top attack success rates on most models and across malicious categories while maintaining high efficiency with concise prompts.
RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records (2024.acl-short)

Copied to clipboard

Challenge: Existing deep learning models for EHRs rely on knowledge from a single source and do not capture the semantic information for medical codes.
Approach: They propose a Retrieval AugMentation pipeline to augment clinical prediction on EHRs . they use multiple knowledge sources to convert them into text and use consistency regularization to capture complementary information from patient visits and summarized knowledge.
Outcome: Experiments on two EHR datasets show that RAM-EHR improves clinical prediction tasks.
ZPR2: Joint Zero Pronoun Recovery and Resolution using Multi-Task Learning and BERT (2020.acl-main)

Copied to clipboard

Challenge: Zero pronoun recovery and resolution aim at recovering the dropped pronounce and pointing out its anaphoric mentions.
Approach: They propose to solve two tasks together to recover the dropped pronoun and point out its anaphoric mentions.
Outcome: The proposed model outperforms previous state of the arts benchmarks on two benchmarks.
Flexibly Utilize Memory for Long-Term Conversation via a Fragment-then-Compose Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models extract useful information from conversation history to enhance the response in long-term conversations.
Approach: They propose a Fragment-then-Compose framework to optimize memory utilization for long-term open-domain conversation.
Outcome: The proposed framework can be used to extract useful information from conversation history . it can be adapted to different situations and improve response generation .
LinkPrompt: Natural and Universal Adversarial Attacks on Prompt-based Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Prompt-based learning is a new language model training paradigm that adapts Pre-trained Language Models (PLMs) to downstream tasks.
Approach: They propose a prompt-based learning paradigm that adapts Pre-trained Language Models to downstream tasks . they use a gradient-based beam search algorithm to generate adversarial triggers .
Outcome: The proposed model improves performance on various natural language processing tasks by optimizing the prompt template.
WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection (2024.acl-long)

Copied to clipboard

Challenge: Prior studies have shown that EaaS can be prone to model extraction attacks, however, this concern could be mitigated by adding backdoor watermarks to the text embeddings.
Approach: They propose a new method that removes backdoor watermarks while maintaining the high utility of embeddings.
Outcome: The proposed approach increases the stealthiness of watermarks and has been empirically shown to be effective against CSE attacks.
CoAct: Co-Active LLM Preference Learning with Human-AI Synergy (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to learn from preference-based feedback are expensive and scarce.
Approach: They propose a framework that synergistically combines self-rewarding and active learning through human-AI collaboration.
Outcome: The proposed framework outperforms existing methods on three reasoning benchmarks and achieves average improvements of +13.25% on GSM8K, +8.19% on MATH, and +13.16% on WebInstruct.
DFAMS: Dynamic-flow guided Federated Alignment based Multi-prototype Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for ambiguous queries struggle to retrieve high-quality documents . DFAMS outperforms advanced FR methods by 14.37% in knowledge classification accuracy .
Approach: They propose a framework that leverages dynamic information flow to identify latent query intents and construct semantically aligned knowledge partitions for accurate retrieval across heterogeneous sources.
Outcome: The proposed framework outperforms existing methods in classification accuracy and retrieval recall tests.
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for short TST are difficult to implement and can cause content degradation.
Approach: They propose a method to vary the style polarity of text while preserving semantic content.
Outcome: The proposed method improves over baselines and is highly efficient.
An Alignment-Agnostic Model for Chinese Text Error Correction (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing models for Chinese text error correction can correct mistaken, missing and redundant characters, but they cannot handle missing or redundant characters.
Approach: They propose an alignment-agnostic framework to correct Chinese text errors . framework detects missing and redundant characters and can be used as a cold start model .
Outcome: The proposed framework can handle both text aligned and non-aligned situations and can serve as a cold start model when no annotation data are provided.
ConU: Conformal Uncertainty in Large Language Models with Correctness Coverage Guarantees (2024.findings-emnlp)

Copied to clipboard

Challenge: Uncertainty quantification (UQ) in natural language generation tasks remains an open challenge . however, black-box uncertainty measures require investigating with the proliferation of LLMs served via APIs.
Approach: They propose a conformal uncertainty measure and a method to transform heuristic uncertainty notions into rigorous prediction sets.
Outcome: Empirical results show that the proposed method outperforms state-of-the-art methods and can provide reliable guarantees for open-ended NLG tasks.
A Survey on Natural Language Counterfactual Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in NLP are driven by a variety of Large Language Models (LLMs), such as GPT-3 (175B) and PaLM (540B).
Approach: They propose a taxonomy that categorizes the methods into four groups and summarizes the metrics for evaluating the generation quality.
Outcome: The proposed taxonomy categorizes the generation methods into four groups and summarizes the metrics for evaluating the quality.
InterIDEAS: Philosophical Intertextuality via LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: a new dataset aims to bridge philosophy, literary studies, and natural language processing (NLP) by integrating theories of intertextuality with bibliometric techniques.
Approach: They propose a dataset that bridges philosophy, literary studies, and natural language processing (NLP) it combines theories of intertextuality from literary studies with bibliometric techniques and recent LLMs .
Outcome: a new dataset bridges philosophy, literary studies, and natural language processing (NLP) to analyze intertextuality . the proposed method helps scholars understand the intellectual, social, and historical relations embedded in texts . it also contributes to the development of language models, authors say .
DeepInsert: Early Layer Bypass for Efficient and Performant Multimodal Understanding (2026.eacl-long)

Copied to clipboard

Challenge: Recent work shows that hyperscaling of data and parameter count in LLMs is yielding diminishing improvement when weighed against training costs.
Approach: They propose to insert multimodal tokens directly into the middle of the model to bypass the early layers.
Outcome: The proposed method reduces training and inference costs while preserving performance.
DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing code benchmarks for large language models remain static, resulting in data contamination and unreliable evaluation results.
Approach: They propose a dynamic, complexity-aware benchmark that overcomes the limitations of static datasets and provides a memorization-advantaged benchmark.
Outcome: DynaCode generates 189 million unique nested code problems across 4 units of code complexity and 16 types of call graphs.
Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systems (2025.emnlp-main)

Copied to clipboard

Challenge: Empirical studies for communication topology design often overlook why and when sparse and dense topologies help or hinder collaboration.
Approach: They propose a topology design approach that balances error suppression and beneficial information propagation by fusing connectivity patterns from dense and sparse graphs.
Outcome: The proposed topology design achieves superior performance across tasks with sparse and dense graphs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations