Papers by Jie Lu

43 papers
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)

Copied to clipboard

Challenge: a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities .
Approach: They present a comparative analysis to identify and distinguish LLM activities from human activities.
Outcome: The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities.
Learning In-context Learning for Named Entity Recognition (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to recognize entities in text are limited by the diversity of entity types and the lack of high-quality annotations.
Approach: They propose an in-context learning-based NER approach that can inject in-const NER ability into PLMs and recognize entities of novel types on-the-fly using only a few demonstrative instances.
Outcome: The proposed method outperforms the PLMs+fine-tuning counterparts on 4 few-shot NER datasets and significantly outperformed the Plms+initialized extractors.
Unified Contextual Query Rewriting (2023.acl-industry)

Copied to clipboard

Challenge: Large-scale conversational AI agents such as Alexa, Siri, and Google Assistant are becoming increasingly popular in real-world applications to assist users in daily life.
Approach: They propose a unified contextual query rewriting model that unifies QR for friction reduction and contextual carryover . they leverage the text-to-text unified framework which uses independent tasks with weighted loss to account for task importance .
Outcome: The proposed model reduces friction and contextual carryover by using multiple auxiliary tasks.
MemSearcher: Iterative Memory Integration for Search Agent via End-to-End Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Recent LLM-based search agents often concatenate the full interaction history into the context, producing long and noisy inputs and increasing compute cost and memory overhead.
Approach: They propose an agent framework that maintains a compact memory during multi-turn interactions.
Outcome: The proposed framework outperforms strong history-concatenation (ReAct-style) baselines on a range of public datasets while maintaining nearly constant token counts across multi-turn interactions.
TPA: Next Token Probability Attribution for Detecting Hallucinations in RAG (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches attribute hallucinations to a binary conflict between internal knowledge stored in FFNs and the retrieved context.
Approach: They propose a framework which mathematically attributes each next-token probability to seven distinct sources and aggregates source attributions by POS tags to quantify contribution of each model component to the generation of specific linguistic categories within a response.
Outcome: Extensive experiments show that the proposed framework achieves state-of-the-art performance.
LaMP-Val: Large Language Models Empower Personalized Valuation in Auction (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, most research focuses on the bidding algorithms used within auction mechanisms.
Approach: They propose a personalized valuation framework that integrates Large Language Models to incorporate personalized semantic preference into users valuation process.
Outcome: The proposed framework incorporates Large Language Models to incorporate personalized semantic preference into users valuation process.
Robust Preference Optimization via Dynamic Target Margins (2025.findings-acl)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) is an efficient method for ensuring safety and reliability in practical applications.
Approach: They propose a dynamic target margin preference optimization algorithm that adjusts reward margins at the pairwise level.
Outcome: The proposed method achieves an average 4.4% improvement over baselines, setting new benchmarks for state-of-the-art performance.
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit significant but subtle weaknesses, such as mistakes in instruction-following or coding tasks.
Approach: They propose a framework to automatically expose weaknesses in Large Language Models (LLMs) they use three LLM-powered agents to perform comprehensive weakness identification .
Outcome: The proposed framework shows that it is more effective than untargeted data augmentation methods like Self-Instruct to identify weaknesses in LLMs.
Critic-CoT: Boosting the Reasoning Abilities of Large Language Model via Chain-of-Thought Critic (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve the reasoning performance of large language models rely on intuitive instance-level feedback, which limits the reasoning capabilities.
Approach: They propose a framework that pushes LLMs toward System-2-like critic capability by using a step-wise CoT reasoning paradigm and automatic construction of weak-supervision data without human annotation.
Outcome: The proposed model significantly improves task-solving performance by filtering out invalid solutions or iterative refinement.
Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: a new text classification framework for large language models addresses the problem of boundary ambiguity and inherent biases in LLMs.
Approach: They propose a two-stage classification framework for large language models to mitigate bottlenecks . their approach uses pairwise comparisons to efficiently narrow down options .
Outcome: The proposed framework reduces the number of options and improves on four datasets.
AgentTuning: Enabling Generalized Agent Abilities for LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Open large language models (LLMs) with great performance in various tasks are far inferior to commercial models such as ChatGPT and GPT-4 when acting as agents to tackle complex tasks in the real world.
Approach: They propose a method to enhance the agent capabilities of LLMs while maintaining their general abilities.
Outcome: The AgentLM-70B is comparable to GPT-3.5-turbo on unseen agent tasks, demonstrating generalized agent capabilities.
Multi-Level Cross-Modal Alignment for Speech Relation Extraction (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies use synthetic speech to train and evaluate SpeechRE models, hindering their development . modality gap issue limits performance of existing models, limiting future researches .
Approach: They propose to use speech data to train and evaluate SpeechRE models by using real speech . they propose to train a cross-modal alignment model to bridge the modality gap .
Outcome: The proposed model can train to bridge the modality gap between speech encoder and text decoder . the proposed model is based on two real SpeechRE datasets .
HetGCoT: Heterogeneous Graph-Enhanced Chain-of-Thought LLM Reasoning for Academic Question Answering (2025.findings-emnlp)

Copied to clipboard

Challenge: graph neural networks capture structured graph information, but lack integration at the reasoning level.
Approach: They propose a framework that leverages graph structural information to reason interpretable academic QA results.
Outcome: The proposed framework outperforms sota baselines on OpenAlex and DBLP datasets.
On-Policy Self-Alignment with Fine-grained Knowledge Feedback for Hallucination Mitigation (2025.findings-acl)

Copied to clipboard

Challenge: Large language models exhibit behavior that deviates from the boundaries of their knowledge during response generation.
Approach: They propose a framework that allows large language models to explore their knowledge boundaries and self-correct generation behavior through fine-grained feedback signals.
Outcome: The proposed framework enables LLMs to explore their knowledge boundaries and self-correct generation behavior through fine-grained feedback signals.
Dependency-based Hybrid Trees for Semantic Parsing (D18-1)

Copied to clipboard

Challenge: Existing models for semantic parsing focus on structure-based models, but none deal with dependency information.
Approach: They propose a dependency-based hybrid tree model which converts natural language utterances into machine interpretable meaning representations.
Outcome: The proposed model achieves state-of-the-art performance across eight languages and is highly tractable inferenceable.
Visual Prompt Tuning for Few-Shot Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing work on pretraining models for text classification uses image encoders instead of visual prompts.
Approach: They propose a method to deploy large-scale pre-trained models in the prompt-tuning paradigm in few-shot learning.
Outcome: The proposed method outperforms the most recent prompt-tuning methods on five public text classification datasets.
Leveraging Training Data in Few-Shot Prompting for Numerical Reasoning (2023.findings-acl)

Copied to clipboard

Challenge: Chain-of-thought (CoT) prompts can be challenging to design for arithmetic word problem solving.
Approach: They propose to use training data to replace CoT with programs as the reasoning step . their results show that leveraging training data can improve generalization ability of prompts .
Outcome: The proposed methods improve the generalization ability of prompts and the performance of fine-tuned smaller models in arithmetic word problem solving.
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)

Copied to clipboard

Challenge: prevailing pre-training approaches for large language models involve several complexities.
Approach: They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data .
Outcome: The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data .
The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters (2025.acl-long)

Copied to clipboard

Challenge: Theory-of-Mind (ToM) is a psychological capability that allows humans to understand and interpret the mental states of others.
Approach: They propose a CharToM-QA benchmark to assess the importance of comprehensive contextual understanding about personal backgrounds in ToM.
Outcome: The proposed model outperforms existing models on 1,035 ToM questions based on classic novels and shows that educated participants perform better when they have read the novels than non-educated participants.
Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for hallucination detection depend on internal signals like uncertainty and self-consistency checks to identify unreliable outputs.
Approach: They propose a retrieval-augmented generation method to enhance hallucination detection by addressing information updating challenges.
Outcome: The proposed method improves on existing methods with strong generalization capabilities.
Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have explored Continual Instruction Tuning (CIT) in Multimodal Large Language Models (MLLMs), with a primary focus on Task-incremental CIT, where MLLM are required to continuously acquire new tasks.
Approach: They propose a Sparse Mixture of Expert (SMoE) based method for domain-incremental CIT in Multimodal Large Language Models (MLLMs) . they equip the SMoA module with a domain-specific autoregressive loss (DSAL) they establish a new benchmark to evaluate the efficacy of their method .
Outcome: The proposed method outperforms all baselines and is based on a Sparse Mixture of Experts (SMoE) module .
Better Feature Integration for Named Entity Recognition (2021.naacl-main)

Copied to clipboard

Challenge: Existing approaches to named entity recognition (NER) focus on stacking the LSTM and graph neural networks (GCNs) however, the exact interaction mechanism between the two types of features is not clear and the performance gain is not significant.
Approach: They propose a model that incorporates both types of features with a Synergized-LSTM which captures how the two types of feature interact.
Outcome: The proposed model achieves better performance than previous approaches while requiring fewer parameters.
Non-Autoregressive Machine Translation as Constrained HMM (2024.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) models have some drawbacks due to slow inference speed and label bias due to local normalization.
Approach: They propose to use a left-to-right Hidden Markov Model (HMM) to control label bias in non-autoregressive translation (NAT) They propose a bi-directional HMM, which can regularize each other's biases via shared parameters.
Outcome: The proposed models can achieve comparable performance to autoregressive Transformers using various decoding methods.
Adversarial Preference Learning for Robust LLM Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Modern language models rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors, but they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of human annotation; (2) the vast diversity of potential adversarials; and (3) the risk of feedback bias and reward hacking.
Approach: They propose an iterative adversarial training method that incorporates three key innovations to address these challenges.
Outcome: Experiments on Mistral-7B-Instruct-v0.3 show that the proposed method significantly enhances robustness and reduces harmful outputs from 5.88% to 0.43%.
Dependency-Guided LSTM-CRF for Named Entity Recognition (D19-1)

Copied to clipboard

Challenge: Named entity recognition (NER) is one of the most important and fundamental tasks in natural language processing (NLP).
Approach: They propose a dependency-guided model to encode dependency trees and capture their properties for named entity recognition.
Outcome: The proposed model improves named entity recognition performance on standard datasets.
TreeRL: LLM Reinforcement Learning with On-Policy Tree Search (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for On-Policy LLM RL typically train a separate process reward model, which suffers from distribution mismatch and reward hacking.
Approach: They propose a reinforcement learning framework that directly incorporates on-policy tree search for RL training.
Outcome: Experiments on math and code reasoning benchmarks show that tree search achieves superior performance compared to traditional ChainRL.
LongSafety: Evaluating Long-Context Safety of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating long sequences.
Approach: They propose a benchmark to evaluate LLM safety in open-ended long-context tasks . they find that relevant context and extended input sequences can exacerbate safety risks .
Outcome: The proposed benchmark identifies significant safety vulnerabilities in 16 LLMs . strong safety performance in short-context scenarios does not correlate with safety in long-contact tasks .
Evolving Agentic Workflow Driven by Human-Agent Collaboration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generate agentic workflows using large language models are limited by high manual design costs, inefficient agentic search, and poor dynamic adaptability to new tasks and human preferences.
Approach: They propose an evolutionary framework for generating agentic workflows through human-agent collaboration using evolutionary algorithms that mutate and cross over their structures, prompts, and LLM backbones.
Outcome: The proposed framework surpasses other automated baselines by 27.34% while achieving comparable performance to o1-preview at only one-fourth of the cost.
Better Modeling of Incomplete Annotations for Named Entity Recognition (N19-1)

Copied to clipboard

Challenge: Existing approaches to named entity recognition (NER) assume that the training data is fully annotated with named entity information.
Approach: They propose a supervised setup for named entity recognition where annotated data is assumed to be available during training.
Outcome: The proposed approach is able to recognize named entities with incomplete annotations.
Mitigating the Privacy Issues in Retrieval-Augmented Generation (RAG) via Pure Synthetic Data (2025.emnlp-main)

Copied to clipboard

Challenge: Existing literature suggests that RAG systems may face privacy issues when the retrieval process involves private data.
Approach: They propose a two-stage synthetic data generation paradigm that uses attributes to preserve contextual information from the original data.
Outcome: The proposed approach preserves key contextual information from the original data while reducing privacy risks.
ArrowGEV: Grounding Events in Video via Learning the Arrow of Time (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches for grounding events in videos are limited by their time-sensitive nature . arrow of time in physics characterizes intrinsic directionality of temporal processes .
Approach: They propose a framework that explicitly models temporal directionality in events to improve event grounding and temporal understanding in VLMs.
Outcome: The proposed framework improves event grounding and directionality understanding in VLMs.
Cheems: A Practical Guidance for Building and Evaluating Chinese Reward Models from Scratch (2025.acl-long)

Copied to clipboard

Challenge: Existing Chinese resources are small in scale and limited to specific domains, making them insufficient for LLM post-training.
Approach: They propose a Chinese-annotated reward model and a preference dataset to address this gap . they evaluate Chinese RMs on CheemsBench and construct an RM that captures human preferences .
Outcome: The proposed RM achieves state-of-the-art performance on CheemsBench and CheeMePreference.
A Self-Denoising Model for Robust Few-Shot Relation Extraction (2025.acl-long)

Copied to clipboard

Challenge: Existing studies assume that the support set contains only accurately labeled instances, but this assumption is often unrealistic.
Approach: They propose a self-denoising model for FSRE which can automatically correct noisy labels of support instances.
Outcome: The proposed model outperforms all baselines on two public datasets showing that it can correct mislabeled support instances.
ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarization (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to building cross-lingual summarization systems on dialogue documents are limited.
Approach: They propose a benchmark dataset for building cross-lingual summarization systems on dialogue documents.
Outcome: The proposed model outperforms pipeline models on ClidSum and mDialBART.
Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)

Copied to clipboard

Challenge: Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent.
Approach: They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites.
Outcome: The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites.
Enhancing One-Shot Pruned Pre-trained Language Models through Sparse-Dense-Sparse Mechanism (2025.coling-main)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) are robust in contextual understanding but their considerable size incurs significant computational and storage costs.
Approach: They propose a Sparse-Dense-Sparse pruning framework to prune PLMs . they prune less critical connections using conventional pruning methods .
Outcome: The proposed pruning framework outperforms SparseGPT and Wanda under identical sparsity.
Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction (2022.acl-long)

Copied to clipboard

Challenge: Existing approaches to solve math word problems do not provide explanations for generated expressions.
Approach: They propose a deductive approach that presents explainable deductive reasoning steps to iteratively construct target expressions.
Outcome: The proposed model significantly outperforms existing strong baselines on four benchmark datasets.
To be Closer: Learning to Link up Aspects with Opinions (2021.emnlp-main)

Copied to clipboard

Challenge: Dependency parsers are not designed for capturing interaction between opinion words and aspect words.
Approach: They propose to learn an aspect-centric tree structure to shorten distance between aspects and opinion words.
Outcome: The proposed model outperforms baselines on five aspect-based sentiment datasets.
ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring (2026.acl-industry)

Copied to clipboard

Challenge: Existing regulatory policies create label inconsistencies and reasoning ambiguities in historical datasets.
Approach: They propose a policy-adaptive governance system that enables evolving reinforcement through multi-agent adversarial umpiring.
Outcome: The proposed system outperforms fine-tuning baselines on industrial and public datasets . it enables evolving reinforcement through multi-agent adversarial umpiring .
More Than Sum of Its Parts: Deciphering Intent Shifts in Multimodal Hate Speech Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing systems struggle with multimodal content where the emergent meaning transcends the aggregation of individual modalities.
Approach: They propose a framework to characterize semantic intent shifts where modalities interact to construct implicit hate from benign cues or neutralize toxicity through semantic inversion.
Outcome: The proposed framework outperforms state-of-the-art benchmarks on H-VLI and on established benchmarks.
Towards Robust k-Nearest-Neighbor Machine Translation (2022.emnlp-main)

Copied to clipboard

Challenge: k-Nearest-Neighbor Machine Translation (kNN-MT) is a popular research paradigm in machine translation.
Approach: They propose a confidence-enhanced kNN-MT model with robust training to reduce noise . they introduce NMT confidence to refine the modeling of important components of kN-MT .
Outcome: The proposed model improves on four benchmark datasets and is robust to training.
ENT-DESC: Entity Description Generation by Exploring Knowledge Graph (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for knowledge-to-text generation use RDF triples or key-value pairs to generate a natural language description.
Approach: They propose a large-scale dataset to facilitate the study of KG-to-text . they propose MGCN model architecture that incorporates aggregation methods to extract the rich graph information.
Outcome: The proposed model can represent the original graph information more comprehensively and integrates multiple aggregation methods to extract the rich graph information.
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences.
Approach: They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context.
Outcome: The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations