Papers by Jin Lu

43 papers
TrInk: Ink Generation with Transformer Network (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for handwriting generation capture global dependencies and can generate high-quality handwritten samples.
Approach: They propose a Transformer-based model for ink generation, TrInk, which captures global dependencies.
Outcome: The proposed model reduces character error rate and word error rate by 35.56% on the IAM-OnDB dataset compared to previous models.
Benchmarking Retrieval-Augmented Generation for Medicine (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have state-of-the-art performance on a wide range of medical question answering tasks, but they still face challenges with hallucinations and outdated knowledge.
Approach: They propose a benchmark to evaluate medical RAG systems using large-scale experiments with over 1.8 trillion prompt tokens.
Outcome: The proposed benchmark improves accuracy of six different LLMs by up to 18% over chain-of-thought prompting.
Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios (2025.findings-naacl)

Copied to clipboard

Challenge: Long prompts contain redundant information and are sensitive to the position of key information in long context scenarios.
Approach: They propose a training-free prompt compression framework that retains key information at token level while removing distracting tokens.
Outcome: The proposed framework outperforms existing methods on long context benchmarks.
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions.
Approach: They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process.
Outcome: The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences.
A Neural Transition-based Model for Nested Mention Recognition (D18-1)

Copied to clipboard

Challenge: Existing methods to recognize nested mentions are based on Stack-LSTM . nesting mentions can be used for downstream tasks like question answering and relation extraction.
Approach: They propose a scalable transition-based method to model the nested structure of mentions.
Outcome: The proposed method gets the state-of-the-art performance in ACE datasets showing its effectiveness in detecting nested mentions.
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) face memory challenges due to the high cost of backpropagation.
Approach: They propose a zeroth-order (ZO) optimization that matches memory usage to inference . they propose scalable and memory-efficient zeroth order (ZE) optimizer that integrates annealed A-GNB gradients with diagonal Hessian estimation and layer-wise clipping as a second-order pre-conditioner.
Outcome: The proposed algorithm outperforms state-of-the-art methods with an average speedup of 20 over MeZO on RoBERTa-large and OPT-1.3B.
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions.
Approach: They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification.
Outcome: The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% .
Self-Harmonized Chain of Thought (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for chain-of-thought prompting have limitations . arithmetic, commonsense, and symbolic reasoning tasks are challenging .
Approach: They propose a method that unifies diverse solution paths into a consistent reasoning pattern.
Outcome: The proposed method outperforms existing methods by 2.8% on reasoning tasks.
MIND: From Passive Mimicry to Active Reasoning through Capability-Aware Multi-Perspective CoT Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches restrict students to following a single golden rationale and treat different reasoning paths independently, causing suboptimal performance.
Approach: They propose a capability-adaptive framework that transitions distillation from passive mimicry to active cognitive construction and employ a feedback-driven inertia calibration mechanism to align supervision with the student’s current adaptability.
Outcome: Experiments show that the proposed framework achieves state-of-the-art performance on both in-distribution and out-of distribution benchmarks.
NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generate research ideas rely on retrieval or prompt engineering to generate ideas.
Approach: They propose a method that uses iterative planning and search to boost creative potential of LLMs by integrating external knowledge with broader and deeper insights.
Outcome: The proposed method outperforms the current state-of-the-art in generating 2.5 times more top-rated ideas based on 170 seed papers in a Swiss Tournament evaluation.
LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios (2025.naacl-long)

Copied to clipboard

Challenge: LongLeader aims to assess different LLMs' long-context comprehension abilities . long-constext comprehension is a key bottleneck for many use cases .
Approach: They propose a leaderboard to assess different LLMs' long-context comprehension abilities . they offer open-source access to the benchmarks and maintain a dedicated website .
Outcome: The proposed model assesses different LLMs on selected benchmarks and provides open-source access to the benchmarks.
Modeling Content Importance for Summarization with Pre-trained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies on content importance do not consider semantics and context when evaluating importance.
Approach: They apply information theory to pre-trained language models to define the concept of importance from the perspective of information amount.
Outcome: Experiments on CNN/Daily Mail and New York Times show that the proposed model can model the importance of content better than previous methods based on F1 and ROUGE scores.
Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intents (2026.acl-long)

Copied to clipboard

Challenge: Tool-calling agents are increasingly deployed in real-world customer-facing workflows . but most studies on tool-callers focus on idealized settings with general, fixed, and well-specified tasks.
Approach: They propose a tool-calling agent-based data pipeline that converts trajectories into user-facing tasks with controlled intent adaptations.
Outcome: The proposed pipeline can be used to study tool use under three scenarios.
Threshold Filtering Packing for Supervised Fine-Tuning: Training Related Samples within Packs (2025.naacl-long)

Copied to clipboard

Challenge: Randomly concatenating data points can lead to cross-contamination due to the significant difference in their subject matter.
Approach: They propose a method that randomly concatenates data of varying lengths until reaching the designed maximum length to optimize context length and reduce padding.
Outcome: The proposed method significantly improves performance on GSM8K and HumanEval, and also improves fairness and accuracy by 15%.
BinaryBERT: Pushing the Limit of BERT Quantization (2021.acl-long)

Copied to clipboard

Challenge: Recent pre-trained language models have achieved remarkable performance improvement in various tasks, but the improvement generally comes at the cost of increasing model size and computation.
Approach: They propose a binary quantization technique which initializes binaryBERT by splitting from a ternary network.
Outcome: The proposed model achieves state-of-the-art performance on the GLUE and SQUAD benchmarks while being 24x smaller.
CARD: Cross-modal Agent Framework for Generative and Editable Residential Design (2025.emnlp-main)

Copied to clipboard

Challenge: Architectural design automation has made significant progress, but the complexity of open-world environments makes residential design a challenging task.
Approach: They propose a framework that leverages a system of specialized cross-modal agents to adapt to open-world residential design.
Outcome: The proposed framework enables users to generate and edit residential design without requiring specialized expertise.
Sailor: Open Language Models for South-East Asia (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) rely on English data for training, but are often not comparable across other languages.
Approach: They propose to develop a family of open language models for SEA languages . they use BPE dropout, aggressive data cleaning and deduplication to improve model robustness .
Outcome: The proposed models perform well across four benchmarks, including commonsense reasoning, question answering, reading comprehension and examination.
Is the Attention Matrix Really the Key to Self-Attention in Multivariate Long-Term Time Series Forecasting? (2026.acl-long)

Copied to clipboard

Challenge: In multivariate long-term time series forecasting, it is widely believed that the effectiveness of self-attention arises from its attention matrix.
Approach: They propose a multi-branch MLP that isolates the ‘multi-brain mapping with element-wise operation’ structure from the Transformer and shows that it achieves competitive performance.
Outcome: The proposed model outperforms three classic and three latest Transformer models and shows that it achieves competitive performance.
Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedback (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) generate code for given contexts, such as incomplete code, class, data structure, or project-specific information.
Approach: They propose a compiler feedback-based code generation approach that leverages static analysis to identify mismatches between the generated code and the project's context.
Outcome: The proposed model outperforms retrieval-based code generation baselines and significantly outperfies the existing large language models.
Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to RLVR use multiple-choice questions as verifiable rewards . however, not all tasks provide reliable verification .
Approach: They propose a framework that actively constructs high-quality distractors to block elimination shortcuts and promote deep reasoning.
Outcome: The proposed method significantly improves reasoning capabilities of Large Language Models.
HisDoc-OCR: Restoring Visual Grounding in MLLMs for Chinese Historical Document OCR (2026.findings-acl)

Copied to clipboard

Challenge: Despite multimodal large language models' strong performance on modern document OCR, their application to historical Chinese texts suffers from severe hallucinations, character fabrication, uncontrolled repetition, and semantic drift.
Approach: They propose a multimodal large language model which restores visual grounding through three synergistic strategies: Layout Injection, First-Occurrence Boost, Self-Distilled Attention Focusing and HisDoc-OCR.
Outcome: The proposed model outperforms general-purpose and OCR-specific models on Chinese historical documents.
MultiConIR: Towards Multi-Condition Information Retrieval (2025.findings-emnlp)

Copied to clipboard

Challenge: MultiConIR is a benchmark designed to evaluate retrieval and reranking models under nuanced multi-condition query scenarios.
Approach: They propose a benchmark to evaluate retrieval and reranking models under nuanced multi-condition query scenarios.
Outcome: The proposed benchmark evaluates retrieval and reranking models under nuanced multi-condition query scenarios across five domains.
Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong Information (2024.findings-emnlp)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) is a key technique for enhancing the performance of Large Language Models.
Approach: They propose a framework that optimizes outputs by utilizing wrong information and multi-perspective verification.
Outcome: The proposed framework surpasses all baselines on 8 datasets and 5 LLMs.
Neural Graph Matching Networks for Chinese Short Text Matching (2020.acl-main)

Copied to clipboard

Challenge: Chinese word segmentation can be erroneous, ambiguous or inconsistent, causing performance problems.
Approach: They propose a sentence matching framework that uses paired word lattices as input instead of a character sequence.
Outcome: The proposed framework outperforms the state-of-the-art short text matching models on two Chinese datasets.
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to extract event records from text decompose complex structure prediction task into multiple subtasks.
Approach: They propose a sequence-to-structure generation paradigm that can extract events from text . they propose unified event extraction, constrained decoding algorithm and curriculum learning algorithm .
Outcome: The proposed method can achieve competitive performance using record-level annotations in both supervised learning and transfer learning settings.
Web Sitemap Knowledge Can Enhance Autonomous Browsing (2026.findings-acl)

Copied to clipboard

Challenge: Existing web agents suffer from limited robustness, efficiency and task success due to lack of structural understanding of websites and lack of browsing priors in pre-trained models.
Approach: They propose an agent-oriented sitemap protocol that integrates structured website knowledge into web agents.
Outcome: The proposed agent-oriented sitemap improves robustness, efficiency and effectiveness without extra training.
Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization? (2024.emnlp-main)

Copied to clipboard

Challenge: Text summarization is a key natural language generation task, but the high cost of inaccurate summaries raises concerns about the reliability of uncertainty estimation on text summarisation (UE-TS) evaluation methods.
Approach: They propose a UE-TS benchmark that evaluates the uncertainty estimation capabilities of two large language models and one pre-trained language model on three datasets.
Outcome: The proposed benchmark evaluates the uncertainty estimation capabilities of two large language models and one pre-trained language model on three datasets, with human-annotation analysis incorporated where applicable.
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)

Copied to clipboard

Challenge: Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B.
Approach: They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation.
Outcome: The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model.
STRUX: An LLM for Decision-Making with Structured Explanations (2025.naacl-short)

Copied to clipboard

Challenge: a new LLM decision-making framework is designed to help users understand how and why decisions are made.
Approach: They introduce a new LLM decision-making framework called STRUX that provides structured explanations for LLM decisions.
Outcome: The proposed framework improves decision-making by providing structured explanations . it has been evaluated on the task of forecasting stock investment decisions based on earnings call transcripts - superior performance against strong baselines compared with previous frameworks based upon earnings call transcriptions demonstrating superior performance .
InternalInspector I2: Robust Confidence Estimation in LLMs through Internal States (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) often struggle with generating reliable outputs, often producing high-confidence inaccuracies known as hallucinations.
Approach: They propose a framework that leverages contrastive learning on internal states including attention states, feed-forward states, and activation states of all layers to enhance confidence estimation in LLMs.
Outcome: The framework outperforms existing methods in the hallucination detection benchmark HaluEval and the previous methods at the same time.
Tab-CoT: Zero-shot Tabular Chain of Thought (2023.findings-acl)

Copied to clipboard

Challenge: Recent efforts to encourage more structured reasoning procedures to be captured have shown that chain-of-though (CoT) prompting methods can be effective in NLP tasks.
Approach: They propose a tabular-format CoT prompting method that allows the complex reasoning process to be explicitly modeled in a highly structured manner.
Outcome: The proposed method shows impressive performance improvements on a range of reasoning tasks.
Narrative Order Aware Story Generation via Bidirectional Pretraining Model with Optimal Transport Reward (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing storytelling systems suffer from insufficient understanding of event correlations and inadequate awareness of event temporal order.
Approach: They propose a narrative order aware framework to generate coherent stories with flashbacks . they propose 'bidirectional pretraining model with Optimal Transport Reward' to improve quality .
Outcome: The proposed framework generates coherent stories with flashbacks with a novel optimal transport reward.
Rethinking the Reversal Curse of LLMs: a Prescription from Human Knowledge Reversal (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models (LLMs) are limited by their aggressive sample permutation and lack a detailed understanding of the underlying reasons for the reversal curse.
Approach: They propose a method which enhances bidirectional entity correlation modeling and pairwise relationship reasoning to overcome the reversal curse.
Outcome: The proposed method overcomes the reversal curse by augmenting the samples with entity order-reversals and semantically preserved question-answer pairs.
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models.
Approach: This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy .
Outcome: The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications.
Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have evaluated and shown limitations in specific capabilities such as visual understanding, but a systematic evaluation of VLMs’ fundamental WM abilities remains absent.
Approach: They propose a framework that assesses perception and prediction to provide an atomic evaluation of VLMs as WMs.
Outcome: The proposed framework assesses perception and prediction abilities on 15 latest VLMs and compares them to human-level models.
Parrot: A Training Pipeline Enhances Both Program CoT and Natural Language CoT for Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing work focuses on enabling models to generate natural language chain-of-thought rationales or leverage executable and verifiable code, such as Python.
Approach: They propose a novel training pipeline that integrates sequential P-CoT and N-Co T generation and a subtask hybrid training strategy to facilitate natural language transferability.
Outcome: The proposed training pipeline improves both N-CoT and P-Co T performance over the RL baseline.
H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving (2026.findings-acl)

Copied to clipboard

Challenge: Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime .
Approach: They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM .
Outcome: Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets .
From Discourse to Narrative: Knowledge Projection for Event Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing event-centric knowledge graphs rely on explicit connectives to extract relations between events.
Approach: They propose a knowledge projection paradigm for event relation extraction using commonalities between events.
Outcome: The proposed method achieves state-of-the-art performance and extrinsic results verify the extracted event relations.
TabDSR: Decompose, Sanitize, and Reason for Complex Numerical Reasoning in Tabular Data (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models often underperform due to complex queries, noisy data, and limited numerical capabilities.
Approach: They propose a framework that integrates seamlessly with mainstream LLMs to improve tabular reasoning.
Outcome: The proposed framework outperforms existing methods in state-of-the-art analysis.
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)

Copied to clipboard

Challenge: Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice.
Approach: They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation.
Outcome: The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts.
PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on Large Language Models (LLMs) have failed to evaluate their performance in event reasoning with a single event relational type or reasoning format.
Approach: They propose a benchmark to evaluate LLMs' event reasoning capability using a single event relational type or reasoning format.
Outcome: The proposed model improves on 10K diverse instruction-tuning demonstrations to alleviate event reasoning-oriented data scarcity.
PubMedQA: A Dataset for Biomedical Research Question Answering (D19-1)

Copied to clipboard

Challenge: PubMedQA is a biomedical question answering dataset based on PubMed abstracts . 68.1% accuracy is achieved, compared to single human performance of 78.0% .
Approach: They propose a biomedical question answering dataset from PubMed abstracts . the dataset is annotated by experts and has 1k instances of QA .
Outcome: The proposed model achieves 68.1% accuracy compared to human performance of 78.0% and majority-baseline of 55.2%.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations