Papers by Jiayi Li

43 papers
Rule-Guided Extraction: A Hierarchical Rule Optimization Framework for Document-Level Event Argument Extraction (2025.findings-emnlp)

Copied to clipboard

Challenge: Document-level event argument extraction (EAE) is a critical task in natural language processing.
Approach: They propose an LLM-driven HiErarchical Rule Optimization framework that iteratively generates and selects optimal hierarchical rules.
Outcome: The proposed framework outperforms few-shot supervised methods and outperformed state-of-the-art prompting baselines.
Chronos: Learning Temporal Dynamics of Reasoning Chains for Test-Time Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for testing time scales treat reasoning traces or tokens equally, ignoring substantial variations in trajectory quality and localized logical failures.
Approach: They propose a chronological reasoning scorer that models each trajectory as a time series.
Outcome: The proposed method achieves relative improvements of 34.21% over Pass@128 and 22.70% over Maj@135 on HMMT25, highlighting its effectiveness.
LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient (2026.acl-long)

Copied to clipboard

Challenge: Using generic and efficient benchmark generators, human annotators are limited by inefficiency . current benchmark generator methods rely on seed signals, leading to long cycles and high costs .
Approach: They propose a framework to evaluate LLMs as generic benchmark generators and integrate them as BenchMaker.
Outcome: The proposed framework achieves comparable performance to human-annotated benchmarks on most metrics.
OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing LLMs are limited by text-context budgets, resulting in token-expensive storage of raw trajectories . Optical Context Retrieval Memory (OCR-Memory) renders historical tra-jectorios into images annotated with unique visual identifiers.
Approach: They propose a framework that leverages the visual modality as a high-density representation of agent experience.
Outcome: Optical Context Retrieval Memory (OCRM) renders historical trajectories into images annotated with unique visual identifiers.
Warmup Generations: A Task-Agnostic Approach for Guiding Sequence-to-Sequence Learning with Unsupervised Initial State Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing supervised fine-tuning (SFT) methods focus on directly generating the target output without leveraging the benefits of intermediate steps or initial guidance.
Approach: They propose a task-agnostic framework that enables models to generate intermediate "warmup" sequences that are iteratively refined to maximize their contribution to the final output.
Outcome: The proposed framework outperforms traditional supervised fine-tuning methods on translation, summarization, and multi-choice question answering tasks.
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement (2025.naacl-long)

Copied to clipboard

Challenge: Existing large language models (LLMs) show exceptional problem-solving capabilities but struggle with complex reasoning tasks.
Approach: They propose a novel RAG approach that integrates retrieved information to guide tree-based reasoning process based on LLMs.
Outcome: The proposed approach outperforms existing methods in large language models . iteratively plans intermediate sub-queries and answers based on the LLM itself .
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature.
Approach: They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management.
Outcome: The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench.
MccSTN: Multi-Scale Contrast and Fine-Grained Feature Fusion Networks for Subject-driven Style Transfer (2024.lrec-main)

Copied to clipboard

Challenge: Stylistic style transfer is an important part of the image processing field . due to the low semantic similarity between the original image and the style image, many fine-grained style features are discarded.
Approach: They propose a new style representation and transfer framework that can be adapted to existing image style transfers.
Outcome: The proposed framework can be adapted to existing image style transfers.
CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to search for images using single-modality are limited by representation space fragmentation.
Approach: They propose a unified representation framework that achieves efficient query-target alignment . they introduce a multi-level Chain-of-Thought prompting strategy that guides MLMs to generate discriminative, semantically compatible captions for target images .
Outcome: The proposed framework achieves efficient query-target alignment through synergistic components.
Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have shown promise on understanding and reasoning over tables, but current approaches remain limited.
Approach: They propose a multi-agent framework that decomposes table reasoning into three specialized roles: planning, coding, and answering.
Outcome: The proposed framework decomposes table reasoning into three specialized roles: planning, coding, and answering.
InsBank: Evolving Instruction Subset for Ongoing Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies emphasize that quality and diversity of instruction data are more crucial than quantity, highlighting the need to select diverse, high-quality subsets to reduce training costs.
Approach: They propose to use a continuously updated repository to integrate the latest valuable instruction data with a progressive evolution framework to evolve InsBank over time.
Outcome: The proposed framework outperforms baselines in InsBank evolution and extracts budget-specific subsets.
Adversarial Yet Cooperative: Multi-Perspective Reasoning in Retrieved-Augmented Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing training paradigms rely on outcome-oriented rewards, which provide insufficient signal for shaping the complex, multi-step reasoning process.
Approach: They propose a framework that integrates large reasoning models with retrieval-augmented generation to improve reasoning fidelity and verification rigor.
Outcome: Experiments on multiple benchmarks demonstrate the effectiveness of the proposed framework.
FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression (2026.findings-eacl)

Copied to clipboard

Challenge: Low-rank decomposition methods suffer from accuracy degradation and expensive calibration procedures.
Approach: They propose a fast and accurate, training-free structural compression method based on fine-grained low-rank transformations in the activation space.
Outcome: The proposed method outperforms pruning baselines in generalization and downstream performance while delivering inference speedups.
Focus-Constrained Attention Mechanism for CVAE-based Response Generation (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing models generate high-frequency but trivial responses such as "I don't know" or "I'm ok" due to the discrepancy in discourse-level information, standard models generate one-to-many relationships.
Approach: They propose to transform coarse-grained discourse-level information into fine-grounded word-level knowledge by introducing a fine-grain focus signal and a focus-constrained attention mechanism to take full advantage of focus.
Outcome: The proposed model can generate more diverse and informative responses compared with state-of-the-art models.
StreamMeCo: Long-Term Agent Memory Compression for Efficient Streaming Video Understanding (2026.findings-acl)

Copied to clipboard

Challenge: StreamMeCo is an efficient Stream Agent Memory Compression framework for video understanding.
Approach: They propose an efficient Stream Agent Memory Compression framework that evicts redundant memory nodes and introduces a time-decay memory retrieval mechanism to mitigate performance degradation.
Outcome: The proposed framework achieves 1.87 speedup in memory retrieval while delivering an average accuracy improvement of 1.0% on three challenging benchmark datasets.
PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization (2025.naacl-long)

Copied to clipboard

Challenge: Existing approaches to optimize RAG generators fail to align with RAG requirements thoroughly.
Approach: They propose a method for optimizing the RAG generator from multiple preference perspectives to align with RAG requirements comprehensively.
Outcome: The proposed method improves the performance of RAG generators by incorporating retrieved documents into the prompt.
UCS: Estimating Unseen Coverage for Improved In-Context Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing selection methods prioritize heuristic notions of relevance or diversity and provide limited insight into the coverage of a demonstration set.
Approach: They propose a training-free, subset-level coverage prior that is unrevealed by a model-consistent embedding and a Smoothed Good-Turing estimator to estimate the number of unrevelled clusters within a candidate subset.
Outcome: Experiments on multiple intent-classification and reasoning benchmarks show that augmenting strong baselines with UCS improves ICL accuracy by 2-6% under the same selection budget.
Beyond One-Size-Fits-All: Tailored Benchmarks for Efficient Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing efficient methods estimate performance of models on large benchmarks, but these methods rely on the assumption that target models have high prediction consistency with source models.
Approach: They propose a method that conducts customized evaluation tailored to each target model.
Outcome: The proposed method reduces the MAE of estimates by 31.4% on benchmarks across 300 models.
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches (2024.findings-emnlp)

Copied to clipboard

Challenge: Long context capability is a crucial competency for large language models as it mitigates the human struggle to digest long-form texts.
Approach: They propose to evaluate 10+ state-of-the-art approaches for long context-capable LLMs.
Outcome: The proposed methods are compared against 10+ state-of-the-art approaches across seven categories of long context tasks.
“I See What You Did There”: Can Large Vision-Language Models Understand Multimodal Puns? (2026.acl-long)

Copied to clipboard

Challenge: Puns are a common form of rhetorical wordplay that exploits polysemy and phonetic similarity to create humor.
Approach: They propose a multimodal pun generation pipeline and a model to evaluate their understanding of puns.
Outcome: The proposed benchmark improves the understanding of multimodal puns by 16.5% in the F1 test.
C3KG: A Chinese Commonsense Conversation Knowledge Graph (2022.findings-acl)

Copied to clipboard

Challenge: Existing commonsense knowledge bases organize tuples in an isolated manner, causing problems for chatbots .
Approach: They create a Chinese commonsense conversation knowledge graph which integrates social commonsensm and dialog flow information.
Outcome: The proposed graph incorporates social commonsense knowledge and dialog flow information.
Recipe2Plan: Evaluating Planning Abilities of LLMs for Efficient and Feasible Multitasking with Time Constraints Between Actions (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing evaluation benchmarks focus on single task performance, ignoring multitask planning and execution efficiency.
Approach: They propose a benchmark framework based on real-world cooking scenarios . recipe2plan challenges agents to optimize cooking time through parallel task execution .
Outcome: The proposed benchmarks highlight the need for improved temporal awareness and global multitasking capabilities in large language models.
Can Third Parties Read Our Emotions? (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to infer author’s private states from written text have relied heavily on datasets annotated by third-party annotators.
Approach: They propose a framework for evaluating the limitations of third-party annotations and call for refined annotation practices to accurately represent and model authors’ private states.
Outcome: The proposed methods outperform human annotators on emotion recognition tasks.
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios (2024.findings-acl)

Copied to clipboard

Challenge: chain-of-thought (CoT) prompting has been shown to be effective on complex reasoning tasks, but the naive greedy decoding used in CoT prompting causes the repetitiveness and local optimality.
Approach: They propose a generalizable ensemble-optimization method that uses a set of reasoning paths to prompt a language model one more time to determine the optimal answer.
Outcome: The proposed method can be generalized to almost all scenarios where the type of input questions and answer format of reasoning paths may be unknown.
Automated Essay Scoring via Pairwise Contrastive Regression (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches to automate essay scoring use regression or ranking objectives . a novel neural pairwise ranking model is developed to optimize both objectives based on the same loss .
Approach: They propose a novel Neural Pairwise Contrastive Regression model that optimizes both objectives simultaneously as a single loss.
Outcome: The proposed model outperforms previous methods on the public Automated Student Assessment Prize dataset.
ImCoref-CeS: An Improved Lightweight Pipeline for Coreference Resolution with LLM-based Checker-Splitter Refinement (2026.acl-long)

Copied to clipboard

Challenge: Existing supervised neural methods for coreference resolution are underexplored . current methods rely on small language models, but their potential is underexploited .
Approach: They propose a framework that integrates an enhanced supervised model with LLM-based reasoning.
Outcome: The proposed method surpasses existing state-of-the-art methods in coreference resolution.
Teaching Neural Module Networks to Do Arithmetic (2022.coling-1)

Copied to clipboard

Challenge: Neural Module Networks (NMNs) have limited reasoning abilities and lack numerical reasoning capability.
Approach: They propose to integrate the original question in the interpreter and introduce addition and subtraction modules that perform numerical reasoning over numbers.
Outcome: The proposed methods outperform previous state-of-the-art models on a subset of DROP and achieve competitive reasoning performance.
SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing metrics for machine translation quality for under-resourced African languages suffer from limited language coverage and poor performance in low-resource settings.
Approach: They propose a large-scale human-annotated machine translation evaluation dataset . they use a reference-based and reference-free evaluation model to compare MT quality .
Outcome: The proposed models outperform AfriCOMET and the strongest LLM on low-resource languages.
Retrieved Sequence Augmentation for Protein Representation Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Using multiple sequence alignments (MSA) to extract evolutionary knowledge is limited.
Approach: They propose to use multiple sequence alignments to augment protein representations . they propose to employ Retrieved Sequence Augmentation to enhance protein representation learning .
Outcome: The proposed method surpasses MSA Transformer by 5% in structural and property prediction tasks while being 373 times faster.
LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem (2025.findings-emnlp)

Copied to clipboard

Challenge: distributing LLMs without a proven track record like ‘meta-llama‘ or ‘qwen‘ rarely gains community traction.
Approach: They propose a simple, efficient, yet specific recipe for a backdoor LoRA to be injected into task-enhancing LoRAs and examine the mechanisms of such infections.
Outcome: The proposed model allows attackers to scale the distribution of compromised LoRAs with minimal effort by leveraging the rich pool of shared LoRA assets.
The Impact of Language Mixing on Bilingual LLM Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies show multilingual speakers intentionally switch languages during reasoning . enforcing monolingual decoding reduces accuracy by 5.6 percentage points .
Approach: They find that multilingual speakers intentionally switch languages during reasoning . enforcing monolingual decoding reduces accuracy by 5.6 percentage points . authors suggest that language mixing is not merely a byproduct of multilingual training .
Outcome: The proposed model can be used to predict whether a language switch would benefit or harm reasoning.
Speculative Decoding for Multi-Sample Inference (2025.findings-emnlp)

Copied to clipboard

Challenge: Speculative decoding method exploits consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases.
Approach: They propose a speculative decoding method that exploits the consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases.
Outcome: The proposed method exploits the intrinsic consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or databases.
Express What You See: Can Multimodal LLMs Decode Visual Ciphers with Intuitive Semiosis Comprehension? (2025.findings-acl)

Copied to clipboard

Challenge: Traditional VQA benchmarks encounter a modality gap and over-reliance on language priors, whereas human cognition excels at intuitive semiosis, associating abstract visual symbols to linguistic semantics.
Approach: They propose a task of generating abstract linguistics from emoji sequence images, where such reasoning underpins critical applications in cryptography.
Outcome: The proposed model can generate abstract linguistics from emoji sequence images, challenging MLLMs’ reasoning of decoding complex semantics of visual ciphers.
PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Using large-scale annotation data, large language models can generate noise, errors and biases, leading to unexpected behaviours.
Approach: They propose a dataset to promote safety alignment in large language models . they separate helpfulness and harmlessness annotations for question-answering pairs .
Outcome: The proposed dataset provides 44.6k prompts and 265k question-answer pairs with safety meta-labels for 19 harm categories and three severity levels, with answers generated by Llama-family models.
Structure-aware Fine-tuning for Code Pre-trained Models (2024.lrec-main)

Copied to clipboard

Challenge: Existing CodePTMs are mainly structure-free and structurebased, but how to fine-tune them remains a challenge.
Approach: They propose a plug-and-play fine-tuning method that incorporates structural knowledge into pre-trained code models.
Outcome: The proposed method can benefit CodePTMs more with limited training data.
Prior Relational Schema Assists Effective Contrastive Learning for Inductive Knowledge Graph Completion (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge graphs lack robustness and incompleteness to provide link prediction.
Approach: They propose to capture prior schema-level interactions related to relations by leveraging entity type information and introduce schema-guided negatives to bolster the efficiency of normal contrastive representation learning.
Outcome: The proposed method achieves state-of-the-art performance on multiple established metrics across multiple datasets for link prediction.
From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MarkerGen (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to control text length are lacking in LCTG, posing a major limitation for practical applications.
Approach: They propose a plug-and-play approach that decomposes LCTG sub-abilities with human patterns as reference and performs detailed error analysis.
Outcome: The proposed method significantly improves LCTG across various settings, exhibiting outstanding effectiveness and generalizability.
MessToClean: Evidence-Grounded Structure-Preserving Reconstruction for Real-World Degraded Exam Paper Images (2026.acl-long)

Copied to clipboard

Challenge: Existing Multimodal Large Language Models (MLLMs) fail under RDEI, leading to disrupted structure and evidence-unsupported hallucinations.
Approach: They propose a backbone-agnostic, evidence-driven pipeline that treats off-the-shelf MLLMs as interchangeable components to improve stem consistency and figure consistency.
Outcome: The proposed pipeline improves stem consistency by 1.01-3.18%, figure consistency by 0.50-49.16%, and refusal F1 by 1.06-10.88% across question types.
Revisiting Self-Consistency from Dynamic Distributional Alignment Perspective on Answer Aggregation (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on self-consistency show that it improves reasoning abilities by aggregating diverse stochastic samples.
Approach: They propose a confidence-driven mechanism that dynamically calibrates temperature to align with high probability modes.
Outcome: The proposed method outperforms fixed-diversity baselines on reasoning tasks and improves both average and best-case performance.
Language Models Resist Alignment: Evidence From Data Compression (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) may exhibit undesirable behaviors due to the inevitable biases and harmful content present in training.
Approach: They propose to investigate the elasticity of large language models by examining their performance.
Outcome: The proposed model performance declines rapidly before reverting to the pre-training distribution, the authors show . the proposed model weight and code are available at pku-lm-res ist-alignment.github.io.
MMAPS: End-to-End Multi-Grained Multi-Modal Attribute-Aware Product Summarization (2024.lrec-main)

Copied to clipboard

Challenge: Existing product summarization methods lack end-to-end product summaries and multi-grained multi-modal modeling.
Approach: They propose an end-to-end multi-grained multi-modal attribute-aware product summarization method that jointly models product attributes and generates product summaries.
Outcome: The proposed method outperforms state-of-the-art product summarization methods on a large-scale Chinese e-commence dataset.
Weight-Inherited Distillation for Task-Agnostic BERT Compression (2024.findings-naacl)

Copied to clipboard

Challenge: Knowledge Distillation (KD) is a predominant approach for BERT compression.
Approach: They propose a weight-inherited distillation method which directly transfers knowledge from the teacher to a compact student model by inheriting the weights.
Outcome: The proposed method outperforms state-of-the-art KD-based methods on GLUE and SQUAD benchmarks.
Bold Claims or Self-Doubt? Factuality Hallucination Type Detection via Belief State (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on detecting the presence of hallucinations but lack a systematic classification approach, which hinders deeper exploration of their characteristics.
Approach: They propose a method to categorize hallucinations into two types: Overconfident and Unaware .
Outcome: The proposed method categorizes factuality hallucination into two types: Overconfident and Unaware Hallucinations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations