Papers by Yiran Li

19 papers
FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting.
Approach: They propose a framework that aligns replay schedules with a model-centric notion of time.
Outcome: Experiments on three benchmarks show that FOREVER consistently mitigates catastrophic forgetting.
Beyond Surface-Level Pattern Trap: LLM Agents for Faster and Smarter Cross-Architecture Code Migration (2026.findings-acl)

Copied to clipboard

Challenge: cross-architecture code migration is a resource-intensive and errorprone task.
Approach: a framework for cross-architecture code migration is proposed to decouple implementation details through functional mining and code refactoring.
Outcome: a new framework improves performance and correctness over state-of-the-art frameworks on OpenCV migration tasks.
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed.
Approach: They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting.
Outcome: The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data.
What Works and Doesn’t Work, A Deep Decoder for Neural Machine Translation (2022.findings-acl)

Copied to clipboard

Challenge: Deep learning has demonstrated performance advantages in a wide range of natural language processing tasks.
Approach: They propose to deepen the decoder layer in a Transformer model to reduce the difficulty of deep learning.
Outcome: The proposed method can deepen the model on both the encoder and decoder at the same time, resulting in a deeper model and improved performance.
Tuna: Instruction Tuning using Feedback from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: LLms like LLaMA have shown to be cost-effective for generating better responses . however, the instruction-tuned model has only seen one response per instruction .
Approach: They propose to fine tune an instruction-tuned LLM using probabilistic ranking and contextual ranking approaches to increase the likelihood of generating better responses.
Outcome: The proposed model improves on Super Natural Instructions, LMentry and Vicuna QA.
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport (2023.acl-long)

Copied to clipboard

Challenge: Open Information Extraction (OIE) aims to extract structured information from text without the limitations of close ontology.
Approach: They propose a method to assign ground truth labels to parallelly generated tuple proposals . they leverage intersection-over-union (IoU) as assignment quality measurement .
Outcome: The proposed method outperforms the state-of-the-art models on three benchmarks.
MTG: A Benchmark Suite for Multilingual Text Generation (2022.findings-naacl)

Copied to clipboard

Challenge: Using MTG, we train and evaluate multilingual text generation models using human-annotated data.
Approach: They propose a multilingual multiway text generation dataset with 400k human-annotated data that includes four generation tasks across five languages.
Outcome: The proposed dataset includes four generation tasks across five languages (English, German, French, Spanish and Chinese) it provides comprehensive evaluations with diverse generation scenarios.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
VehicleWorld: A Highly Integrated Multi-Device Environment for Intelligent Vehicle Interaction (2025.findings-emnlp)

Copied to clipboard

Challenge: Traditional Function Calling (FC) approaches operate statelessly, requiring multiple exploratory calls to build environmental awareness before execution, leading to inefficiency and limited error recovery.
Approach: They propose a state-based function call approach that maintains explicit system state awareness and implements direct state transitions to achieve target conditions.
Outcome: The proposed approach outperforms traditional function calling approaches, achieving superior execution accuracy and reduced latency.
ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Tasks (2025.emnlp-main)

Copied to clipboard

Challenge: Multi-agent systems (MAS) are limited by poor flexibility and scalability, with underdeveloped optimization strategies.
Approach: They propose a task graph generation and a reward-driven two-stage agent selection process to integrate multi-agent systems to improve their reasoning capabilities.
Outcome: The proposed model outperforms existing methods on Math-MAS and SciBench-MAS SciBech, while other methods completely fail.
The Devil in Linear Transformer (2022.emnlp-main)

Copied to clipboard

Challenge: Existing linear transformers suffer from performance degradations on various tasks and corpus.
Approach: They propose a new linear attention that replaces scaling with a normalization to stabilize gradients and confine attention to neighbouring tokens in early layers.
Outcome: The proposed model outperforms vanilla transformers on the long-range arena benchmark while being significantly more space-time efficient.
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)

Copied to clipboard

Challenge: Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making.
Approach: They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain.
Outcome: The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge.
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs.
Approach: They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods.
Outcome: The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains.
AutoFigure-Edit: Generating Editable Scientific Illustrations via Reference-Guided Styling (2026.acl-demo)

Copied to clipboard

Challenge: Existing automated systems for scientific illustrations are limited in editability, stylistic controllability, and efficiency.
Approach: They propose an end-to-end system that generates fully editable scientific illustrations from long-form scientific text while enabling flexible style adaptation through user-provided reference images.
Outcome: The proposed system generates fully editable scientific illustrations from long-form scientific texts while enabling flexible style adaptation through user-provided reference images.
Scaling Laws for Linear Complexity Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing scaling laws for large language models are unclear, but they are useful for scalability.
Approach: They propose scaling laws for linear complexity language models to establish a foundation for their scalability.
Outcome: The proposed models demonstrate superior linguistic proficiency and knowledge retention.
Separately Parameterizing Singleton Detection Improves End-to-end Neural Coreference Resolution (2024.naacl-short)

Copied to clipboard

Challenge: Current end-to-end coreference resolution models combine detection of singleton mentions and antecedent linking into a single step.
Approach: They add a singleton detector to a coarse-to-fine coreference model and design an anaphoricity-aware span embedding and singletont detection loss.
Outcome: The proposed method significantly improves model performance on OntoNotes and four additional datasets.
TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on single-turn or single-step tasks, failing to capture iterative reasoning in real-world settings.
Approach: They propose a benchmark that evaluates multi-turn, multi-step reasoning through an interactive code-breaking task inspired by the "Turing Machine Board Game" the best model achieves 84% accuracy in Classic mode, but performance drops to 18% in Nightmare mode.
Outcome: The new benchmark evaluates multi-turn, multi-step reasoning through an interactive code-breaking task inspired by the "Turing Machine Board Game" the best model achieves 84% accuracy in Classic mode, but performance drops to 18% in Nightmare mode.
Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to address the "lost-in-the-middle" problem suffer from high latency or suboptimal hand-crafted scaling strategies.
Approach: They propose a layer-specific positional embedding scaling method that assigns distinct scaling factors to each layer.
Outcome: Experiments show that the proposed method mitigates positional attention bias and delivers consistent improvements across multiple long-context benchmarks.
Language-specific Effects on Automatic Speech Recognition Errors for World Englishes (2022.coling-1)

Copied to clipboard

Challenge: Existing systems are not able to meet the needs of speakers of different demographic groups.
Approach: They propose to analyze the performance of Otter’s automatic captioning system on native and non-native English speakers of different language background through a linguistic analysis of segment-level errors.
Outcome: The proposed system predicts certain errors from the phonological structure of a speaker’s native language.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations