Papers by Zijie Liu

17 papers
Progra: Progress-Aware Reinforcement Learning for Multi-Turn Function Calling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multi-turn function calling are limited by redundancy and lack explicit integration of progress awareness into training.
Approach: They propose a framework that explicitly integrates progress awareness into LLM training for multi-turn function calling.
Outcome: Empirical results show that Progra outperforms existing methods on two public benchmarks.
From Outcome to Process: Optimizing MoE Load Balancing with MCTS (2026.findings-acl)

Copied to clipboard

Challenge: Existing balancing strategies focus on constraining the final distribution of expert usage, but overlook the routing decisions made at each layer.
Approach: They propose a three-stage framework that leverages process-level rewards to guide balanced expert routing.
Outcome: Extensive experiments show that LayerMoE improves the performance of state-of-the-art LoRA-MoA baselines, yielding an average accuracy gain of 1.39%.
Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level (2024.emnlp-main)

Copied to clipboard

Challenge: General-purpose Large Language Models (LLMs) like GPT-4 have exhibited strong translation abilities.
Approach: They propose to use a model-agnostic model to refine the performance of general-purpose large-language models for machine translation (MT) by utilizing Gemma-2B/7B as the backbone.
Outcome: The proposed model-agnostic and cost-effective tool improves the performance of general-purpose large-language models for machine translation (MT) by integrating it with any general-use LLM.
On the Consistency of Commonsense in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing evaluations of commonsense for large language models focus on downstream knowledge tasks, failing to probe whether LLMs truly understand and utilize knowledge or merely memorize it.
Approach: They propose to automatically construct a large benchmark named CoCo which measures LLMs’ knowledge memorization, comprehension, and application and examines the consistency between these tasks.
Outcome: The proposed benchmark systematically assesses LLMs’ knowledge memorization, comprehension, and application and examines the consistency between these tasks.
Acquisition and Application of Novel Knowledge in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for constructing new datasets rely on timestamps or simple templates that do not accurately reflect the real world.
Approach: They propose a knowledge dataset construction approach that simulates biological evolution using knowledge graphs to generate synthetic entities with diverse attributes.
Outcome: The proposed framework outperforms knowledge augmentation methods by 3.3%-38%.
Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks for learning Large Language Models (LLMs) require adaptive data processing and low-rank adjustment to improve accuracy and fine-tuning speed.
Approach: They propose a fisher information-based adaptive federated curriculum learning framework with two novel methods to improve FL fine-tuning process.
Outcome: The proposed framework improves performance and fine-tuning speed compared with baseline approaches.
FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data (2025.emnlp-main)

Copied to clipboard

Challenge: Mobile GUI agents have attracted tremendous research participation recently. traditional approaches to mobile agent training rely on centralized data collection.
Approach: They propose a benchmark for federated training and evaluation of mobile GUI agents . they find that federation algorithms consistently outperform local training .
Outcome: The first benchmark for federated training and evaluation of mobile GUI agents is released . it features 6 datasets with 30+ subsets, 8 federation algorithms, 10+ base models, and over 800 apps across 5 categories .
Dialogue is Better Than Monologue: Instructing Meidcal LLMs via Strategic Conversations (2026.findings-eacl)

Copied to clipboard

Challenge: Existing tuning methods for medical AI models are monologue-based . existing benchmarks are based on licensing exams or research articles .
Approach: They propose a benchmark to expose limitations of monologue-based tuning for medical AI models . they use a large dialogue dataset to capture stepwise diagnostic reasoning .
Outcome: The proposed model outperforms monologue-tuned models on a medical question answering task and improves accuracy on standard medical QA benchmarks.
Streaming Hallucination Detection in Long Chain-of-Thought Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Long chain-of-thought reasoning improves performance of large language models, yet hallucinations in such settings often emerge subtly and propagate across reasoning steps.
Approach: They propose to treat step-level hallucination judgments as local observations and introduce a cumulative prefix-level signal that tracks the global evolution of the reasoning state over the entire trajectory.
Outcome: The proposed method enables streaming hallucination detection in long CoT reasoning, providing real-time, interpretable evidence.
On the Role of Discriminative Models in Generative Relation Extraction (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction (RE) are discriminative and generative . previous studies show that discriminative models can support generative RE .
Approach: They propose a framework that leverages discriminative models to produce a top-k set of candidate relations and integrates this knowledge into generative models via in-context or prompt learning.
Outcome: The proposed framework achieves state-of-the-art on five widely used RE benchmarks.
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference (2025.findings-emnlp)

Copied to clipboard

Challenge: Key-Value (KV) cache reading latency increases with context lengths hindering LLM inference . important tokens are sparsely distributed across the long context, making existing retrieval inaccurate .
Approach: They propose a method to retain a small fraction of KV cache based on token importance . important tokens are often sparsely distributed across the long context .
Outcome: The proposed method reduces decoding latency by 1.2 to 1.5.
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Model (LLM) enabled agents lack flexibility to respond to users’ varying needs and preferences.
Approach: They propose a test-time user-preference alignment strategy that optimizes the persona prompt, ensuring real-time preference alignment through textual loss feedback between simulated and ground-truth responses.
Outcome: The proposed framework outperforms baseline methods in real-time and in real applications.
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services (2025.emnlp-industry)

Copied to clipboard

Challenge: Social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement.
Approach: They propose a domain-specific LLM to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for social networking services.
Outcome: The proposed model achieves an average improvement of 14.02% across 8 major tasks and 7.56% in bilingual evaluation benchmark, compared with baseline models.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.
Mix-of-Granularity: Optimize the Chunking Granularity for Retrieval-Augmented Generation (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented generation systems often use a fixed strategy to extract information from multiple sources.
Approach: They propose a method that dynamically determines optimal granularity of a knowledge source based on input queries using a router.
Outcome: The proposed method predicts optimal granularity levels and significantly improves performance in downstream tasks.
Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images.
Approach: They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations.
Outcome: The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images.
Unlocking Instructive In-Context Learning with Tabular Prompting for Relational Triple Extraction (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for relational triple extraction (RTE) are unnatural and recast RTE tasks to text-to-text prompting formats.
Approach: They propose a tabular prompting for RTE which frames RTE task into a table generation task and propose an instructive in-context learning which only selects and annotates samples considering triple semantics in massive unlabeled samples.
Outcome: The proposed prompting for RTE with TableIE achieves state-of-the-art performance compared to other methods . the proposed prompts are based on off-the shelf LLMs and are scalable to multiple scenarios .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations