Papers by Jiaming Liu

27 papers
ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction (2026.findings-acl)

Copied to clipboard

Challenge: ProUIE improves universal information extraction (UIE) without external information . many LLM-based methods rely on extra schema cues, external resources or complex alignment and verification pipelines .
Approach: They propose a Macro-to-Micro progressive learning approach that improves UIE without external information.
Outcome: ProUIE outperforms instruction-tuned baselines on average for NER and RE while using a smaller backbone.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Learning from Mistakes: Iterative Prompt Relabeling for Text-to-Image Diffusion Model Training (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in diffusion models have shown impressive performance in many domains, but their ability to follow instructions is still unsatisfactory.
Approach: They propose an algorithm that aligns images to text through iterative image sampling and prompt relabeling with feedback.
Outcome: The proposed algorithm improves on the spatial relation VISOR benchmark by 15.22% compared to previous methods.
PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for hallucination evaluation rely on mixed queries and posterior evaluation, which quantifies hallucinosity severity but offers limited insight into where and why they occur.
Approach: They propose a controlled benchmark that disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors.
Outcome: The proposed model disentangles hallucinations into four dimensions: knowledge missing, knowledge errors, reasoning errors, and instruction-following errors.
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)

Copied to clipboard

Challenge: Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0.
Approach: They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes.
Outcome: The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation.
SafeMCP: Proactive Power Regulation for LLM Agent Defense via Environment-Grounded Look-Ahead Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are expanding their action spaces to operate in complex environments.
Approach: They propose a server-side defense plugin that constrains tool acquisition via predictive reasoning regarding future safety risks.
Outcome: Experiments on PowerSeeking Bench, ToolEmu, and AgentHarm show that SafeMCP achieves a safe equilibrium, effectively mitigating risks while preserving agent utility.
Improving the Robustness of Summarization Models by Detecting and Removing Input Noise (2023.findings-emnlp)

Copied to clipboard

Challenge: Abstractive summarization models are typically evaluated using test data that is identically distributed as training data.
Approach: They propose a method to detect and remove input noise from documents to be summarized without extra training or auxiliary models.
Outcome: The proposed method recovers a large fraction of the loss in performance, sometimes as large as 11 ROUGE-1 points, without extra training, auxiliary models, or prior knowledge of the type of noise.
Predicting Text Preference Via Structured Comparative Reasoning (2024.acl-long)

Copied to clipboard

Challenge: Existing approaches to comparative reasoning rely on pretraining or fine-tuning models at the cost of massive human annotation and computation.
Approach: They propose a model that prompts LLMs to generate structured intermediate comparisons by proposing aspects for comparison, followed by generating textual comparisons under each aspect.
Outcome: The proposed model significantly reduces hallucination and improves consistency across various NLP tasks.
DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) large audio language models are expensive in data and computation . prior work shows diffusion-based LALMs can improve audio understanding under matched settings .
Approach: They propose a diffusion-based LALM that upgrades the speech encoder and employs dual semantic and acoustic adapters.
Outcome: a new model improves over existing autoregressive large language models and is competitive to strong AR models . the proposed model can make use of limited training data and improve inference efficiency . a recent study shows that diffusion-based models can improve audio understanding .
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach: They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome: The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .
Multilingual Fine-Grained News Headline Hallucination Detection (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing models to generate news headlines often suffer from the "hallucination" problem, where the produced headline does not fully align with the source article's content.
Approach: They propose to use a multilingual, fine-grained dataset to detect news headlines in 5 languages using supervised fine-tuning techniques and coarse-to-fine prompting to boost the few-shot detection performance.
Outcome: The proposed methods boost the few-shot hallucination detection performance in terms of the example-F1 metric.
LiPO: Listwise Preference Optimization through Learning-to-Rank (2025.naacl-long)

Copied to clipboard

Challenge: Recent work on language models with curated feedback provides promising alternatives to RLHF . multiple responses can be ranked by reward models or AI feedback, but there is no study on directly fitting upon a list of responses.
Approach: They propose a method that aligns language models with curated human feedback . they propose SLiC and DPO as promising alternatives to traditional RLHF .
Outcome: The proposed method outperforms DPO and SLiC on several preference alignment tasks with curated and real rankwise preference data.
Ex3: Automatic Novel Writing by Extracting, Excelsior and Expanding (2024.acl-long)

Copied to clipboard

Challenge: Generating long-term texts using artificial intelligence has always been a challenge . however, the generated novels exhibit poor logical coherence and appeal in their plots and deficiencies in character and event depiction, ultimately compromising the overall narrative quality.
Approach: They propose a method for extracting excelsior and expanding from novel data to generate arbitrarily long novels using large language models.
Outcome: The proposed method produces high-quality long-form novels with a high level of logical coherence and appeal despite the use of large language models.
DEGAP: Dual Event-Guided Adaptive Prefixes for Templated-Based Event Argument Extraction with Slot Querying (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in event argument extraction (EAE) involve incorporating useful auxiliary information into models during training and inference.
Approach: They propose a method that uses two prefixes to learn from different events and templates.
Outcome: The proposed method achieves state-of-the-art performance on four datasets . it can leverage possible connections between different events and capture relevant information from the prefix .
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs (2024.findings-acl)

Copied to clipboard

Challenge: Knowledge distillation (KD) is a technique for transferring expertise from large teacher models to compact student models with reduced memory footprints and inference costs.
Approach: They propose to transfer knowledge from large teacher models to compact student models by exploiting teacher-student capacity discrepancies to generate pseudo-preference pairs where teacher outputs are preferred over student outputs.
Outcome: The proposed framework exploits teacher-student capacity discrepancy to generate pseudo-preference pairs where teacher outputs are preferred over student outputs.
Training ELECTRA Augmented with Multi-word Selection (2021.findings-acl)

Copied to clipboard

Challenge: Existing pre-training methods for NLP tasks require massive computation resources.
Approach: They propose a method that trains a discriminator to detect replaced tokens and select original tokens from candidate sets.
Outcome: The proposed method improves ELECTRA based on multi-task learning on GLUE and SQUAD datasets.
STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for storytelling lack coherence and consistency, compromising the overall storytelling experience.
Approach: They propose a novel approach that improves the coherence and consistency of automatically generated stories by managing plot nodes and enabling dynamic interactions between different parts of the story.
Outcome: The proposed approach outperforms existing methods in 84.33% of the trials.
MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for AI math tutoring largely overlook these skills.
Approach: They evaluate 12 leading multimodal large language models and find clear performance gaps between them.
Outcome: The proposed benchmarks show that they can solve 770 problems and provide diagnostics and guidance to students step by step.
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to rank documents using large language models do not understand these challenging ranking formulations.
Approach: They propose to use Pairwise Ranking Prompting to improve ranking performance . they propose to outperform fine-tuned baseline rankers on benchmark datasets .
Outcome: The proposed technique outperforms supervised baselines on benchmark datasets and outperformed other LLM-based solutions by over 10% on average.
Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models struggle to meet user’s needs when required to generate responses of a specific length due to their inherent difficulty in accurately perceiving numerical constraints.
Approach: They propose a Target Length Generation Task and propose RULER, a model-agnostic approach that controls generated length for large language models.
Outcome: The proposed model-agnostic approach improves instruction-following ability of large language models under length-constrained instructions and can generate appropriate MLT when length constraints are not explicitly provided.
Language Models Resist Alignment: Evidence From Data Compression (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) may exhibit undesirable behaviors due to the inevitable biases and harmful content present in training.
Approach: They propose to investigate the elasticity of large language models by examining their performance.
Outcome: The proposed model performance declines rapidly before reverting to the pre-training distribution, the authors show . the proposed model weight and code are available at pku-lm-res ist-alignment.github.io.
Hyperion: Private Token Sampling with Homomorphic Encryption (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) enable an extraordinary range of applications, yet their adoption is limited by a fundamental concern: users must send sensitive data to remote model providers.
Approach: They propose an efficient homomorphic encryption algorithm for inverse transform sampling that allows private token sampling under HE.
Outcome: The proposed method samples tokens in 0.14 seconds on GPU, achieving a 100 latency improvement over prior work.
Benchmarking Multi-National Value Alignment for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on large language models focus on ethical reviews, failing to capture the diversity of national values.
Approach: They propose a national value extraction pipeline to efficiently construct value assessment datasets and a model-based model with instruction tagging to process raw data sources.
Outcome: The proposed benchmark evaluates the alignment of LLMs with the values of five major nations: China, the United States, the UK, France, and Germany.
Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent years have witnessed significant advancements in large language models (LLMs) but still struggle with integrating vision and audio.
Approach: They propose a self-knowledge distillation method to improve vision-audio capabilities of OLLMs by learning from the vision-text components.
Outcome: The proposed method improves vision-audio capabilities of OLLMs by learning from vision-text components, which improves interaction between audio and images and results in improved performance on multimodal tasks.
Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in natural language processing (NLP) have witnessed the remarkable capabilities of Large Language Models (LLMs).
Approach: They propose an Explanation-Aware Soft Ensemble framework to empower in-context learning with Large language models.
Outcome: The proposed framework can be used to enhance in-context learning on seven natural language understanding tasks and four varying-size LLMs.
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain.
Approach: They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators.
Outcome: The proposed model performs better than state-of-the-art models, highlighting its challenging nature.
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating the perceptual quality of synthetic speech are limited due to the complexity of perceptual quality factors and the diversity of speech generation tasks.
Approach: They propose a new paradigm for enabling large language models to conduct structured speech quality evaluation using a large-scale dataset.
Outcome: The proposed model performs well across tasks and languages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations