Papers by Ping Chen

34 papers
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
Rethinking Sentiment Style Transfer (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing evaluation methods for text style transfer are unsatisfactory.
Approach: They propose to use a graph-based method to extract attribute content from sentences . they propose an efficient regularization to leverage attribute-dependent content as guiding signals.
Outcome: The proposed method is based on a YELP and IMDB dataset and it is able to detect errors in the human evaluation.
LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks (2024.acl-long)

Copied to clipboard

Challenge: LoRA-Flow uses lightweight modules to customize large language models for downstream tasks . previous work on LoRA combination relied on task-level weights for each involved LoRA .
Approach: They propose a LoRA-Flow approach that uses dynamic weights to adjust the impact of different LoRAs.
Outcome: The proposed method outperforms baselines with task-level weights on six generative tasks.
Message Passing on Semantic-Anchor-Graphs for Fine-grained Emotion Representation Learning and Classification (2024.emnlp-main)

Copied to clipboard

Challenge: Emotion classification is an important task with applications in education, virtual reality, and robotics.
Approach: They propose to use token embeddings to generate a "semantic-anchor graph" using semantic anchors, sentences can be projected onto them to form a graph .
Outcome: Empirically, the proposed system can generate meaningful semantic anchors and discriminative graph patterns for different emotion.
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)

Copied to clipboard

Challenge: Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability.
Approach: They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs .
Outcome: The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks.
Unleashing the Reasoning Potential of LLMs by Critique Fine-Tuning on One Problem (2025.emnlp-main)

Copied to clipboard

Challenge: Critique Fine-Tuning (CFT) is a promising paradigm for unlocking the reasoning capabilities of large language models.
Approach: They propose a method that leverages critique data generated from a single math problem to improve reasoning accuracy.
Outcome: The proposed method surpasses one-shot RLVR while requiring 15 to 20 times less compute.
DNA: Denoised Neighborhood Aggregation for Fine-grained Category Discovery (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to learn compact cluster representations from coarsely labeled data are noisy and degrade the quality of learning.
Approach: They propose a framework that encodes semantic structures of data into the embedding space . they retrieve k-nearest neighbors of a query as positive keys to capture similarities .
Outcome: The proposed framework can retrieve more accurate neighbors and outperform state-of-the-art models by a large margin.
Faster In-Context Learning for LLMs via N-Gram Trie Speculative Decoding (2025.emnlp-main)

Copied to clipboard

Challenge: In-Context Learning (ICL) is a key method in prompt engineering, but its long retrieved contexts and limited token throughput will slow reasoning speeds.
Approach: They propose a method that leverages the overlap between context and model output to generate drafts from the context.
Outcome: The proposed method achieves the highest mean speedup on Vicuna-7B, Llama2-7B-Chat, and Llma3-8B-Instruct tasks.
ZoomRAG: Hierarchical Random-walk Zooming across Multi-scale Information Graphs for Fast and Accurate RAG (2026.findings-acl)

Copied to clipboard

Challenge: retrieval-augmented generation (RAG) is a powerful tool for NLP applications . but it is challenging to encode large knowledge bases as compact offline structures .
Approach: They propose a coarse-to-fine hierarchical graph inference method that uses random walks to retrieve information from a corpus of documents.
Outcome: The proposed method reduces offline indexing costs and accelerates retrieval.
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)

Copied to clipboard

Challenge: Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data.
Approach: They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs.
Outcome: The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements .
ACECODER: Acing Coder RL via Automated Test-Case Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Recent coder models have been driven by supervised fine-tuning, but the potential of reinforcement learning remains unexplored due to the lack of reliable reward data/model in the code domain.
Approach: They propose a pipeline that generates extensive test-case pairs from existing code data and constructs preference pairs based on pass rates over sampled programs.
Outcome: The proposed pipeline generates extensive (question, test-cases) pairs from existing code data and trains them with Bradley-Terry loss.
Beyond Templates: Dynamic Adaptation of Reasoning Demonstrations via Feasibility-Aware Exploration (2026.findings-acl)

Copied to clipboard

Challenge: Existing reasoning datasets that are designed for powerful LLMs often lead to degraded performance when directly applied to weaker models.
Approach: They propose a data adaptation framework that bridges the capability gap between expert reasoning trajectories and diverse SLMs by employing a selective imitation strategy guided by step-wise adaptability estimation via solution simulation.
Outcome: The proposed framework improves generalization and data efficiency over static fine-tuning and can be applied to large models with limited model capacity.
SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for agentic repository-level code understanding overlook long tail topics and rely on memorized knowledge.
Approach: They propose a repository-level agentic code understanding benchmark that uses long-tail repositories with executable environments to enforce topical balance.
Outcome: Empirically, a Qwen3-8B model trained with the proposed benchmark outperforms GPT-4o by 2.3 points.
URG: A Unified Ranking and Generation Method for Ensembling Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to rank and generate large language models have limited performance due to time-intensive nature of ranking process and lack of error propagation.
Approach: They propose a framework that jointly ranks the outputs of Large Language Models and generates fine-grained fusion results.
Outcome: The proposed framework achieves state-of-the-art (SOTA) performance on ranking and generation tasks.
Fine-grained Category Discovery under Coarse-grained supervision with Hierarchical Weighted Self-contrastive Learning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for novel category discovery focus on the scenario where known and novel categories are of the same granularity.
Approach: They propose a novel scenario for fine-grained category discovery under coarse-grain supervision that allows for adapting models to categories of different granularity from known ones.
Outcome: The proposed model can adapt models to categories of different granularity from known ones and reduce labeling cost.
Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context Extension (2026.findings-acl)

Copied to clipboard

Challenge: Existing training-free methods for extrapolating beyond training context lengths are semantics-agnostic . Existing methods that focus on relative token distances can indiscriminately blur semantically relevant and irrelevant tokens .
Approach: They propose an adaptive positional zooming method that uses semantic relevance to extrapolate beyond training context lengths.
Outcome: Experiments show that RiPRA outperforms existing training-free extrapolation methods . relevant tokens get higher positional resolution, while irrelevant tokens are compressed .
PRA-RAG: Provably Robust Aggregation in Retrieval-Augmented Generation against Retrieval Corruption (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense mechanisms lack theoretical robustness guarantees and perform unreliably when the LLM has limited knowledge of the retrieved content.
Approach: They propose a provably robust retrieval aggregation algorithm designed to defend against poisoning attacks on retrieved texts.
Outcome: Experiments show that PRA-RAG reduces the attack success rate to as low as 1% while maintaining an accuracy of 71%, significantly outperforming representative state-of-the-art (SOTA) methods.
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study (2025.coling-main)

Copied to clipboard

Challenge: Existing benchmarks focused on simplified or isolated aspects of coding, ignoring the full spectrum of programming challenges.
Approach: They propose a case study that examines the performance of large language models across the entire software development lifecycle with four programming languages, multiple domains, and carefully designed and verified metrics for each task.
Outcome: The proposed model performs across the entire software development lifecycle, including design, environment setup, implementation, acceptance testing, and unit testing.
VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search (2025.emnlp-main)

Copied to clipboard

Challenge: Existing vision-language models struggle with reasoning-focused tasks due to the lack of high-quality training data.
Approach: They propose a new approach that leverages search engines to create a multimodal multimodal dataset . they use a set of 30,000 seed images to extract HTML data from 700K unique URLs .
Outcome: The proposed model achieves the best known performance on MMMU-Pro (40.7), MathVerse (42.6), and DynaMath (55.7).
AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling (2025.findings-acl)

Copied to clipboard

Challenge: In this paper, we introduce a suite of math models that excel in solving complex math problems.
Approach: They propose a supervised fine-tuning process that achieves competitive performance across general domains, followed by targeted fine- tuning for the math domain using a carefully curated set of prompts and synthetically generated responses.
Outcome: The proposed model outperforms Qwen2.5-Math-72B-Instruct, GPT-4o and Claude-3.5 Sonnet in the math domain.
Text2World: Benchmarking Large Language Models for Symbolic World Model Generation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have encountered limitations in leveraging large language models to generate symbolic world models.
Approach: They propose a benchmarking framework based on planning domain definition language (PDDL) that employs multi-criteria, execution-based metrics for a more robust evaluation.
Outcome: The proposed model outperforms models trained with large-scale reinforcement learning, but lacks the robustness needed to perform in world modeling.
VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing instruction-tuning datasets lack execution-grounded supervision and offer limited support for iterative code correction.
Approach: They propose a large-scale instruction tuning dataset for Python-based visualization and self-correction.
Outcome: The proposed dataset outperforms strong open-source baselines and proprietary models like GPT-4o-mini.
Small Agents, Big Gains: Journey-Aware and Critic-Guided Simulation for Long-Horizon Shopping Dialogues (2026.acl-industry)

Copied to clipboard

Challenge: e-commerce assistants must support inspiration, comparison, and tool-grounded fact-checking . lack of data-coverage and verification problem hampers efficient, deployable models . eaa: "training trajectories must cover diverse user workflows with high fidelity"
Approach: They propose a system that synthesizes diverse, faithful, and policy-aligned shopping trajectories . a small model can significantly outperform same-size baselines and surpass a large-model baseline .
Outcome: The proposed model outperforms existing models and surpasses large models with 8 higher inference throughput.
BrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for deep search agents rely on blackbox web search APIs . dynamic and opaque web APIs hinder reproducibility and fair comparisons - authors .
Approach: They propose a benchmark that employs a fixed corpus for controlled retrieval for deep search agents.
Outcome: The new benchmark shows that agents that combine large language models with retrieval tools excel at complex, reasoning-intensive queries.
Lightweight LLM Agent Memory with Small Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing external memory systems for LLMs have low online overhead but are unstable in accumulating latency over long interactions.
Approach: They propose a lightweight memory system for better agent memory driven by Small Language Models . lightmem modularizes memory retrieval, writing, and long-term consolidation . they show consistent gains across model scales and high efficiency .
Outcome: The proposed system improves agent memory but has low latency and low online overhead . it separates online processing from offline consolidation to enable efficient memory invocation . the proposed system achieves an average F1 improvement of 2.5 over A-MEM on LoCoMo .
Few-Shot Text Classification with Edge-Labeling Graph Neural Network-Based Prototypical Network (2020.coling-main)

Copied to clipboard

Challenge: a few-shot text classification method is proposed to solve the few-sshot text problem . supervised learning methods require large corpus of labeled data, making them hindered in practical application.
Approach: They propose a few-shot text classification method that takes advantage of advanced pre-trained language models to extract the semantic features of each document.
Outcome: The proposed method achieves state-of-the-art on sentiment analysis and relation datasets.
HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to optimize agent performance by incorporating entire historical action-observation pairs into LLMs are redundant in long-horizon tasks.
Approach: They propose a framework that leverages subgoals as memory chunks to manage working memory of LLM-based agents hierarchically.
Outcome: The proposed framework achieves a twofold increase in success rate and reduces the average number of steps required by 3.8.
Generalized Category Discovery with Large Language Models in the Loop (2024.findings-acl)

Copied to clipboard

Challenge: Generalized Category Discovery (GCD) is a crucial task that aims to recognize both known and novel categories from a set of unlabeled data.
Approach: They propose a framework that introduces Large Language Models into the training loop to generate category names without human effort.
Outcome: The proposed framework outperforms SOTA models on three benchmark datasets and generates accurate category names for the discovered clusters.
MIRAGE: Exploring How Large Language Models Perform in Complex Social Interactive Environments (2025.acl-short)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities in environmental perception, reasoning-based decision-making, and simulating complex human behaviors, particularly in interactive role-playing contexts.
Approach: They propose a framework to assess LLMs' proficiency in portraying advanced human behaviors through murder mystery games using eight intricately crafted scripts.
Outcome: The framework evaluates LLMs' performance in portraying advanced human behaviors through murder mystery games.
A Diffusion Weighted Graph Framework for New Intent Discovery (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to learn from unlabeled data generate noisy supervisory signals . current methods only rely on semantic similarities to generate supervisory signal .
Approach: They propose a weighted DWGF framework to capture semantic similarities and structure relationships in data.
Outcome: The proposed method outperforms state-of-the-art models on evaluation metrics across multiple benchmark datasets.
RevPRAG: Revealing Poisoning Attacks in Retrieval-Augmented Generation through LLM Activation Analysis (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) enriches the input to LLMs by retrieving information from the relevant knowledge database.
Approach: They propose to use a knowledge database to enrich the input of LLMs by retrieving information from the relevant knowledge database.
Outcome: The proposed approach can achieve 98% true positive rate while maintaining a false positive rate close to 1%.
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Quantization-aware training (QAT) is a low-bit training solution that requires substantial training resources.
Approach: They propose an algorithm that reduces memory consumption by low-bit representations with minimal accuracy loss.
Outcome: EfficientQAT achieves 2-bit Llama-2-70B model on single GPU in 41 hours . compared to previous methods, it obtains model with less than 3 points accuracy degradation .
Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Deep Research Agents (DRAs) treat report generation as a single-shot writing task.
Approach: They propose an evaluation suite that establishes multi-turn report revision as a new axis.
Outcome: The evaluation suite establishes multi-turn report revision as a new axis.
Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Clarity (2025.findings-emnlp)

Copied to clipboard

Challenge: ambiguity, polysemy, or uncertainty remain significant challenges in natural language processing.
Approach: They introduce a framework that integrates LLM semantic priors with continuous fuzzy membership degrees to create an explicit interaction between probability-based reasoning and fuzzy membership reasoning.
Outcome: The proposed framework integrates semantic priors with continuous fuzzy membership degrees . it allows ambiguous inputs to be gradually transformed into clear and interpretable decisions .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations