Papers by Pengxiang Zhao

9 papers
FISTAPruner: Layer-wise Post-training Pruning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods require inefficient retraining for billion-scale LLMs or rely on heuristicically designed metrics to determine pruning masks, leading to performance degradation.
Approach: They propose a convex optimization model that induces sparsity in large language models by leveraging FISTA.
Outcome: The proposed method can remove 50% of model parameters while retaining 98.6% and 95.6% of the zero-shot performance.
FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems (2026.findings-acl)

Copied to clipboard

Challenge: a lack of benchmarks capture real-world, cross-platform heterogeneity in GUI training . traditional methods to train GUI agents rely on centralized data collection and manual labeling .
Approach: They propose a benchmark for developing and evaluating federated GUI agents across mobile, web and desktop platforms.
Outcome: The proposed benchmarks show that cross-platform collaboration improves performance and identify platform and OS as the most influential factors.
LLM-Driven Multi-Perspective Location Completion for Next Location Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods assume that check-in data is complete, overlooking the subjective nature of user behavior, leading to inaccurate capture of user preferences.
Approach: They propose a framework that uses spatial coordinates to augment location completion by transforming geographic coordinates into text.
Outcome: The proposed framework outperforms state-of-the-art methods on three real-world datasets.
Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained language models overlook intrinsic semantic associations between soft prompt tokens, leading to high discreteness and limited interactions.
Approach: They propose a low-parameters Prompt Tuning method which leverages prompt decomposition and compressed outer product to facilitate multiple interactions among prompt tokens.
Outcome: Experiments on six architectures and eight datasets show that the proposed method outperforms state-of-the-art methods in performance and efficiency.
LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark (2026.findings-acl)

Copied to clipboard

Challenge: Mobile GUI agents show promise in automating tasks but face significant generalization challenges in long-tail scenarios.
Approach: They propose a benchmark framework for mobile GUI agents that measures the performance of GUI agents by analyzing their performance.
Outcome: The LearnGUI benchmark outperforms existing methods in offline and online evaluations and demonstrates consistent gains across model architectures.
A3: Android Agent Arena for Mobile GUI Agents with Essential-State Procedural Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation methods for mobile GUI agents rely on static frame assessments or offline static apps.
Approach: They propose an evaluation system that leverages large language models as reward models to verify task completion and process achievement.
Outcome: The proposed system addresses the limitations of traditional function based evaluation methods on online dynamic apps.
Knowledge Decoupling via Orthogonal Projection for Lifelong Editing of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing large language models (LLMs) have achieved some success, but their knowledge understanding and memory capacity significantly degrades after extensive editing.
Approach: They propose a method that stores the basis vectors of the representation space of past edits in a knowledge cache and projects the gradient of the current edit onto a space orthogonal to previous knowledge for updating.
Outcome: The proposed method improves question-answering ability and hallucination mitigation by 14% and 61% for large language models after 3,000 edits.
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored.
Approach: They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain.
Outcome: MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows.
Unleashing Low-Bit Inference on Ascend NPUs: A Comprehensive Evaluation of HiFloat Formats (2026.acl-industry)

Copied to clipboard

Challenge: Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency.
Approach: They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs.
Outcome: The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations