Challenge: generative tasks require a high degree of exploratory capacity, but zeroth-order methods suffer from slow convergence . generative task-specific methods tend to converge toward local minima, causing noise and inefficient estimation .
Approach: They propose a framework that synergizes FO precision with exploratory capability of ZO estimation.
Outcome: The proposed framework synergizes precision of FO gradients with exploratory capability of ZO estimation.

Similar Papers

Global Adaptive Momentum Meets Local Personalized Perturbation: Efficient Federated LLM Fine-Tuning with Zeroth-Order Gradients (2026.acl-long)

Copied to clipboard

Challenge: federated fine-tuning of large language models provides privacy-preserving approach to deploying pervasive generative AI services.
Approach: They propose a federated framework for fine-tuning large language models . they propose unified optimization and local personalized perturbation for ZO gradients .
Outcome: The proposed framework outperforms existing methods for integrating ZO gradients in federated learning over diverse heterogeneous data settings.
MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional capabilities across diverse tasks, but their fine-tuning requires significant memory, posing challenges for resource-constrained environments.
Approach: They propose a ZO-based framework that eliminates the need for backpropagation and provides a memory-efficient alternative to backprograming.
Outcome: The proposed framework surpasses first-order methods in performance and accuracy.
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in memory-efficient zeroth-order methods have limited their widespread adoption due to performance drops and a high risk of divergence.
Approach: They propose a memory-efficient zeroth-order framework to improve performance and convergence of the MeZO methods by using only forward passes.
Outcome: The proposed framework improves performance and convergence of the proposed methods on Roberta-Large and Llama-2-7B models.
MUZO: Leveraging Multiple Queries and Momentum for Zeroth-Order Fine-Tuning of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning large language models incur memory overhead due to the need for activation storage for back-propagation (BP).
Approach: They propose a method that estimates gradients through finite differences without activation storage for back-propagation.
Outcome: The proposed method demonstrates superior performance in fine-tuning various LLMs.
QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are quantized to lower precision to reduce memory cost and latency in inference.
Approach: They propose a quantized zeroth-order framework for fine-tuning Large Language Models (LLMs) using low-precision forward passes.
Outcome: The proposed method achieves comparable results to first-order methods in FP8 and superior accuracy in INT8 and INT4 training.
Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models are slow and lack of performance.
Approach: They propose a Zeroth-Order optimization framework that uses forward passes to fine-tune Large Language Models.
Outcome: The proposed framework achieves 1.7 to 3.0 wall-clock acceleration on LLaMA and OPT models.
MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are currently pre-trained and fine-tuned on large cloud servers . fine-timing on resource-constrained edge devices presents significant memory and computational demands .
Approach: They propose a resource-efficient fine-tuning framework for LLMs specifically designed for edge devices.
Outcome: Experiments show that MobiZO achieves substantial runtime speedups and memory savings while improving fine-tuning accuracy.
Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Prompt optimization is an important technique for adapting Large Language Models (LLMs) to specific tasks.
Approach: They propose a zeroth-order approach which enables efficient prompt tuning solely via inference APIs.
Outcome: The proposed approach outperforms existing black-box prompt tuning methods in terms of performance and convergence speed.
XAutoLM: Efficient Fine-Tuning of Language Models via Meta-Learning and AutoML (2025.emnlp-main)

Copied to clipboard

Challenge: XAutoLM is a meta-learning-augmented framework that can be used to optimize discriminative and generative LM fine-tuning pipelines.
Approach: They propose a meta-learning-augmented AutoML framework that reuses past experiences to optimize discriminative and generative LM fine-tuning pipelines efficiently.
Outcome: XAutoLM surpasses zero-shot optimizer’s peak F1 on five of six tasks, reduces mean evaluation time of pipelines by up to 4.5x, and uncovers 50% more pipelines above zero- shot Pareto front.
RoZO: Geometry-Aware Zeroth-Order Fine-Tuning on Low-Rank Adapters for Black-Box Large Language Models (2026.eacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional performance across a wide range of tasks, yet fine-tuning them efficiently under black-box or memory-constrained settings remains challenging.
Approach: They propose a Riemannian zeroth-order optimization framework that constrains updates to the tangent space of the LoRA manifold.
Outcome: The proposed framework achieves more stable convergence, tighter variance bounds, and superior performance compared to existing ZO methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations