Challenge: Several studies have explored delta parameter properties via pruning, quantization, low-rank approximation, and extrapolation, but what properties of delta parameters are essential for maintaining performance?
Approach: They propose to examine delta parameter properties along magnitude and sign . they propose to use a loss-based local surrogate analysis to examine editing effects .
Outcome: The proposed analysis shows that delta parameters can be edited while maintaining performance.

Similar Papers

Training Dynamics for Text Summarization Models (2022.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models have shown impressive results when fine-tuned on large summarization datasets.
Approach: They analyze the training dynamics for generation models, focusing on summarization . they find that a propensity to copy the input is learned early in the training process .
Outcome: The proposed model learns at different stages of fine-tuning, the authors show . they show that factual errors are learnt in later stages, but not at high-loss tokens .
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to improve inference efficiency by accelerating model fine-tuning have not been thoroughly explored.
Approach: They propose to combine parameter-efficient adaptation and model compression to accelerate model . they propose to freeze binary parameters and scale scaling factors for target tasks .
Outcome: The proposed algorithm achieves >10x compression ratio under 4-bit quantization and >1,000x reduction in trainable parameters.
Editing Large Language Models: Problems, Methods, and Opportunities (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in model editing for LLMs have created challenges and opportunities for the community.
Approach: They propose to alter the behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.
Outcome: The proposed method alters behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.
A Survey of Post-Training Scaling in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated proficiency in understanding and generating human natural languages.
Approach: They propose a framework for scaling large language models using supervised fine-tuning, RLxF and test-time compute methodologies.
Outcome: The proposed model can be used to understand and generate human natural languages.
Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Memory Editing (ME) has emerged as an efficient method to modify erroneous facts or inject new knowledge into Large Language Models (LLMs).
Approach: They propose to evaluate LLMs with single edit only and parameter-modifying ME with parameter-preserving ME.
Outcome: The proposed method can maintain LLMs’ fundamental capabilities but struggles to accurately recall edited knowledge presented in a different format.
Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to quantize large language models suffer from significant accuracy loss at low bit-widths due to high-impact parameters.
Approach: They propose a quadratic optimization framework that quantizes high-impact parameters to moderate bit-widths while quantizing low bit-wideths.
Outcome: The proposed framework preserves high-impact parameters while preserving memory usage.
Scaling Parameter-Constrained Language Models with Quality Data (2024.emnlp-industry)

Copied to clipboard

Challenge: Scaling laws in language modeling quantify training loss as a function of dataset size and model parameters, but neglect the critical role of data quality in model generalization.
Approach: They propose to use effective training tokens as a combination of text diversity and syntheticity as measured by a teacher model to calculate scaling laws.
Outcome: The proposed term effective training tokens is a combination of two readily-computed indicators of text diversity and syntheticity as measured by a teacher model.
On the Impact of Calibration Data in Post-training Quantization and Pruning (2024.acl-long)

Copied to clipboard

Challenge: Quantization and pruning are the foundations of compression for large language models . however, no prior work has investigated how calibration data impacts performance of compression methods.
Approach: They propose an empirical study on the effect of calibration data on LLM performance.
Outcome: The proposed methods improve performance in a post-training setting.
Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapse (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to reducing the effects of knowledge editing are insufficiently understood.
Approach: They propose a plug-and-play framework that preserves the dominant subspace of the original weights and analyzes parameter updates in the spectral basis of the weights.
Outcome: The proposed framework improves editing efficacy while preserving general abilities under long-horizon sequential editing, including extreme settings with up to 20,000 edits.
Is It Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Text simplification and elaboration tasks are limited to only relatively altering the readability of texts to cater to a diverse audience.
Approach: They propose to generate 8 versions of a text at different readability levels using ChatGPT and Llama-2 and introduce a two-step process to generate paraphrases.
Outcome: The proposed task requires the generation of 8 versions at various target readability levels for each input text.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations