Challenge: achieving precise control over generated content and maintaining semantic consistency remain significant limitations, particularly concerning grounding techniques and the necessity for model fine-tuning.
Approach: They propose an off-the-shelf approach that integrates Large Language Models with Bayesian Optimization to facilitate precise and user-friendly image editing.
Outcome: The proposed approach outperforms existing methods in editing accuracy and semantic preservation, as validated using different LLMs including Claude3 and GPT-4.

Similar Papers

Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modifications (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that large language models can perform precise text editing tasks.
Approach: InstrEditBench is a benchmark dataset that compares 30,000 structured editing tasks . experimental evaluations show FineEdit outperforms state-of-the-art models .
Outcome: The proposed model outperforms state-of-the-art models on single-turn edits and mistral-7B-OpenOrca on direct edits.
Knowledge Editing for Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: Large Language Models (LLMs) are not immune to issues of factual accuracy or logically consistent.
Approach: This tutorial will present cutting-edge methods and practical tools for editing Large Language Models (LLMs).
Outcome: The aim of this course is to familiarize researchers with the latest advancements and emerging strategies in the realm of knowledge editing for LLMs.
Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approach (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt.
Approach: They propose to refine a Large Language Model (LLM) with prompt-output pairs with equivalent semantics to achieve semantic consistency.
Outcome: The proposed method improves the semantic consistency and task performance of LLMs.
Improving Cross-Domain Low-Resource Text Generation through LLM Post-Editing: A Programmer-Interpreter Approach (2024.findings-eacl)

Copied to clipboard

Challenge: Large pre-trained language models such as GPT-3.5 and GPT-4 have gained significant attention in natural language research due to limited computational resources or inaccessible parameters.
Approach: They propose a neural programmer-interpreter approach that preserves the domain generalization ability of LLMs while editing their output.
Outcome: The proposed framework significantly improves GPT-3.5’s performance in logical form-to-text conversion and low-resource machine translation, surpassing other state-of-the-art (SOTA) LLM post-editing methods in cross-domain settings.
Intention-Adaptive LLM Fine-Tuning for Text Revision Generation (2026.findings-eacl)

Copied to clipboard

Challenge: Existing work on large language models (LLMs) has demonstrated impressive capabilities in context-based text generation tasks, such as summarization and reasoning.
Approach: They propose an intention-adaptive layer-wise LLM fine-tuning framework that dynamically selects a subset of LLM layers to learn intentions and transfers them to revision generation.
Outcome: The proposed framework outperforms PEFT baselines on small revision corpora while maintaining fast convergence and accuracy.
Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing (2024.naacl-long)

Copied to clipboard

Challenge: Large language models have demonstrated considerable success in various natural language processing tasks, but their performance in NMT tasks is still underexplored.
Approach: They propose to use LLMs as automatic post-editors rather than direct translators to improve BLEU and COMET performance.
Outcome: The proposed approach improves BLEU but COMET performance compared to in-context learning.
Editing Large Language Models: Problems, Methods, and Opportunities (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in model editing for LLMs have created challenges and opportunities for the community.
Approach: They propose to alter the behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.
Outcome: The proposed method alters behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.
Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods to improve robustness require changing the fine-tuning process or large-scale data augmentation, which are infeasible or cost prohibitive for closed-source models.
Approach: They propose to prioritize more complex examples or replace existing training examples with LLM-generated data to improve performance on OOD NLI datasets.
Outcome: The proposed methods improve performance on difficult OOD datasets while training with synthetic data leads to substantial improvements on easier OOD data.
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently.
Approach: They propose a framework that processes each editing request to best align with it.
Outcome: The proposed framework achieves 9% improvement over the state-of-the-art model.
Learning to Follow Object-Centric Image Editing Instructions Faithfully (2023.findings-emnlp)

Copied to clipboard

Challenge: avrahami et al., 2022b,a): natural language instructions are often underspecified, requiring models to uncover their implicit meaning.
Approach: They propose to use paired data to model the implicit meaning of instructions . they also propose to ground the model to localize where the edit has to be performed .
Outcome: The proposed model performs better than state-of-the-art baselines on paired data, showing improvements in quality and faithfulness.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations