Imposter: Text and Frequency Guidance for Subject Driven Action Personalization using Diffusion Models (2025.coling-main)
Copied to clipboard
| Challenge: | ImPoster is a novel algorithm for generating a target image of a ‘source’ subject performing a 'driving' action. |
| Approach: | They propose an unsupervised approach that generates a target image of a ‘source’ subject performing a driving action from a single pair of inputs along with the text descriptions of the two images. |
| Outcome: | The proposed algorithm is completely unsupervised and does not require access to additional annotations like keypoints or pose. |
Similar Papers
VideoEraser: Concept Erasure in Text-to-Video Diffusion Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that VideoEraser outperforms prior methods regarding efficacy, integrity, fidelity, robustness, and generalizability. |
| Approach: | They propose a training-free framework that prevents T2V diffusion models from generating videos with undesirable concepts even when explicitly prompted with those concepts. |
| Outcome: | The proposed framework outperforms existing methods in erasure, celebrity erasion, and explicit content erasing tasks. |
Empowering Diffusion Models on the Embedding Space for Text Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent work adapts diffusion models to textual data by diffusing on the embedding space. |
| Approach: | They propose an embedding diffusion model based on Transformer to solve the problem of embeddable space and denoising model. |
| Outcome: | The proposed model is more efficient than previous methods on seminal text generation tasks and is superior to existing models. |
Principled Self-Correction in Discrete Diffusion: A UCB-Guided Framework for Text Generation (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing diffusion models are trained on corrupted ground-truth tokens, but at inference time they must denoise inputs corruptes from their own predictions. |
| Approach: | They propose a framework that denoises inputs corrupted from their own predictions at inference time. |
| Outcome: | The proposed framework achieves higher faithfulness and coherence over existing diffusion baselines. |
From Competition to Synergy: Unlocking Reinforcement Learning for Subject-Driven Image Generation (2026.acl-long)
Copied to clipboard
| Challenge: | a naive application of GRPO leads to conflicting gradient signals and a misalignment with the temporal dynamics of the diffusion process. |
| Approach: | They propose a framework that uses synergy-aware reward shaping to penalize conflicted reward signals and amplify synergies to provide a sharper and decisive gradient. |
| Outcome: | The proposed framework outperforms naive GRPO and Time-Aware Dynamic Weighting (TDW) on DreamBench, and achieves a state-of-the-art balance between ID preservation and prompt adherence. |
Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmark (2025.acl-long)
Copied to clipboard
| Challenge: | Existing MLLMs rely on commercial models such as GPT-4o for evaluations, but they are not universally accessible. |
| Approach: | They propose a task decomposition evaluation framework based on GPT-4o to automatically construct a specialized training dataset to break down the multifaceted evaluation process into simpler sub-tasks. |
| Outcome: | The proposed framework outperforms the current state-of-the-art GPT-4o evaluation framework with over 4.6% improvement in Spearman and Kendall correlations with human judgments. |
Minimal, Local, and Robust: Embedding-Only Edits for Implicit Bias in T2I Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | EmbEdit is a text-to-image editing method that only fine-tunes the word token embedding (WTE) of the target object. |
| Approach: | They propose a method to edit implicit assumptions and priors in text-to-image models without affecting unrelated objects or degrading overall performance. |
| Outcome: | The proposed method outperforms previous methods in various models, tasks, and editing scenarios. |
RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation (2025.findings-emnlp)
Copied to clipboard
Aviv Slobodkin, Hagai Taitelbaum, Yonatan Bitton, Brian Gordon, Michal Sokolik, Nitzan Bitton Guetta, Almog Gueta, Royi Rassin, Dani Lischinski, Idan Szpektor
| Challenge: | Existing methods assess only one aspect of the task, misalign with human judgments or rely on costly API-based evaluation. |
| Approach: | RefVNLI evaluates textual alignment and subject preservation in a single run. |
| Outcome: | RefVNLI outperforms or matches existing baselines across multiple benchmarks and subject categories. |
ReFACT: Updating Text-to-Image Models by Editing the Text Encoder (2024.naacl-long)
Copied to clipboard
| Challenge: | Text-to-image generative models encode factual associations that can quickly become outdated, diminishing their utility for end-users. |
| Approach: | They propose a method for editing factual associations in text-to-image models without retraining or explicit input from end-users. |
| Outcome: | The proposed method improves generalization and preservation of unrelated concepts on an existing dataset and compares with other methods. |
RecGPT: Generative Pre-training for Text-based Recommendation (2024.acl-short)
Copied to clipboard
| Challenge: | Existing models for text-based recommendation lack data sparsity and flexibility to capture fluctuations in user preferences over time. |
| Approach: | They present the first domain-adapted and fully-trained large language model for text-based recommendation. |
| Outcome: | The proposed model outperforms baseline models on rating prediction and sequential recommendation tasks. |
LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for inference are expensive and lack spatial redundancy . Discrete Diffusion Language Models are a promising paradigm for multimodal generation . |
| Approach: | They propose a locality-aware dynamic rescue method that exploits spatial Markov property of images. |
| Outcome: | The proposed method achieves an approximate 4 speedup over baselines on four text-to-image generation benchmarks. |