Papers by Jinghan Yu
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)
Copied to clipboard
Jinghan Yu, Junhao Xiao, Chenyu Zhu, Jiaming Li, Jia Li, HanMing Deng, Xirui Wang, Guoli Jia, Jianjun Li, Xiang Bai, Bowen Zhou, Zhiyuan Ma
| Challenge: | Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process . |
| Approach: | They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment. |
| Outcome: | The proposed paradigm outperforms existing methods in compositional editing tasks. |
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)
Copied to clipboard
Yiming Zeng, Jinghan Cao, Zexin Li, Wanhao Yu, Zhankai Ye, Dawei Xiang, Ting Hua, Xin Liu, Shangqian Gao, Tingting Yu
| Challenge: | Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently. |
| Approach: | They propose a framework that processes each editing request to best align with it. |
| Outcome: | The proposed framework achieves 9% improvement over the state-of-the-art model. |
Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modifications (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that large language models can perform precise text editing tasks. |
| Approach: | InstrEditBench is a benchmark dataset that compares 30,000 structured editing tasks . experimental evaluations show FineEdit outperforms state-of-the-art models . |
| Outcome: | The proposed model outperforms state-of-the-art models on single-turn edits and mistral-7B-OpenOrca on direct edits. |
Relabeling Minimal Training Subset to Flip a Prediction (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to identify and relabel training subsets that can flip a prediction are not efficient, argues a new study. |
| Approach: | They propose an algorithm to identify and relabel the smallest training subset St needed to flip a prediction. |
| Outcome: | The proposed algorithm can flip a prediction on a test point xt with 2% of training points . the proposed method can be used for multiple purposes including evaluating model robustness . |