Papers by Zhipeng Sun

9 papers
CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to search for images using single-modality are limited by representation space fragmentation.
Approach: They propose a unified representation framework that achieves efficient query-target alignment . they introduce a multi-level Chain-of-Thought prompting strategy that guides MLMs to generate discriminative, semantically compatible captions for target images .
Outcome: The proposed framework achieves efficient query-target alignment through synergistic components.
Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation frameworks for large reasoning models are saturated by a lack of reliable and verifiable benchmarks.
Approach: They propose a rigorously curated, Olympiad-level math benchmark comprising 350 problems, each with parallel English and Chinese versions.
Outcome: The proposed benchmark unifies two evaluation paradigms and offers 150 problems formalized in Lean 4 for rigorous process-level evaluation.
AnyTrans: Translate AnyText in the Image with Large Scale Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in natural language processing and computer vision have made it possible to translate images with text in one language into equivalent images displaying that text translated into another language.
Approach: They propose an all-encompassing framework for the task–In-Image Machine Translation (IIMT) that incorporates contextual cues from both textual and visual elements during translation.
Outcome: The proposed framework can be constructed using open-source models and requires no training, making it highly accessible and expandable.
UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents (2026.acl-long)

Copied to clipboard

Challenge: Recent Large Multimodal Models (LMMs) have shown promising potential for performing end-to-end KIE directly from document images.
Approach: They propose a benchmark to evaluate the performance of Large Multimodal Models (LMMs) using a constrained-category KIE track and an open-categorical KIE Track.
Outcome: Experiments on 15 state-of-the-art LMMs show performance degradation under diverse schema definitions, long-tail key fields, and complex layouts, along with pronounced performance disparities across different document types and scenarios.
Legal Judgment Prediction via Topological Learning (D18-1)

Copied to clipboard

Challenge: Existing studies focus on a specific subtask of judgment prediction and ignore the dependencies among subtasks.
Approach: They propose a topological multi-task learning framework that incorporates multiple subtasks and DAG dependencies into judgment prediction.
Outcome: The proposed model improves on baselines on all judgment prediction tasks.
LEAF: Large Language Diffusion Model for Time Series Forecasting (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent work has applied large language models (LLMs) into time series forecasting, but they lack an understanding of holistic temporal patterns with potential error accumulation.
Approach: They propose a framework that marries Larg e Langu age Diffusion Model with time series forecasting (LEAF) they propose converting time series into tokens and adopting language diffusion models to capture temporal dependencies.
Outcome: The proposed framework generates future predictions with a diffusion model from a holistic view.
ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models and diffusion models have opened new possibilities for AI-generated content . personalized cover image generation remains underexplored despite its critical role in boosting user engagement on digital platforms.
Approach: They propose a framework that integrates MLLM-based prompting with personalized preference alignment to generate high-quality, contextually relevant covers.
Outcome: The proposed framework improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy in downstream tasks.
Jiuge: A Human-Machine Collaborative Chinese Classical Poetry Generation System (P19-3)

Copied to clipboard

Challenge: Existing systems for automatic poetry generation are model-oriented, resulting in poor user participation.
Approach: They propose a human-machine collaborative Chinese classical poetry generation system called Jiuge . Jiuge allows users to revise unsatisfied parts of a generated poem draft repeatedly .
Outcome: The proposed system allows users to revise unsatisfied parts of a generated poem draft repeatedly.
Human-Agent Collaborative Paper-to-Page Crafting (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to create project pages from academic papers have focused on static slides and posters, but the dynamic nature of webpages remains an unaddressed challenge.
Approach: They propose a novel multi-agent system that deconstructs paper-to-page creation into a coarse-to fine pipeline from narrative planning to multimodal content generation and interactive rendering.
Outcome: The proposed system generates high-quality, visually appealing pages in under 15 minutes for less than $0.1 .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations