Papers by Zichen Wang

13 papers
Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More (2025.emnlp-main)

Copied to clipboard

Challenge: Vision tokens in multimodal large language models often dominate computational overhead due to excessive length compared to linguistic modality.
Approach: They propose a token pruning method which defines an importance criterion for vision tokens and prunes the unimportant vision token during inference.
Outcome: The proposed method can prune 88.9% of vision tokens while maintaining comparable performance.
Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning (2025.acl-long)

Copied to clipboard

Challenge: Using fine-tuning on task-specific data is essential for large language models to be effective in specialized tasks.
Approach: They propose a method that leverages few-shot in-context learning with the model to be fine-tuned.
Outcome: The proposed method outperforms existing methods with a 3.1-point improvement and a 7.4 speedup on the Llama-3-8B-Instruct model using just 10% of the dataset.
Embedding Domain Knowledge for Large Language Models via Reinforcement Learning from Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to embed knowledge into large language models have some limitations . static nature of training data and lack of knowledge in domains create knowledge gaps .
Approach: They propose a method that iteratively cycles between sampling generations and optimizing the model through calculated rewards.
Outcome: The proposed method outperforms baseline approaches on medical, legal, astronomy, and current events datasets.
Alignment for Efficient Tool Calling of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in tool learning have enabled large language models to integrate external tools, enhancing their task performance by expanding their knowledge boundaries.
Approach: They propose a framework that combines probabilistic knowledge boundary estimation with dynamic decision-making to allow LLMs to better assess when to invoke tools based on their confidence.
Outcome: The proposed framework shows significant improvements in tool efficiency by reducing unnecessary tool usage.
Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods (2026.acl-long)

Copied to clipboard

Challenge: Recent efforts to accelerate inference in Multimodal Large Language Models have focused on visual token compression.
Approach: They propose a framework that leverages downsampling as a discriminator to denoise existing benchmarks.
Outcome: The proposed evaluation framework leverages downsampling as a discriminator to denoise existing benchmarks.
SOLAR: Serendipity Optimized Language Model Aligned for Recommendation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have shown strong potential in recommendation tasks . however, their application to serendipity-oriented recommendations remains challenging .
Approach: They propose a domain-adaptive instruction tuning method that aligns Large Language Models with recommendation tasks.
Outcome: The proposed framework bridges the domain gap between LLMs and recommendation tasks.
StreamMeCo: Long-Term Agent Memory Compression for Efficient Streaming Video Understanding (2026.findings-acl)

Copied to clipboard

Challenge: StreamMeCo is an efficient Stream Agent Memory Compression framework for video understanding.
Approach: They propose an efficient Stream Agent Memory Compression framework that evicts redundant memory nodes and introduces a time-decay memory retrieval mechanism to mitigate performance degradation.
Outcome: The proposed framework achieves 1.87 speedup in memory retrieval while delivering an average accuracy improvement of 1.0% on three challenging benchmark datasets.
OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) lack visual-aware tutorial retrieval and historical visual context curation and pruning.
Approach: They propose a framework that integrates an orchestrator and a Reflection-Memory Agent for robust automation.
Outcome: Experimental results show that OS-Symphony delivers substantial performance gains across model scales.
Black-Box Membership Inference Attacks for Video Training Data in Multimodal Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods assess model memorization of key semantic concepts within a video but do not provide reliable evidence that a specific video was used during training.
Approach: They propose a black-box MIA framework that can provide reliable evidence of specific video data usage for training multimodal large language models.
Outcome: The proposed framework can provide reliable evidence of specific video data usage for training multimodal large language models.
OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Graphical User Interface (GUI) agents powered by Vision-Language Models (VLMs) have demonstrated human-like computer control capability.
Approach: They propose a GUI data synthesis pipeline that reverse engineers GUI trajectory construction process by executing pre-defined tasks.
Outcome: The proposed GUI data synthesis pipeline overcomes the bottlenecks of previous methods that rely on pre-defined tasks and limited data diversity.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.
Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on evaluating MLLMs’ pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning.
Approach: They propose a benchmark designed for visual clue-driven reasoning in daily scenarios that combines rigorous grounding in authentic daily activities and challenging query design that necessitates more than surface-level perception.
Outcome: The proposed benchmark identifies visual clues and their ability to provide robust reasoning in daily scenarios.
Breaking the Impasse: Dual-Scale Evolutionary Policy Training for Social Language Agents (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Rewards (RLVR) is effective for closed-ended tasks, but it is not applicable to open-ended social language games.
Approach: They propose a method that uses a time-scaled evolutionary perception mechanism to detect impasse by quantifying dual-scale value baseline divergence alongside match entropy.
Outcome: Experiments on multiple social language games show that the proposed method outperforms baselines and avoids policy degeneration.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations