Papers by Gang Zhang

36 papers
SumSurvey: An Abstractive Dataset of Scientific Survey Papers for Long Document Summarization (2024.findings-acl)

Copied to clipboard

Challenge: a growing need for long document summarization datasets with 16k input is causing problems.
Approach: They propose to use a dataset to analyze salient information in long document summarizations.
Outcome: The proposed dataset outperforms existing models and LLMs in the distribution form of salient information and the distribution of salinal information is an indicator of quality.
Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects (2026.findings-acl)

Copied to clipboard

Challenge: Large Vision-Language Models are hindered by a systemic efficiency barrier known as visual token dominance.
Approach: They propose a systematic taxonomy of efficiency techniques structured around the inference lifecycle . they examine visual encoding, prefilling, and decoding to understand bottlenecks .
Outcome: The proposed techniques reveal how upstream decisions dictate downstream bottlenecks . the proposed techniques include hybrid compression and modality-aware decoding .
CamoQuery: Language-Guided Reasoning Camouflaged Object Segmentation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for camouflaged object segmentation are limited to vision-only mask prediction under fixed task assumptions.
Approach: They propose a language-guided reasoning camouflaged object segmentation task that generates an intent-consistent segmentation mask from an image and an implicit query text instruction.
Outcome: The proposed task can generate an intent-consistent segmentation mask from a camouflaged image and an implicit query text instruction.
A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have leapt from static chatbots to versatile agents that tackle complex tasks such as science experiments.
Approach: They propose a plan-and-execute framework and propose 'EAGLET' to enhance the executor agent's planning abilities without human effort.
Outcome: The proposed method outperforms existing methods on three long-horizon tasks and reduces training costs by 8 compared to baselines.
Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for accelerating Large Language Models have been criticized for their inference costs and inefficient decoding.
Approach: They propose a self-speculative decoding approach for accelerating Large Language Models without an auxiliary model.
Outcome: The proposed method achieves a speedup of up to 1.99 with no additional neural network training and no extra memory footprint.
FaithLens: Detecting and Explaining Faithfulness Hallucination (2026.findings-acl)

Copied to clipboard

Challenge: Recent progress in large language models (LLMs) has revolutionized text generation.
Approach: They propose a faithfulness hallucination detection model that can provide binary predictions and corresponding explanations to improve trustworthiness.
Outcome: The proposed model outperforms advanced models on 12 diverse tasks.
Meta-Reflection: A Feedback-Free Reflection Learning Framework (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve large language models' ability to understand and reason are limited by external feedback.
Approach: They propose a feedback-free reflection mechanism that requires only a single inference pass without external feedback.
Outcome: The proposed method is based on an industrial e-commerce benchmark and public datasets.
SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark (2024.acl-short)

Copied to clipboard

Challenge: SceMQA focuses on core science subjects including Mathematics, Physics, Chemistry, and Biology.
Approach: They propose to use SceMQA to evaluate multimodal question answering at college entrance level.
Outcome: The proposed model provides specific knowledge points for each problem and detailed explanations for each answer.
Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Recent state-of-the-art (SOTA) effective neural network methods have been used in Chinese word segmentation (CWS) However, the robustness of the previous neural methods is limited by the large-scale annotated corpus.
Approach: They propose a self-supervised Chinese word segmentation approach with a straightforward and effective architecture.
Outcome: The proposed approach outperforms previous methods on 9 different CWS datasets with single criterion training and multiple criteria training and achieves better robustness.
D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agents (2026.findings-acl)

Copied to clipboard

Challenge: Graphical User Interface (GUI) agents aim to automate a wide spectrum of human tasks by emulating user interaction.
Approach: They propose a deliberative framework that leverages a fine-grained tip retrieval mechanism to inform its decision-making process.
Outcome: The proposed framework achieves SOTA among open-source general models on AndroidWorld and ScreenSpot-V2 . it leverages a fine-grained, app-specific tip retrieval mechanism to inform its decision-making process .
HyperLoRA: Efficient Cross-task Generalization via Constrained Low-Rank Adapters Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to adapt pre-trained language models (PLMs) to emerging tasks are costly and inefficient.
Approach: They propose a meta-network that generates task-specific weights without any optimization.
Outcome: The proposed approach has flexible generalization ability and superior performance over hypenetworks.
Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledge (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to enhance textual entity prediction neglect the need for external knowledge or encounter high redundancy in the retrieved knowledge.
Approach: They propose a framework that leverages ChatGPT as an implicit knowledge base and heuristically generates auxiliary knowledge for more efficient entity prediction.
Outcome: The proposed framework outperforms state-of-the-art methods on two classic datasets and exhibits a stronger robustness and generalization capability.
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)

Copied to clipboard

Challenge: Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity.
Approach: They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability.
Outcome: The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability.
SpecVLM: Enhancing Speculative Decoding of Video LLMs via Verifier-Guided Token Pruning (2025.emnlp-main)

Copied to clipboard

Challenge: Video large language models (Vid-LLMs) rely on dense video token representations and require substantial memory and computational overhead in both prefilling and decoding.
Approach: They propose a training-free speculative decoding framework that prunes up to 90% of video tokens to enable efficient speculation without sacrificing accuracy.
Outcome: The proposed framework achieves 2.68 speedup on LLaVA-OneVision-72B and 2.11 speed up on Qwen2.5-VL-32B.
LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrieval-based methods compromise semantic integrity through fixed-size chunking and suffer from inefficient linear scanning.
Approach: They propose a method that preserves local semantic coherence through boundary-aware chunking and constructs a recursive hierarchical index rooted in the triangle inequality.
Outcome: The proposed method achieves 3.6 end-to-end inference speedup with negligible degradation in model performance.
Incorporating Instructional Prompts into a Unified Generative Framework for Joint Multiple Intent Detection and Slot Filling (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches to multiple intent detection and slot filling focus on task-specific components to capture the relationships between intents and slots.
Approach: They propose a Unified Generative framework that captures the relationships between intents and slots in an utterance and formulates the task as a question-answering problem.
Outcome: The proposed framework surpasses baselines on full-data and multi-intent benchmarks on 5-shot and 10-shot scenarios.
TLM: Token-Level Masking for Transformers (2023.emnlp-main)

Copied to clipboard

Challenge: Structured dropout approaches have been investigated to regularize the multi-head attention mechanism in Transformers.
Approach: They propose a new regularization scheme based on token-level rather than structure-level to reduce overfitting by manipulating the connections between tokens in the multi-head attention via masking.
Outcome: The proposed regularization scheme outperforms attention dropout and DropHead on 18 datasets and can establish a new record on the data-to-text benchmark Rotowire (18.93 BLEU).
RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing medical large vision language models often generate inaccurate and irrelevant answers that do not align with established medical facts.
Approach: They propose a strategy for controlling factuality risk through calibrated selection of the number of retrieved contexts and a preference dataset to fine-tune the model.
Outcome: The proposed model achieves an average improvement of 20.8% on three medical VQA datasets.
LLM-Powered Test Case Generation for Detecting Bugs in Plausible Programs (2025.acl-long)

Copied to clipboard

Challenge: TrickCatcher generates test cases that pass existing tests yet contain bugs . a recent study found that tricky bugs are not detected by test suites .
Approach: They propose an LLM-powered approach to generating test cases for uncovering bugs in plausible programs . they use a PUT and specification to generate program variants, an input generator and an Llm to construct test inputs .
Outcome: The proposed approach achieves recall, precision, and F1 scores that are 1.80, 2.65, and 1.66 . trickCatcher generates program variants based on the program under test and its specification .
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains (2026.acl-long)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated remarkable progress in reasoning, but their applications on knowledge-intensive domains have not been explored due to the scarcity of high-quality verifiable data.
Approach: They propose a framework that extends reinforcement learning with verifiable rewards (RLVR) to knowledge-intensive domains through automated verififiability data synthesis while enabling verification of the LLM's reasoning process.
Outcome: Extensive experiments show that the proposed framework enhances the reasoning of large language models in knowledge-intensive domains without significantly compromising the model’s general capabilities.
GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration (2025.emnlp-main)

Copied to clipboard

Challenge: Recent work of GUI action grounding fine-tunes data from pre-trained MLLMs, but data is limited to specific GUI environments.
Approach: They propose to use a GUI-based agent to collect environment-specific data and fine-tune GUI grounding models with the collected data.
Outcome: The proposed model can be extended to other GUI environments to improve performance.
EgoMemory: Memory-Augmented Personalized Retrieval for Long-Context Egocentric Video (2026.findings-acl)

Copied to clipboard

Challenge: Existing egocentric video datasets do not support the personalization and long-context reasoning required for episodic memory retrieval.
Approach: They propose a benchmark framework that uses MLLMs and reflective Chain-of-Thought to ground user queries in personal memory explicitly.
Outcome: The proposed framework outperforms state-of-the-art benchmarks on three benchmarks . it can be used to generate detailed target video descriptions in long-context contexts based on user-specific object annotations enriched with user-specified object annotation data .
STAF: Pushing the Boundaries of Test-Time Adaptation towards Practical Noise Scenarios (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models have demonstrated superior performance on NLP tasks . however, when the training domain and testing domain are taken from different distributions, the deployed model often violates this assumption.
Approach: They propose a Stable Test-time Adaptation Framework to stabilize the adaptation process.
Outcome: The proposed framework boosts model robustness to noise distribution shifts while minimizing error accumulation and catastrophic forgetting.
FinMRAGBench: A Realistic and Complex Benchmark for Multi-Modal RAG in Financial Document Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for realistic financial analysis fail to capture realistic financial situations involving cross-document retrieval, multi-page evidence integration, and diverse analytical tasks.
Approach: They propose a multi-modal financial RAG benchmark that evaluates large language models in realistic financial analysis settings.
Outcome: The proposed framework achieves the strongest overall performance across all models.
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)

Copied to clipboard

Challenge: OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown.
Approach: They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning.
Outcome: The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods.
Learning to Conceal Risk: Controllable Multi-turn Red Teaming for LLMs in the Financial Domain (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as finance where unsafe behavior can lead to serious regulatory risks.
Approach: They propose a black-box multi-turn risk-concealed redteaming framework that progressively conceals surface-level risk while exploiting regulatory-violating behaviors.
Outcome: Experiments on nine widely used LLMs show that the proposed framework achieves 93.19% average attack success rate (ASR) and improves the average ASR to 95.00%.
LLMs as Bridges: Reformulating Grounded Multimodal Named Entity Recognition (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for Grounded Multimodal Named Entity Recognition (GMNER) lack a strong correlation between image-text pairs and is ungroundable.
Approach: They propose a framework that reformulates GMNER into a joint MNER-VE-VG task by leveraging large language models as a connecting bridge.
Outcome: The proposed framework outperforms state-of-the-art methods on the existing GMNER dataset and achieves absolute leads of 10.65%, 6.21%, and 8.83% in all three subtasks.
Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating geometric reasoning data through Chain-of-Thought (CoT) frameworks face three fundamental limitations: 1) lack of high-quality annotations and domain-specific expertise to ensure theorem-grounded diagrams. 2) lack of a coherent model; 3) lack of coherent model.
Approach: They propose a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis framework that synthesizes theorematic diagrams with structured descriptions and properties.
Outcome: The proposed framework expands theorem-type coverage, corrects misunderstandings, and enhances geometric reasoning.
Neural Sparse Topical Coding (P18-1)

Copied to clipboard

Challenge: Topic models with sparsity enhancement are effective at learning discriminative and coherent latent topics of short texts.
Approach: They propose a novel sparsity-enhanced topic model with back propagation that replaces the inference process with the back propagations, making it easy to explore extensions.
Outcome: The proposed model outperforms existing methods on Web Snippet and 20Newsgroups datasets.
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)

Copied to clipboard

Challenge: Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate .
Approach: They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module.
Outcome: The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks .
GUI Agents: A Survey (2025.findings-acl)

Copied to clipboard

Challenge: Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life.
Approach: They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities.
Outcome: The proposed framework delineates their perception, reasoning, planning, and acting capabilities.
GUI0: Self-Evolving Foundational GUI Agents in Super App Ecosystems (2026.acl-long)

Copied to clipboard

Challenge: Automated interaction with graphical user interfaces (GUIs) is central to general artificial intelligence, but remains challenging within Super App ecosystems.
Approach: They propose a framework synergizing autonomous data synthesis with dual-agent co-evolution . GUI0 establishes a domain-aware foundation model via synthesized corpora and employs curriculum-driven reinforcement learning .
Outcome: The proposed framework outperforms Gemini-2.5-Pro and Claude-4-Sonnet in the SuperAPP benchmark and has universal efficacy across base models.
Q-PRM: Adaptive Query Rewriting for Retrieval-Augmented Generation via Step-level Process Supervision (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to rewriting queries often lack supervision signals for intermediate steps . existing approaches rely on outcome-supervised training or heuristic rules to guide the rewrite process .
Approach: They propose a query rewriting framework that generates process-level supervision signals for intermediate steps.
Outcome: a new query rewriting framework outperforms existing approaches on open-domain QA benchmarks.
The Digital Dunning-Kruger Effect: Decoupling Hallucinations via Geometric Hidden-state Observation for Semantic Truthfulness (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) often generate overconfident yet factually incorrect hallucinations.
Approach: They propose a black-box-based framework that captures stubborn hallucinations by integrating internal geometric dynamics with output probability distributions.
Outcome: The proposed framework outperforms white-box methods and reduces computational overhead by over 90%.
Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for hallucination detection have attracted more attention from the community.
Approach: They propose to model the distributional distance between the regular conditional output and the unconditional output, which is generated without a given input text.
Outcome: The proposed model achieves state-of-the-art on the hallucination benchmarks HADES and other datasets.
See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for video understanding suffer from autoregressive generation of tokens.
Approach: They propose a training-free loosely SD framework for Video-LLMs that uses visual-relevant tokens to accurately pinpoint the latter.
Outcome: The proposed framework boosts the accepted length and speedup ratio by 136% and 35% compared to SOTA training-free SD methods for Video-LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations