Papers by Linchao Zhu
Attention as Selector: Unlocking VLM Attention for Long Document Page Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Existing page-level retrieval methods lack query–page interaction before similarity scoring . Existing methods require large-scale datasets to align visual and textual embeddings . |
| Approach: | They propose a retrieval framework that utilizes attention mechanisms inside VLMs for page selection. |
| Outcome: | The proposed retrieval framework outperforms embedding-based retrieval methods on four long-document benchmarks. |
WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings (2023.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on seven semantic textual similarity tasks show our method achieves consistent improvement over the contrastive learning baseline and sets new states of the art. |
| Approach: | They propose a whitening-based contrastive learning method for sentence embedding learning which combines contrastive and shuffled group whitening. |
| Outcome: | The proposed method achieves better alignment and uniformity on seven semantic textual similarity tasks. |
MuTIS: Enhancing Reasoning Efficiency through Multi Turn Intervention Sampling in Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for training large reasoning models with long chain-of-thought (CoT) are limited by the number of parameters and the complexity of the model. |
| Approach: | They propose a framework that leverages multi-turn interventions to produce concise reasoning chains and demonstrates strong scalability. |
| Outcome: | The proposed framework breaks the accuracy-efficiency trade-off by producing concise reasoning chains and demonstrating strong scalability on 7B models. |
N-GRPO: Embedding-Level Neighbor Mixing for Enhanced Policy Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that Large Language Models can generate diverse solutions during the rollout phase. |
| Approach: | They propose a new approach that leverages Semantic Neighbor Mixing to generate diverse input representations by mixing anchor tokens and nearest semantic neighbors. |
| Outcome: | Experimental results show that the proposed approach improves on strong baselines and generalizes on out-of-distribution tasks. |
Verifier-Free RL for LLMs via Intrinsic Gradient-Norm Reward (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning tasks and general tasks. |
| Approach: | They propose a "Verifier-free Intrinsic Gradient-Norm Reward" that uses only the policy model itself. |
| Outcome: | The proposed reward outperforms the state-of-the-art RLIF baseline INTUITOR on math benchmarks and shows cross-domain transfer to code benchmarks when trained only on math data. |
Text Augmented Spatial Aware Zero-shot Referring Image Segmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing zero-shot referring image segmentation methods focus on global-level alignment of image-text pairs, neglecting fine-grained matching between referring sentence and local image regions. |
| Approach: | They propose a zero-shot referring image segmentation task that is training-free . they use a mask proposal network and a text-augmented spatial-correction score . |
| Outcome: | The proposed method outperforms state-of-the-art zero-shot referring image segmentation methods. |
Gloss-Free End-to-End Sign Language Translation (2023.acl-long)
Copied to clipboard
| Challenge: | a study of sign language translation without gloss annotations focuses on the problem of gloss annotation . gloss annotation is hard to acquire, especially in large quantities, and limits the domain coverage of translation datasets . |
| Approach: | They propose a gloss-free end-to-end sign language translation framework to solve this problem . gloss annotations are hard to acquire, especially in large quantities, they argue . |
| Outcome: | The proposed framework improves sign language translation performance on large-scale datasets . gloss annotations are hard to acquire, especially in large quantities . |
VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraft (2024.findings-acl)
Copied to clipboard
| Challenge: | Multi-agent collaboration using LLMs is a challenging research topic that aims to enable multiple autonomous agents to coordinate their actions and achieve a common goal. |
| Approach: | They propose a benchmark for multi-agent collaboration in the Minecraft environment and introduce a Directed Acyclic Graph Multi-Agent Framework to resolve complex inter-ag dependencies. |
| Outcome: | The proposed framework outperforms existing ModelVerse, reducing hallucinations and improving task decomposition efficacy. |
How to Improve LLMs’ Performance on Specific Languages: A Perspective on LLM-Derived Language Similarity (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit uneven performance across languages. |
| Approach: | They propose to use a framework to quantify the similarity within each language pair through both the lenses of language-specific performance patterns and cross-lingual transferability. |
| Outcome: | The proposed approach outperforms traditional linguistic typology and cross-lingual transferability measures on multilingual LLMs. |
FragRel: Exploiting Fragment-level Relations in the External Memory of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to process contexts with unlimited length are limited to finite expansion length or prone to performance degradation when dealing with very long contexts. |
| Approach: | They propose to exploit fragment-level relations in external memory to hierarchically process the long text. |
| Outcome: | The proposed model improves story understanding, repository-level code generation, and long-term chatting. |