Papers by Ge Yu

48 papers
Lost in Decomposition: Analyzing and Mitigating the Limitations of Long Context Methods via Context Dependency (2026.findings-acl)

Copied to clipboard

Challenge: Existing workflow-based long context methods do not perform well on specific datasets . performance degradation is associated with the indiscriminate application of long context models .
Approach: They propose a training-free adaptive routing strategy to improve long context large language models' robustness.
Outcome: The proposed method can be generalized to all types of datasets, but performance degradation is a concern.
Word Segmentation by Separation Inference for East Asian Languages (2022.findings-acl)

Copied to clipboard

Challenge: Chinese Word Segmentation (CWS) is a sequence labeling task that divides sentences into words . despite diverse tagging schemas, they all carry implicit position information.
Approach: They propose to model the separation state of every two consecutive characters by tagging them as two tags.
Outcome: The proposed framework outperforms state-of-the-art on Japanese and Korean Word Segmentation datasets.
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)

Copied to clipboard

Challenge: generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap.
Approach: They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback .
Outcome: The proposed system significantly improves image reasoning and generation quality.
HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding (2025.coling-main)

Copied to clipboard

Challenge: Object categories are typically organized into a multi-granularity taxonomic hierarchy . traditional uni-modal approaches focus primarily on image features, revealing limitations in complex scenarios.
Approach: They propose a framework that combines vision-language models with a deeper exploitation of the hierarchy.
Outcome: The proposed framework shows significant improvements on 11 diverse visual recognition benchmarks.
Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation (2026.findings-acl)

Copied to clipboard

Challenge: Current approaches for Multimodal Sentiment Analysis (MSA) rely on parameter-heavy LLMs for classification, overlooking multimodal sentiment reasoning generation in resource-limited environments.
Approach: They propose a multimodal sentiment reasoning distillation model that employs a teacher-assistant-student paradigm to address deployment constraints in resource-limited environments.
Outcome: The proposed model performs well on a resource-limited JMSRC task with only 3B parameters and shows generalization and interpretability.
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation (2025.acl-long)

Copied to clipboard

Challenge: Existing multimodal large language models lack the ability to memorize, recall, and reason in sustained interactions.
Approach: They propose a multimodal real-world conversation benchmark for evaluating open-ended abilities of multimodal large language models.
Outcome: The proposed benchmarks show that the models perform better in open-ended conversations.
Computer Assisted Translation with Neural Quality Estimation and Automatic Post-Editing (2020.findings-emnlp)

Copied to clipboard

Challenge: Using neural machine translation to approximate human parity is difficult due to the lack of parallel training corpora.
Approach: They propose an end-to-end deep learning framework for quality estimation and automatic post-editing of machine translation output.
Outcome: The proposed framework achieves state-of-the-art performance on the English–German dataset and human translators can significantly expedite their post-editing processing with the model.
Revealing the Attention Floating Mechanism in Masked Diffusion Models (2026.findings-acl)

Copied to clipboard

Challenge: Masked diffusion models (MDMs) leverage bidirectional attention and a denoising process.
Approach: They investigate the attention behaviors of Masked diffusion models by revealing the phenomenon of Attention Floating.
Outcome: The proposed model doubles the performance of autoregressive models in knowledge-intensive tasks.
Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing evaluation metrics cannot fairly evaluate the outputs of RAG models during training and evaluation.
Approach: They propose a method which prompts LLMs to generate different judgments based on various combinations of judgment dimensions and utilizes the judge-consistency to evaluate these judgments.
Outcome: The proposed method generates more accurate evaluations for RAG models across different RAG model and datasets.
Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing document benchmarks focus on English printed texts or simplified Chinese . current vision-language models struggle with visual complexity and poor adaptability .
Approach: They propose a benchmark to evaluate Chinese ancient documents' visual/linguistic complexity . ancient documents are valuable cultural heritage, but they face challenges in digitization and understanding .
Outcome: the first benchmark for Chinese ancient documents evaluates VLMs from OCR to knowledge reasoning . ancient documents carry thousands of years of Chinese history and culture . traditional methods only scan images, while current models struggle with visual complexity .
Enhancing Long-Chain Reasoning Distillation through Error-Aware Self-Reflection (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies treat SLMs as student models and use long-form Chains-of-Thought (CoTs) as supervision signals for Supervised Fine-Tuning (SFT). Existing research focuses on distilling reasoning ability from LLMs to enhance the mathematical reasoning performance of small-scale models.
Approach: They propose a framework that refines teacher CoTs through an error-aware reflection process to enable the student model to construct more tailored teacher Cots.
Outcome: Experiments on multiple mathematical reasoning benchmarks show that ORION improves performance by more than 2% over all baselines.
When Generative Adversarial Networks Meet Sequence Labeling Challenges (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches for sequence labeling use a feature extractor and sequence tagger . a recent study shows that SLGAN is versatile and highly effective .
Approach: They propose a framework that harnesses the capabilities of Generative Adversarial Networks to address sequence labeling challenges.
Outcome: The proposed framework exhibits strong adaptability to various sequence labeling tasks.
MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been widely adopted in real-world dialogue applications, but their robustness is criticized all along.
Approach: They propose to use play-by-play text commentary to build a multi-turn athletic real-world scenario dialogue benchmark to evaluate three critical aspects of multi-turned conversations: ultra multi- turn, interactive multi-twist, and cross-turn tasks.
Outcome: The proposed benchmarks outperform open-source LLMs on three critical aspects of multi-turn conversations: ultra multi-turned, interactive multi- turn, and cross-turn tasks.
Bypassing Neural Evaluations for Fast Audio Editing via Adaptive Trajectory Extrapolation (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio diffusion models have significantly improved text-to-audio editing via inversion techniques, but these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity.
Approach: They propose a model-agnostic Adaptive Trajectory Extrapolation framework that accelerates inversion-based editing process by dynamically evaluating only the most critical generative phases.
Outcome: The proposed framework achieves a 3.9 speedup with negligible loss in fidelity.
Low-Bit Quantization Favors Undertrained LLMs (2025.acl-long)

Copied to clipboard

Challenge: Larger models or those trained on fewer tokens exhibit less quantization-induced degradation (QiD), while smaller, well-trained models face significant performance losses.
Approach: They propose to use QiD to measure an LLM’s training levels and determine the number of training tokens required for fully training LLMs of various sizes.
Outcome: The proposed scaling laws can predict the quantization performance of different-sized LLMs trained with tokens.
On the Emotion Understanding of Synthesized Speech (2026.acl-long)

Copied to clipboard

Challenge: Existing models for emotion understanding do not capture fundamental features of synthesized speech.
Approach: They evaluate emotion recognition models on synthesized speech using SER models and generative models.
Outcome: The proposed model can't generalize to synthesized speech because of speech token prediction . generative models tend to infer emotion from textual semantics while ignoring paralinguistic cues.
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages .
Approach: They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder .
Outcome: The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities.
Structure-Aware Language Model Pretraining Improves Dense Retrieval on Structured Data (2023.findings-acl)

Copied to clipboard

Challenge: Structure Aware Dense Retrieval (SANTA) model encodes user queries and structured data in one universal embedding space for retrieving structured data.
Approach: They propose to use structured data and unstructured data to encode queries and structured data in one universal embedding space for retrieving structured data.
Outcome: The proposed model achieves state-of-the-art on code search and product search and conducts convincing results in the zero-shot setting.
INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results show that INTERVENOR surpasses baseline models, exhibiting improvements of approximately 18% and 4.3% over GPT-3.5 in code generation and code translation tasks.
Approach: They propose a system that prompts Large Language Models to play distinct roles during the code repair process, functioning as both a Code Learner and a code teacher.
Outcome: The proposed system surpasses baseline models in code generation and code translation tasks and improves on syntax errors and assertion errors.
MetaMem: Evolving Meta-Memory for Knowledge Utilization through Self-Reflective Symbolic Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing memory systems can support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows.
Approach: They propose a framework that augments memory systems with a self-evolving meta-memory . meta-meso is iteratively distilling transferable knowledge utilization experiences . results show MetaMem outperforms strong baselines by over 3.6% .
Outcome: The proposed framework outperforms baselines by over 3.6% in the long-horizon human-LLM interaction.
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)

Copied to clipboard

Challenge: Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios.
Approach: They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence.
Outcome: The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction.
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
MeMoTune: A Measure and Moment-Driven Fine-Tuning Framework for Quantized Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods combine quantization with parameter-efficient fine-tuning but fail to meet practical performance requirements.
Approach: They propose a measure and moment approach to optimize objective function for superior fine-tuning results by scaling the update process through a gradient.
Outcome: The proposed framework outperforms state-of-the-art methods on tasks like text generation, summarization, and understanding.
Mitigating Judgment Preference Bias in Large Language Models through Group-Based Polling (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are used as automatic evaluators to provide accurate and reliable assessments.
Approach: They propose a framework that integrates LLM-based judgment models into a multi-agent system and simulates the interactive client-server polling mechanism.
Outcome: The proposed framework outperforms supervised models trained on annotated judgment data while requiring no human-labeled annotations.
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation.
Approach: They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model.
Outcome: Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training .
ThinkNote: Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognition Modeling (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit suboptimal behaviors and inconsistencies when exposed to unfamiliar external information, underscoring their limitations in effectively leveraging such knowledge.
Approach: They propose a framework that enhances the external knowledge utilization of Large Language Models through a two-stage constructivist cognitive modeling process.
Outcome: The proposed framework achieves a 10% improvement over baseline methods on various question-answering benchmarks.
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning.
Approach: They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations.
Outcome: The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models.
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information.
Approach: They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark.
Outcome: The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%.
UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents (2026.acl-long)

Copied to clipboard

Challenge: Recent Large Multimodal Models (LMMs) have shown promising potential for performing end-to-end KIE directly from document images.
Approach: They propose a benchmark to evaluate the performance of Large Multimodal Models (LMMs) using a constrained-category KIE track and an open-categorical KIE Track.
Outcome: Experiments on 15 state-of-the-art LMMs show performance degradation under diverse schema definitions, long-tail key fields, and complex layouts, along with pronounced performance disparities across different document types and scenarios.
Evaluating Evaluation Metrics – The Mirage of Hallucination Detection (2025.findings-emnlp)

Copied to clipboard

Challenge: a large-scale empirical evaluation of hallucination detection metrics is conducted . hallucinosity is a significant obstacle to the reliability and widespread adoption of language models .
Approach: They conduct large-scale empirical evaluation of hallucination detection metrics . they compare hallucinian language models, language models and decoding methods .
Outcome: The results show that the evaluations of hallucination detection metrics fail to align with human judgments, they say . they also show that evaluations with LLM-based evaluation yield the best overall results .
EvoCoT: Overcoming the Exploration Bottleneck in Reinforcement Learning for LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reinforcement learning with verifiable reward (RLVR) are limited by difficulty or lack of exploration.
Approach: They propose a self-evolving curriculum learning framework based on chain-of-thought reasoning optimization that constrains exploration space by self-generating and verifying CoT trajectories.
Outcome: The proposed framework enables LLMs to solve previously unsolved problems without external supervision and is compatible with various RL fine-tuning methods.
Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization (2026.acl-long)

Copied to clipboard

Challenge: Recent studies have explored fine-tuning Large Language Models with synthetic data to enhance their long-context capabilities.
Approach: They propose a framework that leverages a Multi-Armed Bandit rollout strategy to identify the most informative chunks from the given long context for sampling high-quality and diverse responses.
Outcome: The proposed framework achieves 4% improvement on long-context reasoning benchmarks on Llama and Qwen.
ReCUT: Balancing Reasoning Length and Accuracy in LLMs via Stepwise Trails and Preference Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to train LLMs suffer from overthinking, leading to lengthy reasoning traces . Existing approaches to train large language models suffer from this problem .
Approach: They propose a method to combine multiple reasoning chains for training LLMs . they use stepwise exploration and long-short switched sampling to evaluate reasoning paths .
Outcome: The proposed method reduces reasoning lengths by approximately 30-50% . it also maintains or improves reasoning accuracy compared to baselines .
HqeKV: Towards Hybrid Quantization and Eviction for KV Cache in Long-Context LLM Inference (2026.findings-acl)

Copied to clipboard

Challenge: autoregressive inference requires repeated computation across transformer layers.
Approach: They propose a hybrid compression framework built on both quantization and eviction . they propose varying importance metric and flexible conversion policies to reduce memory overhead .
Outcome: The proposed framework outperforms state-of-the-art methods under memory constraints.
RankCoT: Refining Knowledge for Retrieval-Augmented Generation through Ranking Chain-of-Thoughts (2025.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) models enable Large Language Models to access external knowledge.
Approach: They propose a knowledge refinement method that incorporates reranking signals to generate CoT-based summarization based on query and retrieval documents.
Outcome: RankCoT generates CoT-based summarization based on query and all retrieval documents . Rank CoT incorporates a self-reflection mechanism that refines the outputs .
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for enhancing dense retrieval with query augmentation ignore the alignment between generation and ranking objectives.
Approach: They propose a unified LLM-augmented dense retrieval framework that jointly optimizes both the LLM and the retriever.
Outcome: Experimental results show that ExpandR outperforms strong baselines, achieving more than 5% improvement in retrieval performance.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Long-Chain Reasoning Distillation via Adaptive Prefix Alignment (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities, especially in solving complex mathematical problems.
Approach: They propose a framework that exploits teacher CoTs for distillation through adaptive prefix alignment.
Outcome: The proposed framework outperforms baseline models on multiple mathematical reasoning benchmarks by over 3%.
Lang2Act: Fine-Grained Visual Reasoning through Self-Emergent Linguistic Toolchains (2026.findings-acl)

Copied to clipboard

Challenge: Existing frameworks depend on rigid, pre-defined external tools to extend perceptual capabilities of VLMs.
Approach: They propose a framework that leverages self-emergent linguistic toolchains to enhance visual perception and reasoning.
Outcome: The proposed framework improves the visual perception capabilities of large language models by incorporating external visual documents to address a given query.
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Video Large Language Models (VLMs) have been praised for their performance in coarse-grained video understanding but still face ineffective temporal grounding and inadequate timestamp representations.
Approach: They propose a novel Video-LLM that senses and reasoned over specific video moments with fine-grained temporal precision.
Outcome: The proposed model surpasses existing models in fine-grained video understanding tasks and exhibits strong potential as a general video understanding assistant.
MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Models (2026.findings-eacl)

Copied to clipboard

Challenge: Current multimodal benchmarks focus on facts within individual images, but neglect associative relations among multiple images.
Approach: They propose a multi-image relational association task and a MMRA benchmark to evaluate LVLMs.
Outcome: The proposed benchmarks show that entity-level multi-image perception tasks pose greater challenges than image-level tasks.
Towards Efficient and Effective Diffusion Language Model Inference via Semantic-Aware Adaptive Denoising (2026.acl-long)

Copied to clipboard

Challenge: Existing acceleration works cannot accurately detect semantically stabilized tokens and then skip computation, leading to sub-optimal speedup in practice.
Approach: They propose a semantic-aware adaptive denoising framework that encodes scalar confidence scores into an evolution-awful feature vector and clusters vectors proactively and adaptively identify semantically converged tokens.
Outcome: The proposed framework outperforms the SOTA competitor in speed and quality . it can detect semantically stabilized tokens and skip computation, resulting in sub-optimal speedup .
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis (2025.findings-naacl)

Copied to clipboard

Challenge: Existing code debugging benchmarks focus on the Code Repair stage of the code generation process.
Approach: They propose a framework to evaluate the debugging abilities of large language models by emulating the human debug process.
Outcome: The proposed framework outperforms human-curated and GPT-4-generated training data, enabling 7B-scale LLMs to achieve comparable debugging performance to GPT-3.5.
High-Quality Medical Dialogue Synthesis for Improving EMR Generation (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for generating EMRs from doctor-patient dialogues produce rigid and repetitive dialogues.
Approach: They propose a framework that integrates Intent Graph Planning, Dual-Agent Simulation and Rule-Reward Quality Control to generate realistic doctor-patient dialogues.
Outcome: The proposed framework significantly enhances realism, diversity and downstream EMR quality, reducing physician editing efforts.
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on *broadening* the training set with data augmentation techniques to maximize such benefits.
Approach: They propose a method that embeds problem reflection into each training instance.
Outcome: The proposed method enhances performance in standard and complex scenarios that require reflective thinking.
Router-Tuning: A Simple and Effective Approach for Dynamic Depth (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to improve computational efficiency are under-explored and face several critical challenges.
Approach: They propose a method that selectively activates only a subset of the model's layers, skipping those deemed less important.
Outcome: The proposed method significantly improves performance on Attention layers and MoE layers while reducing redundant computation and memory usage.
Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: In order to improve translation efficiency, human translators perform post-editing on machine translations to correct errors.
Approach: They propose to use the parameterized objective function of neural machine translation to deal with the TS problem without additional training.
Outcome: The proposed method improves translation quality by 10.6 BLEU and reduces time overhead by 63.4% on benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations