Papers by Ye Bai

12 papers
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved remarkable performance across NLP tasks . however, in long-context scenarios, they face high computational cost and information redundancy.
Approach: They propose an encoder-decoder context compression framework that generates a compact sequence of soft tokens for downstream tasks.
Outcome: Experiments show that GMSA outperforms baselines on multiple long-context question answering and summarization benchmarks while maintaining low end-to-end latency.
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool.
Approach: They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images .
Outcome: The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images.
Discrete Minds in a Continuous World: Do Language Models Know Time Passes? (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models excel at temporal reasoning tasks, but their ability to perceive the passage of time remains unexplored.
Approach: They propose a Token-Time Hypothesis to test whether LLMs perceive the passage of time . they also propose an interactive navigation challenge to examine how LLM responds to time pressure .
Outcome: The proposed model can map discrete token counts to wall-clock time and validate this through a dialogue duration judgment task.
Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications.
Approach: They propose a reliable strategy for domains to choose more robust LLMs for real-world applications.
Outcome: The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications.
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) routing assigns each query to the best suitable model from an ensemble.
Approach: They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation .
Outcome: The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing.
Nature-Inspired Population-Based Evolution of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: a new framework for population-based evolution of large language models is emerging . a population-driven evolution of LLMs is a key component of evolution, authors say .
Approach: They propose a framework that allows for population-based evolution of large language models . they start with a population of parent LLMs and allow this population to evolve .
Outcome: The proposed framework outperforms existing methods on 12 datasets.
GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion (2025.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graphs lack the ability to integrate structural information into LLMs and output predictions deterministically.
Approach: They propose a method which encodes structural information of KGs and merges it with LLMs to enhance KGC performance.
Outcome: The proposed method improves the performance of KG Completion datasets on KGs by integrating structural information with LLMs.
Rethinking Table Pruning in TableQA: From Sequential Revisions to Gold Trajectory-Supervised Parallel Search (2026.acl-long)

Copied to clipboard

Challenge: Existing pruning methods rely on sequential revisions and unreliable critique signals . Existing methods fail to detect the loss of answer-critical data .
Approach: They propose a table pruning framework which transforms table pruning to gold trajectory-supervised parallel search.
Outcome: The proposed framework outperforms the strongest baseline pruning framework by 3.2% on various tabular reasoning tasks.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement (2026.acl-long)

Copied to clipboard

Challenge: Existing multi-LLM collaboration systems often encounter scalability challenges when integrating new LLMs and tasks.
Approach: They propose a Scalable Multi-LLM Collaboration System to coordinate multiple open-source LLMs.
Outcome: The proposed system outperforms prevailing closed-source LLMs on eight mainstream benchmarks on multiple tasks.
Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to solve question answering (QA) problems are limited by the need for text generation and answer retrieval.
Approach: They propose to introduce QA interaction features in scoring function but at the cost of low efficiency in inference stage.
Outcome: The proposed framework significantly outperforms the state-of-the-art method on multiple answer retrieval datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations