Papers by Guoming Li
ITERATE: Image-Text Enhancement, Retrieval, and Alignment for Transmodal Evolution with LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | a new framework for visual annotation of text-based questions is needed to improve performance . obtaining corresponding images through manual annotation often entails high costs . |
| Approach: | They propose a framework that uses visual modality to enhance the performance of text-based questions. |
| Outcome: | The proposed framework improves the alignment between text and images by using search engines or web scraping techniques. |
Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent research indicates that Large Reasoning Models suffer from a strategic bottleneck at reasoning path planning. |
| Approach: | They propose a framework that reformulates reasoning as a dynamic search for the optimal thinking strategy. |
| Outcome: | The proposed framework improves accuracy and computational cost while reducing generation length by over 22%. |
Faster In-Context Learning for LLMs via N-Gram Trie Speculative Decoding (2025.emnlp-main)
Copied to clipboard
| Challenge: | In-Context Learning (ICL) is a key method in prompt engineering, but its long retrieved contexts and limited token throughput will slow reasoning speeds. |
| Approach: | They propose a method that leverages the overlap between context and model output to generate drafts from the context. |
| Outcome: | The proposed method achieves the highest mean speedup on Vicuna-7B, Llama2-7B-Chat, and Llma3-8B-Instruct tasks. |
XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks. however, their extensive memory requirements present significant challenges for deployment in resource-constrained environments. |
| Approach: | They propose a training-free framework that achieves ultra-low equivalent bit-width KV cache quantization. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on TruthfulQA and LongBench. |
DAC: A Dynamic Attention-aware Approach for Task-Agnostic Prompt Compression (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on information entropy as the metric to compress lexical units, but ignore attention-critical tokens and information . recent advent of In-Context Learning (ICL), Chain-of-Thought (CoT), and Retrieval Augmented Generation (RAG) technologies has significantly invigorated the landscape of applications based on Large Language Models (LLMs). |
| Approach: | They propose a dynamic attention-aware approach to task-agnostic prompt compression . they integrate entropy and attention information to achieve fine-grained prompt compression. |
| Outcome: | Experiments show that the proposed approach improves across tasks and LLMs. |
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive capabilities across various fields, but their widespread use is facing a severe and realistic challenge, which is their high demand for GPU memory. |
| Approach: | They propose a KV cache reduction method which balances both shallow and deep layers by using an attention weight based eviction method and a codebook based replacement approach. |
| Outcome: | The proposed method reduces the KV cache for shallower layers while preserving similar or even better model performance. |
GlossaGen: Making Academic Translation Smarter with Glossing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing machine translation systems obscure or mistranslate key terminology, while paraphrasing aimed at lay readers often oversimplifies it, hindering their ability to master domain-specific technical vocabulary. |
| Approach: | They propose a task which produces translations dynamically adapted to a reader’s academic proficiency, or level, and a framework to address this challenge. |
| Outcome: | The proposed framework achieves higher scores than baselines on a synthesized benchmark and human evaluations. |
KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) based on Transformer Decoders have become the preferred choice for conversational generative AI. |
| Approach: | They propose a paradigm called KV-Latent to reduce the KV cache footprint and improve inference speed by down-sampling the Key-Value vector dimensions into a latent space. |
| Outcome: | The proposed paradigm reduces the KV Cache footprint and improves inference speed with a small amount of extra training, less than 1% of pre-training takes. |