Papers by Longteng Guo

6 papers
VRoPE: Rotary Position Embedding for Video Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing versions of Large Language Models (LLMs) lack a positional encoding strategy for video.
Approach: They propose a new positional encoding method tailored for Video-LLMs that mitigates positional biases and ensures a more uniform distribution of spatial focus.
Outcome: The proposed method outperforms existing versions of RoPE in video understanding and reasoning tasks.
M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge-based VQA benchmarks focus on coarse-grained categories and simple reasoning over single entities.
Approach: They propose a knowledge-based Visual Question Answering benchmark to enhance multimodality evaluation.
Outcome: The proposed benchmark improves evaluation of multimodal large language models in fine-grained multimodal entity understanding and complex multihop reasoning.
SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for multimodal large language models fail to capture complexity and traceability of reasoning processes . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning.
Approach: They propose a multimodal benchmark for scientific reasoning covering 54 subfields . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning .
Outcome: SciVQR evaluates 54 subfields in mathematics, physics, chemistry, geography, astronomy, and biology . the results highlight the need for improved multi-step reasoning and integration of interdisciplinary knowledge .
Self-Bootstrapped Visual-Language Model for Knowledge Selection and Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: a framework that leverages the visual-language model to select key knowledge retrieved by DPR and answer questions improves performance of the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
Approach: They propose a framework that leverages visual-language models to retrieve related knowledge . they use dense passage retrieval to retrieve knowledge related to visual-linguistics .
Outcome: The proposed framework significantly improves the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
ViPE: Visual Perception in Parameter Space for Efficient Video-Language Understanding (2025.emnlp-main)

Copied to clipboard

Challenge: Existing video-language models rely on concatenating visual tokens with textual inputs for joint modeling, but this method suffers from significant inefficiency when scaling to long videos with dense visual inputs.
Approach: They propose a video-to-parameter efficiency paradigm called ViPE that transforms video content into visual perceptual weights, which are directly injected into the LLM’s parameters.
Outcome: The proposed model reduces FLOPs by 85% and inference time by up to 65% while reducing FLOP and FLOP inference times by up-to-65%.
Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in multimodal large language models demonstrate strong performance on visual reasoning benchmarks.
Approach: They propose a benchmark for vision-centric reasoning that integrates visual and textual information for non-trivial reasoning.
Outcome: The proposed benchmark exposes gaps between humans and current MLLMs and reveals limited benefits from test-time reasoning strategies.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations