Papers by Qingyi Si
FaithLens: Detecting and Explaining Faithfulness Hallucination (2026.findings-acl)
Copied to clipboard
Shuzheng Si, Qingyi Wang, Haozhe Zhao, Yuzhuo Bai, Guanqiao Chen, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent progress in large language models (LLMs) has revolutionized text generation. |
| Approach: | They propose a faithfulness hallucination detection model that can provide binary predictions and corresponding explanations to improve trustworthiness. |
| Outcome: | The proposed model outperforms advanced models on 12 diverse tasks. |
Multimodal Table Understanding (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to understanding tables rely on textual inputs and table images are difficult to access in real-world scenarios. |
| Approach: | They propose a multimodal table understanding problem where the model needs to generate correct responses to various table-related requests based on the given table image. |
| Outcome: | The proposed model outperforms open-source MLLMs on 23 benchmarks under held-in and held-out settings. |
An Empirical Study of Instruction-tuning Large Language Models in Chinese (2023.findings-emnlp)
Copied to clipboard
| Challenge: | emergence of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI) however, the closed source of LLMs coupled with the requirement for massive computing resources has deterred researchers from reaching the LLM training stage. |
| Approach: | They propose to use Chinese instruction-tuning LLMs as a cookbook for customizing LLM models that can better respond to Chinese instructions. |
| Outcome: | The proposed LLM can be used to customize Chinese LLMs that can better respond to Chinese instructions. |
Towards One-to-Many Visual Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Visual Question Answering systems are constrained to support domain-specific questions . a model trained on a single specific domain may not be competent for real-world application. |
| Approach: | They propose a task to enable a single model to answer as many different domains of questions as possible . they break the task down into the integration of three key abilities . |
| Outcome: | The proposed model can answer as many domains of questions as possible, the authors argue . the proposed model generalizes well to three extra zero-shot datasets, and the results are published. |
AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are limited by context length when processing long videos. |
| Approach: | They propose a training-free method that flexibly reduces redundancy by allocating compression ratios among time and model layers with theoretical guarantees. |
| Outcome: | Experiments on videoMME, MLVU, LongVideoBench, and LVBench show that AdaRETAKE outperforms existing methods by 2.3% and 2.8% for 7B and 72B models. |
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that biased samples can be brittle for VQA models . however, the improvements on OOD data severely sacrifice the performance on the in-distribution (ID) data. |
| Approach: | They propose a contrastive learning approach that exploits biased samples for unbiased information that contributes to reasoning. |
| Outcome: | The proposed method achieves competitive performance on the OOD dataset while maintaining robustness on the ID dataset. |
Check It Again:Progressive Visual Question Answering via Visual Entailment (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Answering (VQA) only address superficial correlations between image and answer. |
| Approach: | They propose a select-and-rerank progressive framework based on Visual Entailment to address this problem. |
| Outcome: | The proposed framework improves on the Visual Question Answering (VQA) task with 7.55% accuracy. |
Outcome-Grounded Advantage Reshaping for Fine-Grained Credit Assignment in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Ziheng Li, Liu Kang, Feng Xiao, Luxi Xing, Qingyi Si, Zhuoran Li, Weikang Gong, Deqing Yang, Yanghua Xiao, Hongcheng Guo
| Challenge: | Group Relative Policy Optimization (GRPO) uses a coarse-grained credit assignment mechanism that propagates group-level rewards uniformly to to every token in a sequence, neglecting the varying contribution of individual reasoning steps. |
| Approach: | They introduce Outcome-grounded Advantage Reshaping (OAR) which redistributes advantages based on how much each token influences the model’s final answer. |
| Outcome: | Empirical results show that OAR-G outperforms GRPO on a high-fidelity attribution signal and suppresses low-impact tokens while preserving the advantage mass. |
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA (2022.findings-emnlp)
Copied to clipboard
Qingyi Si, Fandong Meng, Mingyu Zheng, Zheng Lin, Yuanxin Liu, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou
| Challenge: | Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution. |
| Approach: | They propose a dataset that considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets. |
| Outcome: | The proposed dataset considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets. |
Combo of Thinking and Observing for Outside-Knowledge VQA (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to visual question answering use external knowledge to acquire and use knowledge beyond images. |
| Approach: | They propose to constrain the cross-modality space into the same space of natural-language space . they propose a multimodal encoder, textual encoder and answer decoder to introduce more types of knowledge . |
| Outcome: | The proposed framework outperforms the state-of-the-art by 6.17% accuracy on a cross-modal space and natural-language space. |
Compressing and Debiasing Vision-Language Pre-Trained Models for Visual Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on VQA models have found that they suffer from dataset biases and inefficient memory footprints. |
| Approach: | They investigate whether a VLP can be compressed and debiased simultaneously by searching sparse and robust subnetworks. |
| Outcome: | The proposed compression and debiasing pipelines outperform the debiased full VLPs on VQA tasks. |