Papers by Ziqi Gao
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios (2024.acl-demos)
Copied to clipboard
| Challenge: | OpenVNA is an open-source framework for analyzing the behavior of multimodal language understanding systems under noisy conditions. |
| Approach: | They propose to use OpenVNA to analyze behavior of multimodal language understanding systems under noisy conditions. |
| Outcome: | The proposed framework provides high flexibility and extensibility, enabling customization with user-defined noise types and models. |
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis (2022.acl-demo)
Copied to clipboard
| Challenge: | M-SENA is an open-source platform for multimodal sentiment analysis. |
| Approach: | They propose to use a platform for multimodal sentiment analysis to facilitate advanced research by providing flexible toolkits, reliable benchmarks, and intuitive demonstrations. |
| Outcome: | The proposed framework provides reliable benchmarks and baseline results of different modality features and MSA benchmarks. |
Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for hallucination mitigation are based on external dependency and require external annotations or auxiliary models for preference data collection. |
| Approach: | a new method is proposed to help model-generated hallucinations without external dependencies. |
| Outcome: | a new method that self-injects hallucinations into a generated response improves halluuutations mitigation. |
Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps (2025.findings-acl)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) has emerged as a prominent technique for fine-tuning large foundation models. |
| Approach: | They propose a low-rank Adaptation technique that harnesses the expressiveness of spectral bases to re-parameterize LoRA from a sparse spectral subspace. |
| Outcome: | The proposed technique achieves greater efficiency with fewer parameters than baselines on various downstream tasks, including commonsense reasoning, math reasoning, and code generation. |
Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation (2026.findings-acl)
Copied to clipboard
Zhiheng Li, Zongyang Ma, Yuntong Pan, Ziqi Zhang, Xiaolei Lv, Bo Li, Jun Gao, Jianing Zhang, Chunfeng Yuan, Bing Li, Weiming Hu
| Challenge: | Multimodal Large Language Models (MLLMs) are increasingly being deployed as content moderators . however, they exploit the Human-AI capability gap and create adversarial environments . smuggling attacks exploit the human-AI gap and exploit the vulnerability . |
| Approach: | They construct a benchmark to evaluate the vulnerability of MLLMs as content moderators . they identify three root causes: limited capabilities of vision encoders, robustness gap in OCR . |
| Outcome: | The proposed model exploits the Human-AI capability gap and is vulnerable to smuggling attacks. |
Parameter-Efficient Fine-Tuning via Circular Convolution (2025.findings-acl)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) has gained popularity for fine-tuning large foundation models, but its intrinsic low-rank characteristic may limit its performance. |
| Approach: | They propose a low-rank adaptive method that uses low-ranked matrices to represent weight changes. |
| Outcome: | The proposed method reduces trainable parameters and mitigates heavy memory consumption associated with full delta matrices by sequentially multiplying mathbf A and mathbb B with the activation. |