Papers by Jianghong Ma
AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for I-MCoT fail to capture dynamic needs of vision-language models . existing methods rely on attention signals, which are unreliable under severe granularity imbalance between brief textual query and informative image. |
| Approach: | They propose a framework that integrates specially selected visual evidence into the context of Vision-Language Models (VLMs) they propose 'AIM-CoT' to improve evidence selection and insertion triggering . |
| Outcome: | Experiments across three benchmarks and four backbones demonstrate the proposed framework’s consistent superiority. |
Asymmetric feature interaction for interpreting model predictions (2023.findings-acl)
Copied to clipboard
| Challenge: | Prior work on feature interaction attribution studies focus on asymmetric interaction that only explains the additional influence of a set of words in combination, which fails to capture asymmetry influence that contributes to model prediction. |
| Approach: | They propose an asymmetric feature interaction attribution explanation model that explores asymmetry higher-order feature interactions in the inference of deep neural NLP models. |
| Outcome: | The proposed model outperforms state-of-the-art models on two sentiment classification datasets. |