Papers by Shansan Gong
BBA: Bi-Modal Behavioral Alignment for Reasoning with Large Vision-Language Models (2024.findings-acl)
Copied to clipboard
Xueliang Zhao, Xinting Huang, Tingchen Fu, Qintong Li, Shansan Gong, Lemao Liu, Wei Bi, Lingpeng Kong
| Challenge: | Multimodal reasoning is a key capability for large vision-language models . however, the vanilla Chain-of-Thought method fails to address critical steps in multi-step reasoning tasks. |
| Approach: | They propose a bi-modal Behavioral Alignment method to augment multimodal reasoning . they use domain-specific language to integrate multimodal information into a precise alternative form . |
| Outcome: | The proposed method significantly improves GPT-4V(ision) on geometry problem solving, chess positional advantage prediction and molecular property prediction. |
Design Choices for Extending the Context Length of Visual Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing open-source Visual Language Models lack systematic exploration into extending their context length, and commercial models often provide limited details. |
| Approach: | They propose to extend Visual Language Models (VLMs) to 128K lengths and open-source the code, data, and models. |
| Outcome: | The proposed model is based on the Qwen-VL series model and is competitive with commercial model GPT-4V. |
Long Chain-of-Thought Fine-tuning via Understanding-to-Reasoning Transition (2025.emnlp-main)
Copied to clipboard
Chenxin An, Zhihui Xie, Xiaonan Li, Ming Zhong, Shansan Gong, Lei Li, Jun Zhang, Jingjing Xu, Lingpeng Kong
| Challenge: | Existing research on long-context scaling in language models has focused on managing lengthy input prompts instead of producing long outputs. |
| Approach: | They propose a sequence-level curriculum learning framework that shifts a model’s focus from interpreting long chain-of-thoughts to generating them. |
| Outcome: | Experiments on rigorous reasoning benchmarks, including AIME24 and GPQA Diamond, show that the proposed approach surpasses standard fine-tuning by over 10% while maintaining robust performance on understanding tasks. |
EconProver: Towards More Economical Test-Time Scaling for Automated Theorem Proving (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have recently advanced the field of Automated Theorem Proving (ATP) Existing cost analyses regulate only the number of sampling passes, ignoring the substantial disparities in sampling costs. |
| Approach: | They propose to integrate two complementary methods into a unified EconRL pipeline to increase pass rates under constrained sampling passes. |
| Outcome: | The proposed method reduces token usage and sample passes while maintaining the original performance. |
DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to text generation use discrete text within a continuous diffusion space, which incurs substantial computational overhead during training and results in slower sampling speeds. |
| Approach: | They propose a soft absorbing state that facilitates diffusion models in learning to reconstruct discrete mutations based on the underlying Gaussian space. |
| Outcome: | The proposed method accelerates training convergence by 4x and generates samples of similar quality 800x faster, rendering it closer to practical application. |
Transferable and Efficient: Unifying Dynamic Multi-Domain Product Categorization (2023.acl-industry)
Copied to clipboard
| Challenge: | e-commerce platforms are encountering increasingly complex product categorization scenarios . multiple business domains correspond to different category taxonomies, with different depths and distinct literal expressions of category names. |
| Approach: | They propose a taxonomy-agnostic framework that calculates semantic relatedness between product titles and category names in the vector space. |
| Outcome: | The proposed framework outperforms strong baselineson three dynamic multi-domain product categorization tasks. |