Papers by Jing Sha
Enhancing Chain-of-Thought Reasoning via Neuron Activation Differential Analysis (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing external components of CoT, but lack internal explanations for the quality of the model's outputs. |
| Approach: | They propose an efficient method to identify reasoning-critical neurons by analyzing their activation patterns under reasoning chains of varying quality. |
| Outcome: | The proposed method shows that neurons in the feed-forward layers are critical in the generation of high-quality reasoning chains. |
MMATH: A Multilingual Benchmark for Mathematical Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a benchmark for multilingual complex reasoning spans 374 high-quality math problems across 10 typologically diverse languages. |
| Approach: | They propose a benchmark for multilingual complex reasoning across 10 languages . they show reasoning in English and answering in target languages can enhance performance . |
| Outcome: | The proposed benchmark demonstrates that models with high-quality reasoning can perform in multiple languages. |
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)
Copied to clipboard
Qibing Ren, Hao Li, Dongrui Liu, Zhanxu Xie, Xiaoya Lu, Yu Qiao, Lei Sha, Junchi Yan, Lizhuang Ma, Jing Shao
| Challenge: | Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms. |
| Approach: | They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content. |
| Outcome: | The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs. |
Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning with benign data can compromise safety of aligned LLMs. |
| Approach: | They propose a Layer-Aware Representation Filtering method that detects safety-degrading layers within the LLM and leverages their representations to detect them. |
| Outcome: | The proposed method can detect safety-degrading features in benign data and remove them from the model. |
Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network (2022.acl-long)
Copied to clipboard
| Challenge: | a fundamental challenge in modeling math problems is how to fuse semantics of textual description and formulas. |
| Approach: | They propose a method to continually pre-train language models for improving understanding of math problems with syntax-aware memory networks. |
| Outcome: | The proposed approach outperforms competitive baselines on four math tasks. |
Towards Harmonized Uncertainty Estimation for Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated exceptional capabilities in handling a wide range of downstream tasks. |
| Approach: | They propose a method that employs a lightweight model trained on data aligned with the target LLM’s performance to adjust uncertainty scores. |
| Outcome: | The proposed method achieves improvements of up to 60% over existing methods. |