Papers by Gangwei Jiang
What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in reasoning with large language models have popularized Long Chain-of-Thought (LCoT) a framework that converts sequential LCoTs into hierarchical tree structures enables deeper structural analysis of LLM reasoning. |
| Approach: | They propose a framework that converts sequential LCoTs into hierarchical tree structures and enables deeper structural analysis of LLM reasoning. |
| Outcome: | The proposed framework can be used to analyze LLM reasoning in a variety of tasks and models. |
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to improve the performance of lifelong prompt tuning are limited due to inherent challenges. |
| Approach: | They propose a similarity heuristic lifelong prompt tuning framework that partitions tasks into two distinct subsets by harnessing a learnable similarity measure. |
| Outcome: | The proposed framework outperforms state-of-the-art techniques in lifelong learning benchmarks and demonstrates robustness against negative transfer in diverse task sequences. |
Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompts (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Continual pre-training has been used for a multitude of domains and tasks . a continually pre-trained model can show a non-decreasing performance on unseen domains . |
| Approach: | They propose a method that generates domain-specific prompts by agreement and disagreement losses. |
| Outcome: | The proposed method achieves improvements of 3.57% and 3.4% on two real-world datasets. |
Understanding and Patching Compositional Reasoning in LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | LLMs have marked a revolutonary shift, yet they falter when faced with compositional reasoning tasks. |
| Approach: | They propose a lightweight method to patch compositional reasoning errors via editing the located MHSA modules in LLMs. |
| Outcome: | The proposed method can be used to patch compositional reasoning errors using MHSA modules located within the layers of the LLMs. |