Papers by Zhilong Ji
MuMath: Multi-perspective Data Augmentation for Mathematical Reasoning in Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) that integrate with external Python interpreters are not able to demonstrate the calculation process, which compromises user-friendliness and understanding of problem-solving steps. |
| Approach: | They propose to use LLaMA-2 to refine LLti-perspective augmentation methods to improve performance. |
| Outcome: | The proposed model achieves 88.3% on GSM8K and 34.5% on MATH. |
Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large vision-language models are often not open-source due to preventing abuse or commercial factors. |
| Approach: | They propose a method for parameter-efficient fine-tuning to improve model accessibility . large models are often not open-source due to preventing abuse or commercial factors . they propose implementing a lightweight adapter over the output feature of an inaccessible model . |
| Outcome: | The proposed methods improve on 11 benchmarks and are made publicly available. |
MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | a method to combine the advantages of open-source and tool-free LLMs remains to be explored. |
| Approach: | They propose a method to integrate open-source LLMs with external Python interpreters and augment math reasoning data. |
| Outcome: | The proposed method improves on GSM8K and MATH with the use of external tools. |
Enhancing Multimodal Continual Instruction Tuning with BranchLoRA (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to fine tune Multimodal Large Language Models (MLLMs) are prone to Catastrophic Forgetting (CF) existing approaches rely on the Mixture-of-Experts (MoE) LoRA framework to preserve previous instruction alignments. |
| Approach: | They propose an asymmetric tuning-freezing mechanism to mitigate parameter inefficiency . branch-specific routers are introduced to ensure optimal branch distribution over time . |
| Outcome: | The proposed framework outperforms existing frameworks on the latest MCIT benchmarks. |