Papers by Bowei He
Bi-Chainer: Automated Large Language Models Reasoning with Bidirectional Chaining (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing unidirectional chaining methods suffer from low prediction accuracy and efficiency. |
| Approach: | They propose a bidirectional chaining method which dynamically switches to depth-first reasoning in the opposite reasoning direction when it encounters multiple branching options within the current direction. |
| Outcome: | The proposed method achieves sizable accuracy boots over unidirectional chaining frameworks on four challenging logical reasoning datasets. |
Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical Scenarios (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot Spoken Language Understanding models need to be trained on a set of data-rich source domains and adapt to the target domain with a few examples. |
| Approach: | They propose a scenario where only a pre-trained language model and a few labeled examples are used to train few-shot SLU models. |
| Outcome: | The proposed model outperforms existing models on few-shot settings by reducing the number of slot labels and reducing training complexity. |
DSPM-NLG: A Dual Supervised Pre-trained Model for Few-shot Natural Language Generation in Task-oriented Dialogue System (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for few-shot natural language generation are based on a dual correlation between NLG and SLU from the perspective of probability. |
| Approach: | They propose a dual supervised pre-trained model to regularize the pre-training process . they use a probabilistic approach to learn the dual correlation between NLG and SLU . |
| Outcome: | The proposed model outperforms the previous state-of-the-art models on a few-shot dataset. |
NILE: Internal Consistency Alignment in Large Language Models (2025.emnlp-main)
Copied to clipboard
Minda Hu, Qiyuan Zhang, Yufei Wang, Bowei He, Hongru Wang, Jingyan Zhou, Liangyou Li, Yasheng Wang, Chen Ma, Irwin King
| Challenge: | Recent advances show that the world knowledge in the Instruction Fine-Tuning (IFT) dataset, which is incompatible with LLMs’ internal knowledge, can greatly hurt the IFT performance. |
| Approach: | They propose a framework to optimize the effectiveness of IFT by carefully aligning the world and internal knowledge of LLMs. |
| Outcome: | The proposed framework can significantly improve performance across multiple LLM ability evaluation datasets. |
Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing task vector-based model merging methods apply uniform coefficients across all parameters, overlooking varying parameter importance both within and across tasks. |
| Approach: | They propose a sensitivity-guided coefficient adjustment method that optimizes existing model merging techniques by operating at both task-specific and cross-task levels. |
| Outcome: | The proposed method outperforms existing model merging techniques on mistral 7B and LLaMA2 7B/13B models and enables them to outperformed specialized models. |
Router-Tuning: A Simple and Effective Approach for Dynamic Depth (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve computational efficiency are under-explored and face several critical challenges. |
| Approach: | They propose a method that selectively activates only a subset of the model's layers, skipping those deemed less important. |
| Outcome: | The proposed method significantly improves performance on Attention layers and MoE layers while reducing redundant computation and memory usage. |