Papers by Sihao Hu
H3Fusion: Helpful, Harmless, Honest Fusion of Aligned LLMs (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to align pre-trained LLMs with instructions for one property are difficult to fine-tune. |
| Approach: | They propose a mixture-of-experts-based fusion mechanism that models alignment as a controllable drift within the subspace, guided by a drift-regularization loss to balance competing alignment dimensions. |
| Outcome: | Extensive evaluations of three benchmark datasets show that H3Fusion outperforms each individually aligned model by 11.37% and provides stronger robustness compared to the state-of-the-art LLM ensemble approaches by 13.77% and model-merging approaches by 6.18 %. |
LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversity (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Extensive evaluation of modern large language models shows performance gain over component LLMs. |
| Approach: | They propose a diversityoptimized LLM ensemble method with three unique properties . they introduce the focal diversity metric to capture diversityperformance correlation . |
| Outcome: | The proposed method outperforms the best-performing ensemble on four benchmarks. |