Papers by Tianfu Zhang
Distilling Large Embeddings via Hyperspherical Householder Quantization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for quantizing large embeddings rely on Euclidean quantization, which is poorly aligned with the angular geometry induced by contrastive embeddment training. |
| Approach: | They propose a geometry-aware distillation method that compresses large embeddings into short discrete representations via iterative Householder transformations on the unit hypersphere. |
| Outcome: | The proposed method reduces decoding cost and maintains strong semantic retrieval accuracy. |
Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve multi-head self-attention are lacking in many languages. |
| Approach: | They propose a redundant head enlivening method to identify redundant heads and vitalize their potential by learning syntactic relations and prior knowledge in the text. |
| Outcome: | The proposed method can identify and vitalize redundant heads without sacrificing the roles of important heads. |
Explaining Length Bias in LLM-Based Preference Evaluations (2025.findings-emnlp)
Copied to clipboard
Zhengyu Hu, Linxin Song, Jieyu Zhang, Zheyuan Xiao, Tianfu Wang, Zhengyu Chen, Nicholas Jing Yuan, Jianxun Lian, Kaize Ding, Hui Xiong
| Challenge: | a preference evaluation metric is often biased towards longer responses, revealing a reliability problem . a decomposition of the preference evaluation into two components is needed to understand this bias. |
| Approach: | They propose to decompose the preference evaluation metric into two key components . the first component is length-dependent and related to trustworthiness . |
| Outcome: | The proposed evaluation metric is based on two components: desirability and information mass. |