Papers by Houyu Zhang
GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models (2025.findings-emnlp)
Copied to clipboard
Jialin Chen, Houyu Zhang, Seongjun Yun, Alejandro Mottini, Rex Ying, Xiang Song, Vassilis N. Ioannidis, Zheng Li, Qingjun Cui
| Challenge: | Existing graph RAGs decouple retrieval and reasoning processes, preventing adaptability . existing graph Raggings depend heavily on ground-truth entities, which are often unavailable in open-domain settings. |
| Approach: | They propose a graph retriever that is trained end-to-end with large-scale graphs . structure and semantic features are encoded via soft tokens and the verbalized graph . |
| Outcome: | The proposed approach improves the performance of large-scale graph retrieval models by grounding it with external knowledge. |
Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models that generate natural language responses for conversations degenerate dull and repetitive contents, leading to off-topic and useless responses. |
| Approach: | They propose a conversation generation model which leverages commonsense knowledge graphs to explicitly model conversation flows by grounding conversations to the concept space. |
| Outcome: | Experiments on Reddit conversations show that the proposed model generates more semantic and informative responses while using 70% fewer parameters. |
On-Policy Self-Distillation for Efficient Diffusion Language Models with Early-Stage Calibration (2026.findings-acl)
Copied to clipboard
Huaisheng Zhu, MingYu Liu, Junze Liu, Zhen Ge, Tian Wang, Jiri Gesi, Dakuo Wang, Weiqi Zhang, Houyu Zhang, Yufan Guo, Xian Li, Bing Yin, Sujay Sanghavi
| Challenge: | Recent studies have demonstrated that masked diffusion models (MDMs) can surpass autoregressive models (ARMs) in various tasks. |
| Approach: | They propose a method to calibrate early token predictions without demonstration data by distilling an unnormalized target distribution into the original model. |
| Outcome: | Experiments on math, planning, and RLHF tasks show that COPSD improves both effectiveness and efficiency, and further enhances performance when combined with supervised fine-tuning. |