Papers by Fuzhen Zhuang
Exploiting Global and Local Hierarchies for Hierarchical Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods encode label hierarchy in a global view, which makes them hard to exploit hierarchical information. |
| Approach: | They propose to leverage label hierarchy in multi-label text classification by encoding label hierarchy as a static hierarchical structure containing all labels. |
| Outcome: | The proposed method achieves significant improvement on three benchmark datasets compared with the state-of-the-art method HGCLR. |
Pruning Pre-trained Language Models Without Fine-Tuning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to prune Pre-trained Language Models (PLMs) are overparameterized and require fine-tuning. |
| Approach: | They propose a pruning method that uses first-order pruning to prune PLMs while fine-tuning the remaining weights. |
| Outcome: | The proposed method outperforms first-order pruning and zero-order methods at sparsity levels. |
Scaling Sentence Embeddings with Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current methods based on contrastive learning have generated high-quality sentence embeddings. |
| Approach: | They propose a method to enhance LLM performance on sentence embeddings with a one-word limitation. |
| Outcome: | The proposed method outperforms contrastive learning methods on sentence embeddings without fine-tuning and with fine-untun. |
Incorporating Global Information in Local Attention for Knowledge Representation Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Graph Attention Networks (GATs) are a promising model that takes advantage of localized attention mechanism to perform knowledge representation learning (KRL) on graph-structure data. |
| Approach: | They propose to incorporate global information into the GAT family of models by using an attention-based global random walk algorithm. |
| Outcome: | Experimental results on KG entity prediction against the state-of-the-arts demonstrate the effectiveness of the proposed model. |
HierGR: Hierarchical Semantic Representation Enhancement for Generative Retrieval in Food Delivery Search (2025.acl-industry)
Copied to clipboard
Fuwei Zhang, Xiaoyu Liu, Xinyu Jia, Yingfei Zhang, Zenghua Xia, Fei Jiang, Fuzhen Zhuang, Wei Lin, Zhao Zhang
| Challenge: | Generative retrieval (GR) is an emerging search paradigm for food delivery search. |
| Approach: | They propose a method that harnesses the advanced query understanding capabilities of large language models to enhance the retrieval of results for complex and long-tail queries in food delivery search scenarios. |
| Outcome: | The proposed method increases the number of online orders by 0.68% for complex search intents. |
Knowledge Graph Embedding with Hierarchical Relation Structure (D18-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding models embed entities and relations into latent vectors without leveraging rich information from relation structure. |
| Approach: | They extend existing KGE models to learn knowledge representations by leveraging relation structure . authors say their approach is capable of extending other KGEs . |
| Outcome: | The proposed approach can extend existing KGE models, and validates against baselines. |
PromptBERT: Improving BERT Sentence Embeddings with Prompts (2022.emnlp-main)
Copied to clipboard
Ting Jiang, Jian Jiao, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Denvy Deng, Qi Zhang
| Challenge: | Existing research shows that BERT and RoBERTa are poor in sentence embeddings due to static token embeddable bias and ineffective BERT layers. |
| Approach: | They propose a novel contrastive learning method for better sentence embeddings by using a template denoising technique. |
| Outcome: | The proposed method achieves 2.29 and 2.58 points of improvement compared to SimCSE and RoBERTa in the unsupervised setting. |
Multi-level Relevance Document Identifier Learning for Generative Retrieval (2025.acl-long)
Copied to clipboard
Fuwei Zhang, Xiaoyu Liu, Xinyu Jia, Yingfei Zhang, Shuai Zhang, Xiang Li, Fuzhen Zhuang, Wei Lin, Zhao Zhang
| Challenge: | Existing methods generate DocIDs based on textual content, which may result in weak semantic connections for similar documents due to variations in expression. |
| Approach: | They propose a new retrieval paradigm that generates unique document identifiers . they propose to use queries as a bridge to connect documents with varying relevance levels . |
| Outcome: | The proposed approach outperforms existing methods on multilingual e-commerce search datasets. |
A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for aspect-sentiment analysis ignore internal correlations between aspect extraction and sentiment classification. |
| Approach: | They propose a hierarchical interactive network to model two-way interactions between two tasks appropriately using shallow-level and deep-level inputs. |
| Outcome: | Extensive experiments on three real-world datasets demonstrate that the proposed model outperforms existing methods. |