Papers by Zhuoyi Yang
Parameter-Efficient Tuning Makes a Good Classification Head (2022.emnlp-main)
Copied to clipboard
| Challenge: | In recent years, pretrained models revolutionized the paradigm of natural language understanding . but the final-layer output of the backbone, i.e. the input of the classification head, will change greatly during finetuning . |
| Approach: | They propose to append a randomly initialized classification head after the pretrained backbone and finetune the whole model. |
| Outcome: | The proposed classification head can be replaced with the randomly initialized heads for a stable performance gain. |
Connecting the Dots: Inferring Patent Phrase Similarity with Retrieved Phrase Graphs (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for inferring patent phrase similarity do not perform satisfactorily . et al., 2010: patents are pivotal to innovation, safeguarding novel ideas . |
| Approach: | They propose a graph-augmented approach to amplify patent phrase contextual information . they construct a phrase graph that links to patents cited by or cited in patents for each phrase . |
| Outcome: | The proposed approach significantly improves the representation of patent phrases in a self-supervised fashion. |