Papers by Shitou Zhang
HyperLoRA: Efficient Cross-task Generalization via Constrained Low-Rank Adapters Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to adapt pre-trained language models (PLMs) to emerging tasks are costly and inefficient. |
| Approach: | They propose a meta-network that generates task-specific weights without any optimization. |
| Outcome: | The proposed approach has flexible generalization ability and superior performance over hypenetworks. |
Enhancing Ancient Chinese Understanding with Derived Noisy Syntax Trees (2023.acl-srw)
Copied to clipboard
| Challenge: | Syntactic information is not used in modern Chinese understanding tasks due to the lack of syntactical annotation. |
| Approach: | They propose a confidence-based syntax encoding network to alleviate the side effects of unsupervised syntax derivation and the incompatibility between ancient and modern Chinese. |
| Outcome: | The proposed component alleviates side effects from unsupervised syntax derivation and incompatibility between ancient and modern Chinese. |