Papers by Zhichao Geng
A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation (2022.findings-acl)
Copied to clipboard
Tianxiang Sun, Xiangyang Liu, Wei Zhu, Zhichao Geng, Lingling Wu, Yilong He, Yuan Ni, Guotong Xie, Xuanjing Huang, Xipeng Qiu
| Challenge: | Existing methods to measure instance difficulty use generalization and threshold-tuning . a new approach to learn to exit is based on hash functions to assign tokens to a fixed exiting layer. |
| Approach: | They propose a Hash-based Early Exiting approach that replaces learn-to-exit modules with hash functions to assign each token to a fixed exiting layer. |
| Outcome: | The proposed approach improves on learning to exit and predicting instance difficulty. |
Improving Abstractive Dialogue Summarization with Speaker-Aware Supervised Contrastive Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing summarization systems based on pre-trained models cannot recognize the unique format of the speaker-utterance pair well in the dialogue. |
| Approach: | They propose three speaker-aware supervised contrastive learning tasks to solve the speaker identification problem in dialogue summarization task. |
| Outcome: | The proposed methods improve on two mainstream dialogue summarization datasets. |
fastHan: A BERT-based Multi-Task Toolkit for Chinese NLP (2021.acl-demo)
Copied to clipboard
| Challenge: | Recently, the need for Chinese natural language processing (NLP) has a dramatic increase for many downstream applications. |
| Approach: | They propose to use Chinese word segmentation (CWS), Part-of-Speech (POS) tagging, named entity recognition (NER), and dependency parsing to train a multi-task model based on a pruned BERT. |
| Outcome: | The proposed model performs better than popular segmentation tools on a non-training corpus. |