Papers by Zhuohao Chen
Towards end-2-end learning for predicting behavior codes from spoken utterances in psychotherapy conversations (2020.acl-main)
Copied to clipboard
| Challenge: | Xu and Sarikaya, 2014) proposes a framework for predicting utterance level labels directly from speech features. |
| Approach: | They propose a framework for predicting utterance level labels directly from speech features using a pretrained Speech-2-Vector encoder as bottleneck. |
| Outcome: | The proposed model outperforms state-of-the-art approaches which use transcribed text for the task of predicting psychotherapy-relevant behavior codes. |
Leveraging Open Data and Task Augmentation to Automated Behavioral Coding of Psychotherapy Conversations in Low-Resource Scenarios (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Behavioral coding is a procedure that requires human intervention to be performed manually. |
| Approach: | They propose to use a publicly available conversation-based dataset to transfer knowledge to a low-resource behavioral coding task by meta-learning. |
| Outcome: | The proposed framework predicts target behaviors more accurately than baseline models. |
Leveraging Task Transferability to Meta-learning for Clinical Section Classification with Limited Data (2022.acl-long)
Copied to clipboard
| Challenge: | Existing text classification systems require thousands of in-domain text data to achieve high performance. |
| Approach: | They propose an algorithm to improve task transferability of meta-learning-based text classification by normalizing negative conditional entropy from source task data to boost cross-domain meta- learning accuracy. |
| Outcome: | The proposed method improves section classification accuracy significantly compared to meta-learning algorithms. |
Linking Knowledge to Care: Knowledge Graph-Augmented Medical Follow-Up Question Generation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) fail to identify information gaps across diverse symptoms. |
| Approach: | They propose a Knowledge Graph-augmented LLM with active in-context learning to generate relevant and important follow-up questions. |
| Outcome: | The proposed framework outperforms state-of-the-art methods by 5% - 8% on relevant benchmarks. |
TextBox 2.0: A Text Generation Library with Pre-trained Language Models (2022.emnlp-demos)
Copied to clipboard
Tianyi Tang, Junyi Li, Zhipeng Chen, Yiwen Hu, Zhuohao Yu, Wenxun Dai, Wayne Xin Zhao, Jian-yun Nie, Ji-rong Wen
| Challenge: | TextBox 2.0 focuses on the use of pre-trained language models (PLMs) to generate text. |
| Approach: | They propose a library that integrates pre-trained language models into 13 common text generation tasks and 83 datasets. |
| Outcome: | The proposed library covers 13 common text generation tasks and their corresponding datasets and incorporates 45 PLMs covering general, translation, Chinese, dialogue, controllable, distilled, prompting, and lightweight PLM. |
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021.acl-demo)
Copied to clipboard
Junyi Li, Tianyi Tang, Gaole He, Jinhao Jiang, Xiaoxuan Hu, Puzhao Xie, Zhipeng Chen, Zhuohao Yu, Wayne Xin Zhao, Ji-Rong Wen
| Challenge: | TextBox is an open-source text generation framework that is modularized and extensible. |
| Approach: | They propose to provide a unified, modularized, and extensible text generation framework that implements 21 text generation models on 9 benchmark datasets. |
| Outcome: | The proposed framework implements 21 models on 9 benchmark datasets and is available under the Apache License 2.0 license. |
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models (2022.naacl-main)
Copied to clipboard
Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Xin Zhao, Ji-Rong Wen
| Challenge: | Recent years have featured a trend towards Transformer based pretrained language models (PLMs) in natural language processing systems. |
| Approach: | They propose to use four evaluation dimensions to evaluate ten widely-used PLMs . they find that pretrained language models are good at different ability tests . |
| Outcome: | The results show that pretrained language models are good at different ability tests and have excellent transferability between tasks. |