Papers by Chengguang Tang
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Mainstream approaches to aligning large language models heavily rely on human preference data. |
| Approach: | They propose a framework that fine-tunes a policy model using pairwise feedback data automatically mined from its outputs. |
| Outcome: | The proposed framework outperforms the base model with an average win rate of 69.7% across seven conversational or instruction-following datasets. |
xDial-Eval: A Multilingual Open-Domain Dialogue Evaluation Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, human evaluation is the most reliable way to holistically judge the quality of the dialogue. |
| Approach: | They propose to use English dialogue evaluation metrics to generalize them to other languages. |
| Outcome: | The proposed metrics outperform OpenAI’s ChatGPT in terms of average Pearson correlations over all datasets and languages. |
Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment (2020.acl-main)
Copied to clipboard
| Challenge: | Existing end-to-end dialog systems perform less effectively when data is scarce. |
| Approach: | They propose a Meta-Dialog System which combines meta-learning and human-machine collaboration to improve dialog learning by a new extended-bAbI dataset and a transformed MultiWOZ dataset. |
| Outcome: | The proposed system outperforms non-meta-learning baselines on a new extended-bAbI dataset and a transformed MultiWOZ dataset for low-resource goal-oriented dialog learning. |