Papers by Qizhe Xie
From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction (P18-1)
Copied to clipboard
| Challenge: | equivalence between credit assignment problem and entropy regularized reinforcement learning is established . a wide range of successful sequence prediction algorithms have been developed . |
| Approach: | They propose to extend credit assignment in reward augmented maximum likelihood learning by credit assignment and entropy regularization. |
| Outcome: | The proposed algorithms outperform RAML and Actor-Critic on two benchmark datasets. |
Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Recent research on test-time adaptation suggests a possible way to improve the generalization ability of LLMs. |
| Approach: | They propose to use multi-armed bandit learning and multi-arm dueling bandits to solve a multi-source test-time model adaptation problem from user feedback. |
| Outcome: | The proposed model is more effective than other strong baselines on extractive question answering datasets. |
Large-scale Cloze Test Dataset Created by Teachers (D18-1)
Copied to clipboard
| Challenge: | Existing cloze tests are used to evaluate language proficiency in language exams, but they are not yet available. |
| Approach: | They propose to create a large-scale human-created cloze test dataset CLOTH, which contains questions used in middle-school and high-school language exams. |
| Outcome: | The proposed dataset outperforms existing models and shows that humans outperformed existing models by a significant margin. |