Papers by Barnabas Poczos
Efficient Meta Lifelong-Learning with Limited Memory (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing natural language learning models fail to continuously learn new tasks as they are re-trained throughout their lifetime. |
| Approach: | They propose a meta-lifelong framework that combines three common lifelong learning principles . they propose to store past examples in episodic memory and replay them at training and inference time . |
| Outcome: | The proposed framework achieves state-of-the-art performance using 1% memory size and narrows the gap with multi-task learning. |
Competence-based Curriculum Learning for Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Existing NMT systems require specialized heuristics and large batch sizes. |
| Approach: | They propose a curriculum learning framework for NMT that reduces training time and costs . framework consists of a principled way of deciding which training samples are shown to the model . |
| Outcome: | The proposed framework can reduce training time and improve performance of recurrent neural network models and Transformers. |
The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Factual Claim Correction rely on a verification model to guide the correction process. |
| Approach: | They propose a claim correction system that does not require a verifier but outperforms existing methods by a considerable margin. |
| Outcome: | The proposed system outperforms existing methods by a considerable margin on the SciFact dataset, 77% on SciFACT-Open and 72.75% on the CovidFact data set. |
Politeness Transfer: A Tag and Generate Approach (2020.acl-main)
Copied to clipboard
Aman Madaan, Amrith Setlur, Tanmay Parekh, Barnabas Poczos, Graham Neubig, Yiming Yang, Ruslan Salakhutdinov, Alan W Black, Shrimai Prabhumoye
| Challenge: | Prior work on text style transfer has not focused on politeness as a style transfer task and we argue that defining it is cumbersome. |
| Approach: | They propose a task of politeness transfer which involves converting non-polite sentences to polite sentences while preserving the meaning. |
| Outcome: | The proposed model outperforms state-of-the-art methods on content preservation and style transfer accuracy. |