Papers by Derek Tam
Optimal Transport-based Alignment of Learned Character Representations for String Similarity (P19-1)
Copied to clipboard
| Challenge: | String similarity models are crucial for record linkage, data integration, search and entity resolution systems. |
| Approach: | They propose a model that encodes the characters of each string, aligns the encodings using Sinkhorn Iteration and scores the alignment with a convolutional neural network. |
| Outcome: | The proposed model outperforms state-of-the-art and classical similarity models on four of the five datasets and improves performance by applying it to cross-document coreference. |
Evaluating the Factual Consistency of Large Language Models Through News Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs generally assign a higher score to factually consistent summaries than to factualally inconsistent summary. |
| Approach: | They propose a benchmark to measure whether large language models prefer factually consistent continuations of inputs. |
| Outcome: | The proposed benchmark compares the scores an LLM assigns to a factually consistent versus a inconsistent summary for an input news article. |
Improving and Simplifying Pattern Exploiting Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that pre-trained language models can learn well when primed with only a few labeled examples. |
| Approach: | They propose a method that uses task-specific unlabeled data to provide denser supervision during fine-tuning. |
| Outcome: | The proposed approach outperforms GPT-3 on SuperGLUE without any unlabeled data. |
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing data efficiency in limited labeled data are limited. |
| Approach: | They propose to use data augmentation methods to increase the efficiency of limited data learning in NLP. |
| Outcome: | The proposed methods perform well on topics/news classification, inference tasks, paraphrasing tasks, and single-sentence tasks. |