Papers by Frederick Liu
Incorporating Priors with Feature Attribution on Text Classification (P19-1)
Copied to clipboard
| Challenge: | Feature attribution methods are used to help users interpret complex models. |
| Approach: | They propose a feature attribution method that integrates feature attributed features into the objective function to allow machine learning practitioners to incorporate priors in model building. |
| Outcome: | The proposed method reduces undesired model biases without a tradeoff on the original task and improves classifier performance in scarce data setting. |
Handling Homographs in Neural Machine Translation (N18-1)
Copied to clipboard
| Challenge: | Existing methods for MT have problems with translating homographs, as it is difficult to select the correct translation based on the context. |
| Approach: | They propose to model the context of the input word with context-aware word embeddings that help to differentiate the word sense before feeding it into the encoder. |
| Outcome: | The proposed models improve translation accuracy and BLEU score on three language pairs. |
Towards Tracing Knowledge in Language Models Back to the Training Data (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on training data attribution (TDA) may offer effective tools for identifying such examples, known as "proponents". |
| Approach: | They propose a benchmark to identify which training examples taught an LM to generate a particular factual assertion. |
| Outcome: | The proposed methods have lower proponent-retrieval precision than baselines that do not have access to the LM. |