Papers by James O’Neill
Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models (2023.acl-short)
Copied to clipboard
| Challenge: | Existing methods for quantization-aware training and quantization for learning have limitations in dealing with accumulative quantization errors. |
| Approach: | They propose a method that minimizes accumulative quantization errors and outperforms baselines by distilling knowledge from a fine-tuned teacher network. |
| Outcome: | The proposed method minimizes accumulative quantization errors and outperforms baselines on the XGLUE benchmark. |
I Wish I Would Have Loved This One, But I Didn’t – A Multilingual Dataset for Counterfactual Detection in Product Review (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using machine translation, counterfactual statements are often found in natural languages. |
| Approach: | They annotate a multilingual CFD dataset from Amazon product reviews covering counterfactuals written in English, German, and Japanese languages. |
| Outcome: | The proposed dataset is robust against selection biases due to cue phrase-based sentence selection. |