Papers by Paul Michel
MTNT: A Testbed for Machine Translation of Noisy Text (D18-1)
Copied to clipboard
| Challenge: | Noisy input text can cause disastrous mistranslations in most modern machine translation systems. |
| Approach: | They propose a benchmark dataset for Machine Translation of Noisy Text (MTNT) they use reddit comments and professionally sourced translations to examine noise types. |
| Outcome: | The proposed dataset can provide an attractive testbed for noise-robust machine translation systems. |
On Evaluation of Adversarial Perturbations for Sequence-to-Sequence Models (N19-1)
Copied to clipboard
| Challenge: | Existing methods for assessing the robustness of sequence-to-sequence models have been ignored by the literature. |
| Approach: | They propose an evaluation framework for adversarial attacks on seq2seq models that takes the semantic equivalence of the pre- and post-perturbation input into account. |
| Outcome: | The proposed framework breaks the assumption that source perturbations should not result in changes in the expected output, but allows for meaning-preserving perturbations that change the output sequence. |
Extreme Adaptation for Personalized Neural Machine Translation (P18-2)
Copied to clipboard
| Challenge: | Existing models that capture speaker-related variations do not include explicit information about the speaker. |
| Approach: | They propose a method that adapts the bias of the output softmax to each particular user . they propose to model speaker-related variations as an additional bias vector in the softmax layer . |
| Outcome: | The proposed technique improves translation accuracy and better reflection of speaker traits in target text. |
Countering Reward Over-Optimization in LLM with Demonstration-Guided Reinforcement Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches address ROO by adding KL regularization, requiring computationally expensive hyperparameter tuning. |
| Approach: | They propose a reinforcement learning approach that leverages human demonstrations and a reward model to recalibrate the reward objective. |
| Outcome: | The proposed approach achieves comparable performance to carefully tuned baselines while mitigating ROO in three RL language tasks. |
compare-mt: A Tool for Holistic Comparison of Language Generation Systems (N19-4)
Copied to clipboard
| Challenge: | Unlike machine translation, natural language outputs are nuanced and there are no clear yes/no distinctions about whether they are correct or not. |
| Approach: | They describe compare-mt, a tool for holistic analysis and comparison of the results of systems for language generation tasks such as machine translation. |
| Outcome: | The compare-mt tool is an open-source pure-python package that has already proven useful to generate analyses that have been used in our papers. |
Weight Poisoning Attacks on Pretrained Models (2020.acl-main)
Copied to clipboard
| Challenge: | Recent trends in NLP use of pre-trained weights raise security questions . authors show that pre-training weights can be injected with vulnerabilities . |
| Approach: | They propose to build "weight poisoning" attacks where pre-trained weights are injected with vulnerabilities that expose "backdoors" they outline practical defenses against such attacks. |
| Outcome: | The proposed attacks expose "backdoors" after fine-tuning models . the proposed attacks are widely applicable and pose a serious threat . |