Papers by Jack Williams
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Social biases present in data are often directly reflected in the predictions of models trained on that data. |
| Approach: | They analyze gender bias in dialogue data and propose techniques to mitigate it . they use counterfactual data augmentation, targeted data collection, and bias controlled training . |
| Outcome: | The proposed techniques mitigate gender bias by balancing genderedness of generated dialogue utterances. |
Solving Data-centric Tasks using Large Language Models (2024.findings-naacl)
Copied to clipboard
Shraddha Barke, Christian Poelitz, Carina Negreanu, Benjamin Zorn, José Cambronero, Andrew Gordon, Vu Le, Elnaz Nouri, Nadia Polikarpova, Advait Sarkar, Brian Slininger, Neil Toronto, Jack Williams
| Challenge: | Large language models are increasingly useful for data-centric tasks, but how do we decide how much data to include in the prompt? |
| Approach: | They propose a cluster-then-select prompting technique that adds the most representative rows from the input data to the LLM prompt. |
| Outcome: | The proposed technique outperforms a baseline for tasks with syntactic variation in the input table. |
Robustness of Named-Entity Replacements for In-Context Learning (2023.findings-emnlp)
Copied to clipboard
Saeed Goodarzi, Nikhil Kagita, Dennis Minn, Shufan Wang, Roberto Dessi, Shubham Toshniwal, Adina Williams, Jack Lanchantin, Koustuv Sinha
| Challenge: | Modern large language models perform in-context learning, where query- answer demonstrations are shown before the final query. |
| Approach: | They propose to use in-context learning to prompt queries before they are answered . they find that the choice of demonstrations can affect model performance . |
| Outcome: | The proposed model performance improves on named entity replacements across three reasoning tasks and two popular LLMs. |