Papers by Andrew Brown
Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model (2024.eacl-long)
Copied to clipboard
| Challenge: | Motivational Interviewing (MI) is a counselling technique used to guide people towards behaviour change. |
| Approach: | They propose a method for distilling reflections from a foundational language model into smaller models that can be owned and controlled. |
| Outcome: | The proposed method achieves 100% success rate on hold-out test set and 90% on the GPT-2 XL. |
Evaluating Language Model Character Traits (2024.findings-emnlp)
Copied to clipboard
Francis Ward, Zejia Yang, Alex Jackson, Randy Brown, Chandler Smith, Grace Colverd, Louis Thomson, Raymond Douglas, Patrik Bartak, Andrew Rowan
| Challenge: | Language models (LMs) exhibit human-like behaviour, but it is unclear how to describe this behaviour without undue anthropomorphism. |
| Approach: | They formalise a behaviourist view of LM character traits and infer belief and intent from LM behaviour, finding consistency varies with model size, fine-tuning, and prompting. |
| Outcome: | The proposed model enables us to describe LM behaviour precisely and without undue anthropomorphism. |