Papers by Alexandra Schofield
Integrating Ethics into the NLP Curriculum (2020.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to teach students how to ethically apply NLP . the tutorial will focus on examples for university classrooms, but ideas can extend to company-internal workshops or tutorials in a variety of organizations. |
| Approach: | a tutorial aims to empower NLP researchers and practitioners to teach others about ethical NLP . the tutorial will focus on examples for university classrooms, but ideas can extend to company-internal workshops . |
| Outcome: | a tutorial aims to teach students how to ethically apply NLP techniques . the tutorial will include examples for university classrooms, but ideas can extend to company-internal workshops . |
More Than Words: Collocation Retokenization for Latent Dirichlet Allocation Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Latent Dirichlet Allocation models ingest words to discover their latent topics . but it is unclear how to achieve the best results for languages without marked word boundaries . |
| Approach: | They propose to use retokenization to merge frequent token ngrams into collocations in input to a Latent Dirichlet Allocation model. |
| Outcome: | The proposed model improves topic coherence and coherency in Chinese and Thai . the proposed model is more coherent and clearer than unmerged models . |
How effective is BERT without word ordering? Implications for language understanding and data privacy (2021.acl-short)
Copied to clipboard
| Challenge: | Ordered word sequences contain the rich structures that define language. |
| Approach: | They show that token representations and self-attention activations within BERT are resilient to shuffling the order of input tokens. |
| Outcome: | The proposed model is able to handle shuffled token representations and self-attention activations . the model can handle GLUE language understanding tasks with bag-of-words data . |