Papers by Leanne Rolston
OpenEL: An Annotated Corpus for Entity Linking and Discourse in Open Domain Dialogue (2022.lrec-1)
Copied to clipboard
| Challenge: | Named entity recognition (NER), named entity linking and discourse modeling are crucial aspects of natural language understanding for open domain dialogue systems. |
| Approach: | They present an annotated multi-domain corpus for linking entities in open-domain dialogue . they use dialogue context and anaphora resolution to assess the effectiveness of the task . |
| Outcome: | The OpenEL corpus is an annotated multi-domain corpus for linking entities in open-domain dialogue . the system Flair + BLINK has the best performance with a 0.65 F1 score . |
The economic trade-offs of large language models: A case study (2023.acl-industry)
Copied to clipboard
Kristen Howell, Gwen Christian, Pavel Fomitchov, Gitit Kehat, Julianne Marzulla, Leanne Rolston, Jadin Tredup, Ilana Zimmerman, Ethan Selfridge, Joseph Bradley
| Challenge: | Large Language Models (LLMs) are a natural fit for contact-based customer service, but their efficacy must be balanced with the cost of training and serving them. |
| Approach: | They propose a cost framework for evaluating an NLP model’s utility for the enterprise as a function of the usefulness of the responses that they generate. |
| Outcome: | The proposed model can be used to help human agents handle complex customer service calls and can be modified to improve their performance. |