Papers by Steven Bedrick
We Need to Talk about Standard Splits (P19-1)
Copied to clipboard
| Challenge: | Existing methods to evaluate systems with a held-out test set are insufficient for system comparison. |
| Approach: | They propose to use multiple random splits to compare performance of systems . they replicate results on standard split but fail to reproduce some rankings . |
| Outcome: | The proposed method is based on multiple random splits to replicate results with a set of part-of-speech taggers. |
Refocusing on Relevance: Personalization in NLG (2021.emnlp-main)
Copied to clipboard
| Challenge: | a number of negative effects exist when NLG systems are not grounded to a specific input text. |
| Approach: | They argue that NLG systems should focus on making use of additional context . they argue that relevance should be thought of as a crucial tool for user-oriented text-generating tasks . |
| Outcome: | The proposed approach is more of the rule than the exception, the authors argue . they argue that value-sensitive design represents a crucial path forward . |