Papers by Rebecca Marvin
Perceptual Models of Machine-Edited Text (2021.findings-acl)
Copied to clipboard
| Challenge: | a dataset of human judgments of machine-edited text is presented . we compare six different methods to create generic models of human perception . |
| Approach: | They propose to use six machine-editing methods to model human perceptions of edited text . they use a dataset of human judgments of machine-edited text and scientific abstracts . |
| Outcome: | The proposed model is based on human judgments of machine-edited text and scientific abstracts . human judgment of edited text is predicted to be within 6% of human consensus labeling . |
Targeted Syntactic Evaluation of Language Models (D18-1)
Copied to clipboard
| Challenge: | Recent advances have led to an explosion of neural network-based LM architectures. |
| Approach: | They propose to supplement perplexity with a metric that assesses whether a language model can predict the grammatical sentence more accurately than an ungrammatically-based model. |
| Outcome: | The proposed model performed poorly on many of the constructions. |