Papers by Olivia Huang
Incorporating Worker Perspectives into MTurk Annotation Practices for NLP (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to data collection for natural language processing on Amazon Mechanical Turk (MTurk) are susceptible to issues regarding workers’ rights and poor response quality without considering the perspectives of MTurq workers. |
| Approach: | They conducted a critical literature review and a survey of MTurk workers to address open questions regarding fair payment, worker privacy, data quality, and considering worker incentives. |
| Outcome: | The findings suggest that future studies may better account for MTurk workers’ experiences in order to respect workers' rights and improve response quality. |