Papers by Mugdha Pandya
Intrinsic Bias Metrics Do Not Correlate with Application Bias (2021.acl-long)
Copied to clipboard
| Challenge: | a recent survey of bias in natural language processing found that a coreference system makes more errors in an anti-stereotypical coreferent than in a pro-sterereotype one. |
| Approach: | They compare intrinsic and extrinsic bias metrics across hundreds of trained models . they urge researchers to focus on extrindic measures of bias, not easy to measure . |
| Outcome: | a new intrinsic metric and an annotated test set on gender bias in hate speech are tested . authors urge researchers to focus on extrinsic measures of bias, and to make them more feasible . |
Dimensions of Online Conflict: Towards Modeling Agonism (2023.findings-emnlp)
Copied to clipboard
Matt Canute, Mali Jin, Hannah Holtzclaw, Alberto Lusoli, Philippa Adams, Mugdha Pandya, Maite Taboada, Diana Maynard, Wendy Hui Kyong Chun
| Challenge: | agonism fosters robust discussions, but hateful antagonism undermines constructive dialogue . a new study analyzes Twitter conversations to identify different dimensions of conflict . |
| Approach: | They annotated Twitter conversations related to trending controversial topics to model conflict on a richly annotized dataset. |
| Outcome: | The proposed model can help to moderate online conflicts and improve content monetization. |