Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution (2022.naacl-main)
Copied to clipboard
| Challenge: | a new benchmark evaluates coreference resolution systems' ability to recognize singular personal "they" we find that current systems overwhelmingly choose to resolve "they's" correctly to a singular entity or to 'a group' |
| Approach: | They propose to evaluate coreference resolution systems for singular personal "they" they use WinoNB schemas to evaluate whether they can correctly resolve singular "they". |
| Outcome: | The proposed benchmark evaluates coreference resolution systems for singular personal "they" they show that they are biased toward resolving "they", not "them" |
Similar Papers
Toward Gender-Inclusive Coreference Resolution (2020.acl-main)
Copied to clipboard
| Challenge: | a recent study shows that coreference resolution systems can be harmful to binary and non-binary trans and cis stakeholders. |
| Approach: | They propose to use gender-based crowd annotations to investigate coreference resolution biases . they use a dataset to examine the complexity of gender in crowd annotation systems . |
| Outcome: | a new study shows that without acknowledging and building systems that recognize gender, we build systems that lead to many potential harms. |
They Exist! Introducing Plural Mentions to Coreference Resolution and Entity Linking (C18-1)
Copied to clipboard
| Challenge: | Unlike singular mentions each of which represents one entity, plural mentions stand for multiple entities. |
| Approach: | They propose a novel coreference resolution algorithm that selectively creates clusters to handle both singular and plural mentions and a deep learning-based entity linking model that jointly handles both types of mentions through multi-task learning. |
| Outcome: | The proposed model outperforms existing models designed for singular mentions and plural mentions. |
Gender Bias in Coreference Resolution (N18-2)
Copied to clipboard
| Challenge: | a study of coreference resolution systems that resolve gender differences in pairs is aimed at examining implicit gender biases. |
| Approach: | They propose a Winograd schema-style set of minimal pair sentences that differ only by gender . they evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems . |
| Outcome: | The proposed system resolves a male and neutral pronoun as coreferent with "The surgeon" but does not resolve the female pronounce. |
Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods (N18-2)
Copied to clipboard
| Challenge: | Existing methods for co-reference resolution focus on gender bias. |
| Approach: | They propose a new benchmark for co-reference resolution focused on gender bias, WinoBias. |
| Outcome: | The proposed system removes the bias without significantly affecting performance on existing datasets. |
PCR4ALL: A Comprehensive Evaluation Benchmark for Pronoun Coreference Resolution in English (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing PCR systems are not reliable in real applications due to weak semantic meanings of pronouns. |
| Approach: | They propose a benchmark and toolbox that evaluates performance of PCR systems from different perspectives. |
| Outcome: | The proposed benchmark and toolbox evaluates the performance of PCR systems from different perspectives. |
Y’all should read this! Identifying Plurality in Second-Person Personal Pronouns in English Texts (D19-55)
Copied to clipboard
| Challenge: | Various languages, such as Spanish, Hebrew, or French, have different words to distinguish between singular "you" and plural "you". |
| Approach: | They train a model to distinguish between the single/plural ‘you’ in English using in-domain training. |
| Outcome: | The proposed model achieves reasonable accuracy, but there is room for improvement in the domain-transfer scenario. |
Conundrums in Entity Coreference Resolution: Making Sense of the State of the Art (2020.emnlp-main)
Copied to clipboard
| Challenge: | despite significant progress on entity coreference resolution, there is a general lack of understanding of what has been improved. |
| Approach: | They present an empirical analysis of entity coreference resolvers to provide an understanding of what has been improved. |
| Outcome: | The proposed model improves the performance of entity coreference resolvers. |
What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues (D19-1)
Copied to clipboard
| Challenge: | a core task of natural language understanding is to ground a pronoun to a visual object it refers to . problem arises when people use pronounos to refer to something they can see without prior introduction . a novel visual-aware PCR model is proposed to solve this problem . |
| Approach: | They propose a visual-aware PCR model to ground a pronoun to a visible object . they propose PCR using a large-scale dialogue dataset to investigate this problem . |
| Outcome: | The proposed model can help resolve pronouns in conversational contexts. |
On the Influence of Coreference Resolution on Word Embeddings in Lexical-semantic Evaluation Tasks (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing word embeddings rely on local information delimited by context windows or dependency parents to predict word relations. |
| Approach: | They propose to use coreference resolution to find all spans of a text that refer to the same entity to improve the F1-Scores. |
| Outcome: | The proposed methods do not benefit significantly from pronoun substitution. |
Joint Coreference Resolution and Character Linking for Multiparty Conversation (2021.eacl-main)
Copied to clipboard
| Challenge: | Character linking is the task of linking mentioned people in conversations to the real world . human use of pronouns or normal entities makes it difficult to link mentioned people to real people . a critical step towards understanding conversations is grounding mentioned people - a goal of the natural language processing community . |
| Approach: | They propose to integrate richer context from the coreference relations among different mentions to help the linking task. |
| Outcome: | The proposed model outperforms all previous models on both tasks. |