Papers by Joseph Fisher
Merge and Label: A Novel Neural Network Architecture for Nested NER (P19-1)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is one of the best studied tasks in natural language processing. |
| Approach: | They propose a neural network architecture that merges tokens and/or entities into nested entities and labels them independently. |
| Outcome: | The proposed approach achieves state-of-the-art F1 of 74.6 and improves with contextual embeddings to 82.4. |
Debiasing knowledge graph embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to train knowledge graph embeddings to be neutral to sensitive attributes such as gender have been shown to increase training time by a factor of eight or more. |
| Approach: | They propose a method where all embeddings are trained to be neutral to sensitive attributes such as gender by default using an adversarial loss. |
| Outcome: | The proposed method reduces training time by eightfold and improves accuracy. |
ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking (2022.naacl-industry)
Copied to clipboard
| Challenge: | Entity linking is the task of recognising mentions of entities in unstructured text documents and linking them to the corresponding entities in a Knowledge Base (KB) the largest public EL dataset is Wikipedia, which covers just 3% of the entities in Wikidata. |
| Approach: | They propose a model which performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass. |
| Outcome: | The proposed model outperforms state-of-the-art methods on standard datasets by an average of 3.7 F1 and can generalise to large-scale knowledge bases such as Wikidata and zero-shot entity linking. |
Improving Entity Disambiguation by Reasoning over a Knowledge Base (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work in entity disambiguation relies on a limited subset of KB facts to link entities . less common entities are prone to missing or inconsistent KB information, which is problematic for models which rely on 'one source' |
| Approach: | They propose an ED model which links entities by reasoning over a symbolic knowledge base in a fully differentiable fashion. |
| Outcome: | The proposed model outperforms state-of-the-art models on six well-established datasets by 1.3 F1 on average. |