| Challenge: | SANTO is an annotation tool designed for complex relation extraction tasks . a subset of information extraction tasks can be typed n-ary relation extraction or slot filling . |
| Approach: | They propose a domain-adaptive annotation tool for complex slot filling tasks . SANTO enables fast and clearly structured annotation for multiple users in parallel . |
| Outcome: | The proposed tool can be used for slot filling tasks and import and export procedures of standard formats enable interoperability with external sources and tools. |
Similar Papers
DERE: A Task and Domain-Independent Slot Filling Framework for Declarative Relation Extraction (D18-2)
Copied to clipboard
| Challenge: | Comparability of models across tasks is lacking in most machine learning systems for natural language processing. |
| Approach: | They propose a framework for declarative specification and compilation of template-based information extraction that uses a generic specification language for the task and for data annotations in terms of spans and frames. |
| Outcome: | The proposed framework enables representation of a large variety of natural language processing tasks. |
A Web-based Collaborative Annotation and Consolidation Tool (2020.lrec-1)
Copied to clipboard
| Challenge: | Annotation tools have a rigid structure, closed back-end and front-end, and are built in a non-user-friendly way rendering them unusable for a large cohort. |
| Approach: | They propose a web-based collaborative annotation and consolidation tool (AWOCATo) that supports varied textual formats and allows users to easily adapt to the annotation task. |
| Outcome: | AWOCATo supports a range of tasks and domains, filling the gap left by the lack of tools that can be used by people with and without programming knowledge. |
Text Annotation Graphs: Annotating Complex Natural Language Phenomena (L18-1)
Copied to clipboard
| Challenge: | Text Annotation Graphs is a web-based tool for annotating text . it provides functionality for representing complex relationships between words and word phrases . |
| Approach: | They introduce a web-based tool for annotating text, Text Annotation Graphs, or TAG . it provides functionality for representing complex relationships between words and word phrases . |
| Outcome: | The proposed software can represent complex relationships between words and words . it can also be used to find similar structures within the current document or external annotated documents. |
Neural Dependency Parsing of Biomedical Text: TurkuNLP entry in the CRAFT Structural Annotation Task (D19-57)
Copied to clipboard
| Challenge: | Syntactic analysis (parsing) is a fundamental task in natural language processing (NLP). |
| Approach: | They propose to use the Turku neural parser to adapt it to the biomedical domain . they evaluated custom word embeddings, combination with other in-domain resources . |
| Outcome: | The proposed approach achieved a labeled attachment score of 89.7%, the best among task participants. |
Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research on slot filling has witnessed considerable improvement with considerable data and label shifts. |
| Approach: | They propose an adaptive end-to-end metric learning scheme for zero-shot slot filling that uses context-aware soft label representations and slot-level contrastive representation learning to mitigate the data and label shift problems. |
| Outcome: | The proposed approach outperforms existing methods on public benchmarks and shows that it is simple, efficient and generalizable. |
Mention Extraction and Linking for SQL Query Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL systems take a slot-filling approach, but they are limited in capturing inter-dependencies among SQL clauses. |
| Approach: | They propose an extraction-linking approach where a unified extractor recognizes all types of slot mentions appearing in the question sentence before a linker maps the recognized columns to the table schema to generate executable SQL queries. |
| Outcome: | The proposed method achieves the first place on the WikiSQL benchmark. |
AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging (P19-3)
Copied to clipboard
| Challenge: | Existing sequence annotation tools focus on improving user interfaces and user interface. |
| Approach: | They propose an open-source web-based data annotation framework for sequence tagging tasks . the framework is based on active learning and automatic crowd consolidation . |
| Outcome: | The proposed framework is a comprehensive solution for sequence labeling tasks . it can be deployed in downstream systems while new annotations are being made . |
A Web-based System for Crowd-in-the-Loop Dependency Treebanking (L18-1)
Copied to clipboard
| Challenge: | Existing treebanks are limited in size, genre, and topic coverage, making manual annotation time-consuming and expensive. |
| Approach: | They propose a web-based interactive tool for editing dependency trees that uses machine learning to accelerate annotation. |
| Outcome: | CROWDTREE is a web-based interactive tool for editing dependency trees . it can train a parsing model during the annotation process and can even be compatible with Mechanical Turk. |
A Novel Cascade Binary Tagging Framework for Relational Triple Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to extract relational triples from unstructured text are inadequate to solve the overlapping triple problem. |
| Approach: | They propose a cascade binary tagging framework that models relations as functions that map subjects to objects in a sentence. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two datasets . it outperformed baseline methods by 17.5 and 30.2 absolute gains . |
Robust Zero-Shot Cross-Domain Slot Filling with Example Values (P19-1)
Copied to clipboard
| Challenge: | Task-oriented dialog systems rely on deep learning-based slot filling models . little to no training data for target domains may be available or schemas may not be aligned . |
| Approach: | They propose to use slot descriptions and examples of slot values to learn slot semantic representations that are transferable across domains and robust to misaligned schemas. |
| Outcome: | The proposed model outperforms state-of-the-art models on two multi-domain datasets on low-data setting. |