TextAnnotator: A UIMA Based Tool for the Simultaneous and Collaborative Annotation of Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing annotation tools are not efficient for the annotation of corpora and are not error-free. |
| Approach: | They propose to extend existing annotation tools by evaluating their flexibility and efficiency. |
| Outcome: | The proposed system performs platform-independent multimodal annotations and annotates complex textual structures. |
Similar Papers
FITAnnotator: A Flexible and Intelligent Text Annotation System (2021.naacl-demos)
Copied to clipboard
| Challenge: | In this paper, we introduce FITAnnotator, a generic web-based tool for efficient text annotation. |
| Approach: | They propose a generic web-based tool for efficient text annotation. |
| Outcome: | The proposed tool is based on a fully modular architecture and provides three kinds of interfaces to annotate instances, evaluate annotation quality and manage the annotation task for annotators, reviewers and managers. |
TreeAnnotator: Versatile Visual Annotation of Hierarchical Text Relations (L18-1)
Copied to clipboard
| Challenge: | TREEANNOTATOR is a browser-based tool for annotating tree-like structures . it provides a wider range of formats and provides graphical annotations . |
| Approach: | They evaluate TREEANNOTATOR, a browser-based tool for annotating tree-like structures, in particular structures that jointly map dependency relations and inclusion hierarchies, as used by Rhetorical Structure Theory. |
| Outcome: | The GUI interface is user-friendly and provides two visualization modes. |
A UIMA Database Interface for Managing NLP-related Text Annotations (L18-1)
Copied to clipboard
| Challenge: | despite the use of UIMA as a document-based schema, it does not provide native database support. |
| Approach: | They develop a database interface to allow generic use of UIMA documents in database systems. |
| Outcome: | The framework is evaluated in relation to file system-based storage and provides data protection. |
A Web-based Collaborative Annotation and Consolidation Tool (2020.lrec-1)
Copied to clipboard
| Challenge: | Annotation tools have a rigid structure, closed back-end and front-end, and are built in a non-user-friendly way rendering them unusable for a large cohort. |
| Approach: | They propose a web-based collaborative annotation and consolidation tool (AWOCATo) that supports varied textual formats and allows users to easily adapt to the annotation task. |
| Outcome: | AWOCATo supports a range of tasks and domains, filling the gap left by the lack of tools that can be used by people with and without programming knowledge. |
YEDDA: A Lightweight Collaborative Text Span Annotation Tool (P18-4)
Copied to clipboard
| Challenge: | Existing annotation tools do not consider post-annotation quality analysis due to inter-annotator disagreement. |
| Approach: | They propose a lightweight but efficient open-source tool for text span annotation that can be used for collaborative user annotation and administrator evaluation and analysis. |
| Outcome: | The proposed system reduces the annotation time by half compared with existing tools and the time can be compressed by 16.47% through intelligent recommendation. |
Textinator: an Internationalized Tool for Annotation and Human Evaluation in Natural Language Processing and Generation (2022.lrec-1)
Copied to clipboard
| Challenge: | Large-scale pretrained language models have brought substantial advances to the natural language processing field. |
| Approach: | They present an internationalized annotation and human evaluation bundle, called Textinator, along with documentation and video tutorials. |
| Outcome: | The proposed tool is compared to other tools along 9 different axes and is available in multiple languages. |
PDFAnno: a Web-based Linguistic Annotation Tool for PDF Documents (L18-1)
Copied to clipboard
| Challenge: | Currently, linguistic annotation tools for PDF documents focus on plain-text documents. |
| Approach: | They propose a web-based linguistic annotation tool for PDF documents . it offers functions for various types of linguistic annotations directly on PDF . |
| Outcome: | The proposed tool can annotate on PDF documents with named entity, dependency relation, and coreference chain. |
LightTag: Text Annotation Platform (2021.emnlp-demo)
Copied to clipboard
| Challenge: | LightTag is a text annotation tool built on the premise of global optimization by addressing annotator as well as project managers and data scientists who manage the work and enforce production quality. |
| Approach: | They propose to use LightTag to optimize the global NLP process by addressing annotators as well as project managers and data scientists who manage the work and enforce production quality. |
| Outcome: | The proposed tool is based on the theory of constraints and is available for free for academic use. |
LexiClean: An annotation tool for rapid multi-task lexical normalisation (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Lexical normalisation is the task of identifying and normalising non-canonical tokens (e.g. erroneous spelling, acronyms, etc.) in noisy, non-standard, corpora. |
| Approach: | They propose to use LexiClean to annotate multiple tasks in noisy corpora using in situ token modification and annotation that can be rapidly applied corpus wide. |
| Outcome: | The proposed tool can be rapidly applied corpus wide and can identify and normalise noisy, non-standard, and domain specific corpora. |
Universal Semantic Annotator: the First Unified API for WSD, SRL and Semantic Parsing (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to understanding textual information are still far from achieving true natural language understanding (NLU). |
| Approach: | They propose a unified API for high-quality automatic annotations of texts in 100 languages through state-of-the-art systems for Word Sense Disambiguation, Semantic Role Labeling and Semantics Parsing. |
| Outcome: | The proposed system can provide users with rich and diverse semantic information, help second-language learners, and integrate explicit semantic knowledge into downstream tasks and real-world applications. |