APLenty: annotation tool for creating high-quality datasets using active and proactive learning (D18-2)
Copied to clipboard
| Challenge: | APLenty is an annotation tool for creating high-quality sequence labeling datasets using active and proactive learning. |
| Approach: | They present APLenty, an annotation tool for creating high-quality sequence labeling datasets using active and proactive learning. |
| Outcome: | The proposed tool is highly flexible and can be adapted to various other tasks. |
Similar Papers
Paladin: an annotation tool based on active and proactive learning (2021.eacl-demos)
Copied to clipboard
| Challenge: | Existing tools for active learning focus on the active learning algorithms and provide no user interface thus making it difficult to use for the end-users. |
| Approach: | They present an open-source web-based annotation tool for creating high-quality multi-label document-level datasets that integrates active learning and proactive learning. |
| Outcome: | The proposed tool is designed for multi-label annotation, but it can be adapted to other tasks in single-l Label settings. |
AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging (P19-3)
Copied to clipboard
| Challenge: | Existing sequence annotation tools focus on improving user interfaces and user interface. |
| Approach: | They propose an open-source web-based data annotation framework for sequence tagging tasks . the framework is based on active learning and automatic crowd consolidation . |
| Outcome: | The proposed framework is a comprehensive solution for sequence labeling tasks . it can be deployed in downstream systems while new annotations are being made . |
ALAMBIC : Active Learning Automation Methods to Battle Inefficient Curation (2023.eacl-demo)
Copied to clipboard
| Challenge: | ALAMBIC is an open-source web-based platform for annotating text data through active learning for classification task. |
| Approach: | They present an open-source web-based platform for annotating text data through active learning for classification task. |
| Outcome: | The proposed model can be downloaded and used in downstream tasks and integrates with other types of models, features and active learning strategies. |
Efficient Annotator Reliability Assessment with EffiARA (2025.acl-demo)
Copied to clipboard
| Challenge: | Obtaining annotations from experts is ideal, but this expertise is logistically and financially costly. |
| Approach: | They propose an annotation framework that supports the whole annotation pipeline from understanding the resources required for an annotation task to compiling the annotated dataset. |
| Outcome: | The proposed framework improves classification performance through annotator-reliability-based soft-label aggregation and sample weighting, and increases agreement among annotators through removal of identifying and replacing an unreliable annotation. |
DART: A Lightweight Quality-Suggestive Data-to-Text Annotation Tool (2020.coling-demos)
Copied to clipboard
| Challenge: | Neural data-to-text generation systems require large-scale labeled data to generate sentences. |
| Approach: | They propose to create an interactive annotation tool that iteratively analyzes annotated structured data to better sample unlabeled data. |
| Outcome: | The proposed tool reduces the number of annotations needed with active learning and automatically suggests relevant labels. |
ActiveAnno: General-Purpose Document-Level Annotation Tool with Active Learning Integration (2021.naacl-demos)
Copied to clipboard
| Challenge: | Existing tools for document-level annotation lack document-based quality and flexibility. |
| Approach: | a new annotation tool is being developed for industry and research use cases . a configurable user interface and a RESTful API are included . authors propose to use ACTIVEANNO as default for document-level annotation . |
| Outcome: | ACTIVEANNO is an annotation tool for industry and research use cases. |
LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanation (2020.acl-demos)
Copied to clipboard
Dong-Ho Lee, Rahul Khanna, Bill Yuchen Lin, Seyeon Lee, Qinyuan Ye, Elizabeth Boschee, Leonardo Neves, Xiang Ren
| Challenge: | Existing frameworks for sequence labeling and classification require massive human effort and labeling data is limited. |
| Approach: | They propose a web-based, Label-Efficient AnnotatioN framework that allows an annotator to provide the needed labels for a task and can capture explanations for each labeling decision. |
| Outcome: | The proposed framework surpasses baseline F1 scores by 5-10 percentage points while using 2X times fewer labeled instances. |
Reassessing Active Learning Adoption in Contemporary NLP: A Community Survey (2026.eacl-long)
Copied to clipboard
| Challenge: | a longstanding strategy to reduce annotation costs is active learning . data annotation is expected to remain important and active learning to stay relevant . |
| Approach: | They conduct an online survey to assess the perceived relevance of data annotation and active learning . they propose a strategy to reduce annotation costs using active learning, an iterative process . |
| Outcome: | The proposed strategies reduce setup complexity and uncertainty cost while maintaining model performance. |
ALToolbox: A Set of Tools for Active Learning Annotation of Natural Language Texts (2022.emnlp-demos)
Copied to clipboard
Akim Tsvigun, Leonid Sanochkin, Daniil Larionov, Gleb Kuzmin, Artem Vazhentsev, Ivan Lazichny, Nikita Khromov, Danil Kireev, Aleksandr Rubashevskii, Olga Shahmatova, Dmitry V. Dylov, Igor Galitskiy, Artem Shelmanov
| Challenge: | Currently, the framework supports text classification, sequence tagging, and seq2seq tasks. |
| Approach: | They propose an open-source framework for active learning annotation in natural language processing that provides an easy-to-deploy GUI annotation tool directly in the Jupyter IDE. |
| Outcome: | The proposed framework reduces computational overhead and duration of AL iterations and increases annotated data reusability. |
T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Annotation projection is a task of transporting labels from source to target language without high-quality training data. |
| Approach: | They propose an annotation projection approach that leverages pretrained text2text models and machine translation technology to generate annotated data. |
| Outcome: | The proposed approach outperforms existing methods on intrinsic and extrinsic tasks in 5 Indo-European and 8 low-resource African languages. |