Resisting the Lure of the Skyline: Grounding Practices in Active Learning for Morphological Inflection (2024.acl-short)
Copied to clipboard
| Challenge: | Several approaches to active learning are available, including confidence-based, diversity-based and committee-based. |
| Approach: | They propose to use a baseline and a skyline to measure the accuracy of the unannotated sample pool. |
| Outcome: | The proposed model outperforms a random selection baseline and a skyline approach. |
Similar Papers
Eeny, meeny, miny, moe. How to choose data for morphological inflection. (2022.emnlp-main)
Copied to clipboard
| Challenge: | Data scarcity is a major bottleneck for many natural language processing tasks . active learning aims to reduce the cost of data annotation by selecting the most informative examples to label. |
| Approach: | They propose to use oracle experiments to select data that is most informative for the model. |
| Outcome: | The proposed sampling strategies show that they improve on the oracle experiment and the 10-cycle iteration using Natügu as a case study. |
Active Learning for BERT: An Empirical Study (2020.emnlp-main)
Copied to clipboard
Liat Ein-Dor, Alon Halfon, Ariel Gera, Eyal Shnarch, Lena Dankin, Leshem Choshen, Marina Danilevsky, Ranit Aharonov, Yoav Katz, Noam Slonim
| Challenge: | Existing approaches to deal with data scarcity are active learning (AL) and pre-trained models are not being considered. |
| Approach: | They propose to use active learning techniques to cope with data scarcity in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
| Outcome: | The proposed methods improve BERT performance in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
It’s Morphin’ Time! Combating Linguistic Discrimination with Inflectional Perturbations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work on societal bias in NLP focuses on race and gender . linguistic background is a unique attribute that has been largely ignored in the field . |
| Approach: | They examine linguistic background to craft plausible adversarial examples that expose biases in popular NLP models. |
| Outcome: | The proposed model improves robustness without sacrificing performance on clean data. |
Active Learning for Corpus Refinement: Cost-Effective Preprocessing to Improve Validity of Applied Quantitative Text Analysis (2026.eacl-srw)
Copied to clipboard
| Challenge: | Quantitative text analysis relies on high-quality corpora, but keyword-based collection often retrieves irrelevant material, undermining validity. |
| Approach: | They propose to use a transformer-based classifier to iteratively refine corpora by excluding irrelevant documents. |
| Outcome: | The proposed method outperforms random sampling and weakly supervised sampling and outperformed random sampling. |
Active Learning Principles for In-Context Learning with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning has significantly enhanced predictive performance in few-shot learning settings. |
| Approach: | They propose to use pool-based Active Learning to identify the most informative demonstrations for few-shot learning over a single iteration to identify best demonstrations. |
| Outcome: | The proposed model outperforms all other methods, including random sampling, in the analysis of 24 classification and multi-choice tasks. |
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference (D18-1)
Copied to clipboard
| Challenge: | a new dataset presents a task of grounded commonsense inference, unifying natural language inference and commonsensical reasoning. |
| Approach: | They propose a procedure that constructs a de-biased dataset by iteratively training stylistic classifiers and using them to filter the data. |
| Outcome: | The proposed procedure oversamples a de-biased dataset using state-of-the-art language models . human models struggle on the proposed procedure, indicating significant opportunities for future research. |
ALVIN: Active Learning Via INterpolation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that Active Learning methods ignore example groups whose prevalence may vary . supervised fine-tuning remains a critical component of model development, authors say . |
| Approach: | They propose an approach that uses interpolations to create anchors between examples . they propose to use the model to identify informative examples that counteract shortcuts . |
| Outcome: | The proposed model outperforms state-of-the-art active learning methods on six datasets . it prioritizes high-certainty instances that integrate representations from different example groups . |
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work has explored the suitability of pre-trained language models in low resource settings with less than 1,000 training data points. |
| Approach: | They propose to use pool-based active learning to speed up training while keeping the cost of labeling new data constant. |
| Outcome: | The proposed model can be fine-tuned to optimize for low-resource settings while keeping the cost of labeling constant. |
Getting The Most Out of Your Training Data: Exploring Unsupervised Tasks for Morphological Inflection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained transformers have been shown to be effective in many natural language tasks, but are under-explored for character-level sequence to sequence tasks. |
| Approach: | They propose to use pre-trained transformers for character-level morphological inflection in several languages to train models for unsupervised tasks. |
| Outcome: | The proposed model outperforms the best two shared tasks on morphological inflection and graphemeto-phoneme conversion benchmarks. |
XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for active learning rely on model uncertainty or disagreement to pick unlabeled data, leading to over-confidence in superficial patterns and lack of exploration. |
| Approach: | They propose to use a bi-directional encoder and a uni-directional decoder to generate and score an explanation for low-resource text classification. |
| Outcome: | The proposed model improves on 9 strong baselines on six datasets and can generate explanations for its predictions. |