| Challenge: | a family of multitask variational methods for semi-supervised sequence labeling is currently unclear how to use them in the context of sequence labelling. |
| Approach: | They propose a family of multitask variational methods for semi-supervised sequence labeling using latent variables and a discriminative labeler. |
| Outcome: | The proposed models outperform standard sequential baselines on 8 sequence labeling datasets and improve further with unlabeled data. |
Similar Papers
Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces (N18-1)
Copied to clipboard
| Challenge: | Multi-task learning and semi-supervised learning are successful paradigms for learning in scenarios with limited labelled data. |
| Approach: | They propose to induce a joint embedding space between disparate label spaces and learning transfer functions between label embeddments to leverage unlabelled data and auxiliary, annotated datasets. |
| Outcome: | The proposed approach outperforms strong single and multi-task baselines and achieves state of the art on aspect-based and topic-based sentiment analysis. |
Bringing Emerging Architectures to Sequence Labeling in NLP (2026.eacl-long)
Copied to clipboard
| Challenge: | Pretrained Transformer encoders are the dominant approach to sequence labeling . however, few have been applied to sequence labels on flat or simplified tasks . |
| Approach: | They propose to use pretrained Transformer encoders to model relations across words . they find that the architectures adapt well across tagging tasks that vary in complexity . |
| Outcome: | The proposed architectures perform well across tagging tasks across languages and datasets. |
Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification (2021.eacl-main)
Copied to clipboard
| Challenge: | Semi-supervised learning and multilingual pretraining have been shown to be effective for task-specific labelled data shortages. |
| Approach: | They propose to combine semi-supervised deep generative models and multi-lingual pretraining to form a pipeline for document classification task. |
| Outcome: | The proposed method outperforms state-of-the-art models in low-resource settings across several languages and outperformed existing models in English. |
Variational Inference and Deep Generative Models (P18-5)
Copied to clipboard
| Challenge: | Unsupervised and semi-supervised learning has been addressed scarcely in NLP . this tutorial provides an introduction to variational inference followed by an example-driven discussion of how to use variational methods for training DGMs. |
| Approach: | This tutorial provides an introduction to variational inference followed by an example-driven discussion of how to use variational methods for training DGMs. |
| Outcome: | This tutorial provides an introduction to variational inference followed by an example-driven discussion of how to use variational methods for training DGMs. |
Deep Latent Variable Models of Natural Language (D18-3)
Copied to clipboard
| Challenge: | In this tutorial, we will discuss the challenges of applying neural variational inference to NLP problems. |
| Approach: | The tutorial will cover deep latent variable models in the case where exact inference over the latent variables is tractable. |
| Outcome: | The proposed tutorial will cover deep latent variable models in the case where inference cannot be performed tractably and when it is not . |
Sequence Labeling Parsing by Learning across Representations (P19-1)
Copied to clipboard
| Challenge: | Constituency and dependency parsing are the main abstractions for representing syntactic structure of sentences . constituency parsers are considered disjointed tasks, and their improvements have been obtained separately. |
| Approach: | They propose to add auxiliary loss to constituency parsing paradigms and explore a model that parses both paradigms at no cost. |
| Outcome: | The proposed model outperforms single-task models by 1.05 F1 points and 0.62 UAS points for constituency parsing and dependency parsers. |
Augmented Natural Language for Generative Sequence Labeling (2020.emnlp-main)
Copied to clipboard
| Challenge: | generative framework for joint sequence labeling and sentence-level classification is general purpose, performing well on few-shot learning, low resource, and high resource tasks. |
| Approach: | They propose a generative framework for joint sequence labeling and sentence-level classification . their framework incorporates label semantics and shares knowledge across tasks . |
| Outcome: | The proposed model performs on few-shot learning, slot labeling, and intent classification benchmarks. |
More Embeddings, Better Sequence Labelers? (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work suggests contextual embeddings improve sequence labeling accuracy . but, there is no definite conclusion on whether concatenating different kinds of embeddables is effective . |
| Approach: | They propose a family of contextual embeddings that improves sequence labeling accuracy . they conduct extensive experiments on 3 tasks over 18 datasets and 8 languages . |
| Outcome: | The proposed family of contextual embeddings improves the accuracy of sequence labelers over non-contextual embedders. |
Event Representation with Sequential, Semi-Supervised Discrete Variables (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for event modeling take discrete, external knowledge into account . obtaining fully accurate structured knowledge can be difficult . |
| Approach: | They propose a method that takes partially-observed sequences of discrete, external knowledge into account. |
| Outcome: | The proposed method outperforms baselines and state-of-the-art in script induction and converges faster. |
A Cross-Sentence Latent Variable Model for Semi-Supervised Text Sequence Matching (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to text matching consider each sequence separately . a proposed model uses both sequences to generate a given relationship with a source sequence . |
| Approach: | They propose a latent variable model for predicting the relationship between a pair of text sequences by generating a sequence that has a given relationship with a source sequence. |
| Outcome: | The proposed model achieves state-of-the-art on natural language inference and paraphrase identification. |