Challenge: Existing methods to predict scientific claims’ replicability use only hand-extracted statistics features without utilizing research papers’ text information.
Approach: They propose two weakly supervised learning approaches that use automatically extracted text information of research papers to improve the prediction accuracy of research replication using both labeled and unlabeled datasets.
Outcome: The proposed methods achieve an accuracy of 75.76% over real-world datasets.

Similar Papers

Denoising Multi-Source Weak Supervision for Neural Text Classification (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent years have witnessed the rapid development of deep neural networks (DNNs) for text classification problems.
Approach: They propose a label denoiser which estimates the source reliability using a conditional soft attention mechanism and reduces label noise by aggregating rule-annotated weak labels.
Outcome: The proposed model outperforms state-of-the-art methods on sentiment, topic, and relation classifications and achieves comparable performance with fully-supervised methods even without labeled data.
Weaker Than You Think: A Critical Look at Weakly Supervised Learning (2023.acl-long)

Copied to clipboard

Challenge: Weakly supervised learning is a popular approach for training machine learning models in low-resource settings.
Approach: They propose to use weakly supervised learning to train models with noisy labels from weak sources instead of collecting expensive human annotations.
Outcome: The proposed methods outperform weakly supervised methods on various NLP datasets and tasks on the test sets.
Will it Blend? Blending Weak and Strong Labeled Data in a Neural Network for Argumentation Mining (P18-2)

Copied to clipboard

Challenge: Obtaining high quality labeled data for natural language understanding tasks is slow, error-prone, complicated and expensive.
Approach: They propose a method to blend weak and strong labeled data during the training of neural networks using a topic-dependent evidence detection dataset.
Outcome: The proposed method improves the training of neural networks when a small amount of labeled data is available.
Weakly- and Semi-supervised Evidence Extraction (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to combine evidence annotations with document labels are limited to a minority of training examples.
Approach: They propose to combine evidence annotations with abundant document labels for evidence extraction task.
Outcome: The proposed method outperforms baselines on two classification tasks with evidence annotations.
Self-Training with Weak Supervision (2021.naacl-main)

Copied to clipboard

Challenge: State-of-the-art deep neural networks require large amounts of labeled training data that is expensive to obtain or not available for many tasks.
Approach: They propose a weak supervision framework that leverages all available data for a given task . they leverage task-specific unlabeled data through self-training with a model that predicts pseudo-labels for instances that may not be covered by weak rules .
Outcome: The proposed framework improves on state-of-the-art datasets on six benchmark tasks.
Named Entity Recognition through Deep Representation Learning and Weak Supervision (2021.findings-acl)

Copied to clipboard

Challenge: Weakly supervised named entity recognition (NER) uses noisy labels to estimate the true labels of a dataset.
Approach: They propose a model to learn optimal assignments of latent NER tags using observed tokens and weak labels provided by labeling functions.
Outcome: The proposed model improves the quality of weak labels on four public datasets.
Learning Concept Abstractness Using Weak Supervision (D18-1)

Copied to clipboard

Challenge: Existing methods for inferring abstractness of words and expressions without labeled data are limited and limited.
Approach: They propose a weakly supervised approach for inferring the property of abstractness of words and expressions in the absence of labeled data.
Outcome: The proposed approach obtains high correlation with human labels in the absence of labeled data.
Learning with Limited Text Data (2022.acl-tutorials)

Copied to clipboard

Challenge: Natural Language Processing (NLP) relies on labeled data to perform state-of-the-art performance . labeles are often required to label large amounts of textual data . this tutorial will provide an overview of labeleing in NLP .
Approach: This tutorial will provide a systematic overview of methods for learning from limited labeled data.
Outcome: This tutorial will provide a systematic and up-to-date overview of the proposed methods . it will highlight current challenges and future directions .
Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labeling (2021.eacl-main)

Copied to clipboard

Challenge: Neural natural language generation and understanding models are data-hungry and require massive amounts of annotated data to be competitive.
Approach: They propose a framework that automatically synthesizes weak labels from large-scale weakly-labeled data with a fine-tuned GPT-2 and adapts parameter updates to the models according to the estimated label-quality.
Outcome: The proposed framework outperforms benchmark systems on the E2E and Weather datasets when 100% of the training data is used.
Towards Realistic Single-Task Continuous Learning Research for NER (2021.findings-emnlp)

Copied to clipboard

Challenge: Academic datasets are often static and contain data that is annotated all at once based on fixed annotation guidelines.
Approach: They propose to build a single-task continuous learning dataset from an existing dataset and release it along with the code to the research community.
Outcome: The proposed model is based on an existing dataset and released to the research community.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations