Divisive Language and Propaganda Detection using Multi-head Attention Transformers with Deep Learning BERT-based Language Models for Binary Classification (D19-50)
Copied to clipboard
| Challenge: | a team of researchers used a pre-trained BERT language model to train propaganda . the model was based on a cloze comprehension test to answer a question about influence operations . |
| Approach: | team used a BERT language model that was pre-trained on Wikipedia and BookCorpus . they used cloze comprehension tests to train the model to answer a propaganda question . |
| Outcome: | The proposed model was trained on Wikipedia and BookCorpus to answer propaganda questions . the team used a neural network that was pre-trained on the Wikipedia and bookCorpus corpus . |
Similar Papers
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (N19-1)
Copied to clipboard
| Challenge: | Existing language representation models pre-train deep bidirectional representations from unlabeled text without significant task-specific architecture modifications. |
| Approach: | They propose a language representation model that pre-trains bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. |
| Outcome: | The proposed model achieves state-of-the-art results on eleven natural language processing tasks, pushing the GLUE score to 80.5 (7.7 point absolute improvement), MultiNLI accuracy to 86.7% (4.6% absolute improvement) |
Fine-Grained Propaganda Detection with Fine-Tuned BERT (D19-50)
Copied to clipboard
| Challenge: | The goal of the Fragment Level Classification task is to detect and classify textual segments that correspond to one of the 18 given propaganda techniques in a news articles dataset. |
| Approach: | They propose a model that performs word-level classification using a pre-trained language model to detect and classify propaganda fragments in a news article dataset. |
| Outcome: | The proposed model performs word-level classification using a popular pre-trained language model. |
Sentence-Level Propaganda Detection in News Articles with Transfer Learning and BERT-BiLSTM-Capsule Model (D19-50)
Copied to clipboard
| Challenge: | a new task is needed to detect propaganda in news articles . the need for communication has increased in online social media platforms . a proposed solution to the problem of sentence-level propaganda classification is ranked 12th . |
| Approach: | They propose to build a binary classifier able to provide corresponding propaganda labels . their solution ranks 12th among 26 teams in the NLP4IF-2019 Shared Task SLC . |
| Outcome: | The proposed model outperforms baseline approach and the winning system on a similar task. |
JUSTDeep at NLP4IF 2019 Task 1: Propaganda Detection using Ensemble Deep Learning Models (D19-50)
Copied to clipboard
| Challenge: | Detecting fake news is not well established yet, but it can be classified under several labels: false, biased, or framed to mislead the readers. |
| Approach: | They propose a deep learning model using BiLSTM, XGBoost, and BERT to detect propaganda using a corpus from a challenge. |
| Outcome: | The proposed model outperforms the baseline model on a dataset from the challenge NLP4IF 2019 . |
Understanding BERT performance in propaganda analysis (D19-50)
Copied to clipboard
| Challenge: | Despite the challenging nature of the shared task, our pretrained BERT model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the contest. |
| Approach: | They propose to use a dataset to fine-tune a model for propaganda analysis at sentence level to determine whether a text is 'propaganda' and to examine false-positive cases. |
| Outcome: | The proposed model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the shared task. |
Cost-Sensitive BERT for Generalisable Sentence Classification on Imbalanced Data (D19-50)
Copied to clipboard
| Challenge: | Popular NLP tasks such as sentiment analysis and event extraction from social media are examples of imbalanced classification problems. |
| Approach: | They propose a method to generalise on dissimilar training and test data using a measure of similarity between datasets. |
| Outcome: | The proposed method achieves the second highest score on sentence-level propaganda classification. |
BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models of NLP are fading away, but new ones are needed to maintain their dominance. |
| Approach: | They propose a method to pretrain a CNN using Wikipedia data and integrate it with standard TLMs. |
| Outcome: | The proposed method outperforms the original ALBERT on GLUE tasks and achieves similar performance to SOTA on open-domain QA tasks. |
CAUnLP at NLP4IF 2019 Shared Task: Context-Dependent BERT for Sentence-Level Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Sentence-level and fragment-level propaganda detection tasks are more challenging compared to document-level detection. |
| Approach: | They propose to use context-dependent input pairs to fine-tune the pretrained propaganda detection BERT to better utilize document information. |
| Outcome: | The proposed system can detect propaganda on document-level, sentence-level and fragment-level. |
Pretrained Ensemble Learning for Fine-Grained Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Propaganda detection is a reallife challenge that can affect how people understand news . |
| Approach: | They propose to use a manually annotated dataset to tackle the propaganda detection on sentence level classification task of NLP4IF 2019 workshop co-located with EMNLP-IJCNLP 2019 conference. |
| Outcome: | The proposed model is ranked in the first place with 68.8312 F1-score on the development dataset and in the sixth place with 61.3990 F1 score on the testing dataset. |
Neural Architectures for Fine-Grained Propaganda Detection in News (D19-50)
Copied to clipboard
| Challenge: | MIC-CIS is a fine grained propaganda detection system . previous work focused on document level, labeling articles as propaganda . |
| Approach: | They propose to use different neural architectures to jointly perform propaganda detection tasks . they also investigate different ensemble schemes such as majority-voting, relax-vote, etc. |
| Outcome: | The proposed system performs sentences and fragment level propaganda detection tasks. |