| Challenge: | Despite the challenging nature of the shared task, our pretrained BERT model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the contest. |
| Approach: | They propose to use a dataset to fine-tune a model for propaganda analysis at sentence level to determine whether a text is 'propaganda' and to examine false-positive cases. |
| Outcome: | The proposed model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the shared task. |
Similar Papers
CAUnLP at NLP4IF 2019 Shared Task: Context-Dependent BERT for Sentence-Level Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Sentence-level and fragment-level propaganda detection tasks are more challenging compared to document-level detection. |
| Approach: | They propose to use context-dependent input pairs to fine-tune the pretrained propaganda detection BERT to better utilize document information. |
| Outcome: | The proposed system can detect propaganda on document-level, sentence-level and fragment-level. |
Fine-Grained Propaganda Detection with Fine-Tuned BERT (D19-50)
Copied to clipboard
| Challenge: | The goal of the Fragment Level Classification task is to detect and classify textual segments that correspond to one of the 18 given propaganda techniques in a news articles dataset. |
| Approach: | They propose a model that performs word-level classification using a pre-trained language model to detect and classify propaganda fragments in a news article dataset. |
| Outcome: | The proposed model performs word-level classification using a popular pre-trained language model. |
Cost-Sensitive BERT for Generalisable Sentence Classification on Imbalanced Data (D19-50)
Copied to clipboard
| Challenge: | Popular NLP tasks such as sentiment analysis and event extraction from social media are examples of imbalanced classification problems. |
| Approach: | They propose a method to generalise on dissimilar training and test data using a measure of similarity between datasets. |
| Outcome: | The proposed method achieves the second highest score on sentence-level propaganda classification. |
Fine-Grained Analysis of Propaganda in News Article (D19-1)
Copied to clipboard
| Challenge: | Existing methods for detecting propaganda are noisy and lack of explainability. |
| Approach: | They propose to perform fine-grained analysis of texts by detecting all fragments that contain propaganda techniques as well as their type. |
| Outcome: | The proposed model outperforms several strong BERT-based baselines. |
Fine-Tuned Neural Models for Propaganda Detection at the Sentence and Fragment levels (D19-50)
Copied to clipboard
| Challenge: | The system was evaluated on a unified development set without distributing the gold labels. |
| Approach: | They propose to use fine-grained propaganda detection to build models that can explain why an article is propagandistic. |
| Outcome: | The proposed model performed on all eighteen propaganda techniques in the corpus of the shared task. |
Pretrained Ensemble Learning for Fine-Grained Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Propaganda detection is a reallife challenge that can affect how people understand news . |
| Approach: | They propose to use a manually annotated dataset to tackle the propaganda detection on sentence level classification task of NLP4IF 2019 workshop co-located with EMNLP-IJCNLP 2019 conference. |
| Outcome: | The proposed model is ranked in the first place with 68.8312 F1-score on the development dataset and in the sixth place with 61.3990 F1 score on the testing dataset. |
Sentence-Level Propaganda Detection in News Articles with Transfer Learning and BERT-BiLSTM-Capsule Model (D19-50)
Copied to clipboard
| Challenge: | a new task is needed to detect propaganda in news articles . the need for communication has increased in online social media platforms . a proposed solution to the problem of sentence-level propaganda classification is ranked 12th . |
| Approach: | They propose to build a binary classifier able to provide corresponding propaganda labels . their solution ranks 12th among 26 teams in the NLP4IF-2019 Shared Task SLC . |
| Outcome: | The proposed model outperforms baseline approach and the winning system on a similar task. |
Divisive Language and Propaganda Detection using Multi-head Attention Transformers with Deep Learning BERT-based Language Models for Binary Classification (D19-50)
Copied to clipboard
| Challenge: | a team of researchers used a pre-trained BERT language model to train propaganda . the model was based on a cloze comprehension test to answer a question about influence operations . |
| Approach: | team used a BERT language model that was pre-trained on Wikipedia and BookCorpus . they used cloze comprehension tests to train the model to answer a propaganda question . |
| Outcome: | The proposed model was trained on Wikipedia and BookCorpus to answer propaganda questions . the team used a neural network that was pre-trained on the Wikipedia and bookCorpus corpus . |
A Primer in BERTology: What We Know About How BERT Works (2020.tacl-1)
Copied to clipboard
| Challenge: | a new study examines the current state of knowledge about the BERT model . the model is a stack of transformer encoder layers that are based on multiple self-attention ''heads'' |
| Approach: | They present a survey of over 150 studies of the popular Transformer-based model BERT . they discuss the current state of knowledge about how BERT works and how it is represented . |
| Outcome: | The proposed model is based on the Transformer-based model with state-of-the-art results . the proposed model has little cognitive motivation and is too small to perform ablation studies . |
On the use of BERT for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Existing studies on using pretrained language models for supervised NMT have not been successful. |
| Approach: | They propose to integrate BERT pretrained models with supervised NMT models by using monolingual data. |
| Outcome: | The proposed models improve translation quality in English-German, English-Russian and IWSLT14 datasets. |