CAUnLP at NLP4IF 2019 Shared Task: Context-Dependent BERT for Sentence-Level Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Sentence-level and fragment-level propaganda detection tasks are more challenging compared to document-level detection. |
| Approach: | They propose to use context-dependent input pairs to fine-tune the pretrained propaganda detection BERT to better utilize document information. |
| Outcome: | The proposed system can detect propaganda on document-level, sentence-level and fragment-level. |
Similar Papers
Understanding BERT performance in propaganda analysis (D19-50)
Copied to clipboard
| Challenge: | Despite the challenging nature of the shared task, our pretrained BERT model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the contest. |
| Approach: | They propose to use a dataset to fine-tune a model for propaganda analysis at sentence level to determine whether a text is 'propaganda' and to examine false-positive cases. |
| Outcome: | The proposed model scored 0.62 F1 on the test set and ranked third among 25 teams who participated in the shared task. |
Fine-Tuned Neural Models for Propaganda Detection at the Sentence and Fragment levels (D19-50)
Copied to clipboard
| Challenge: | The system was evaluated on a unified development set without distributing the gold labels. |
| Approach: | They propose to use fine-grained propaganda detection to build models that can explain why an article is propagandistic. |
| Outcome: | The proposed model performed on all eighteen propaganda techniques in the corpus of the shared task. |
Fine-Grained Propaganda Detection with Fine-Tuned BERT (D19-50)
Copied to clipboard
| Challenge: | The goal of the Fragment Level Classification task is to detect and classify textual segments that correspond to one of the 18 given propaganda techniques in a news articles dataset. |
| Approach: | They propose a model that performs word-level classification using a pre-trained language model to detect and classify propaganda fragments in a news article dataset. |
| Outcome: | The proposed model performs word-level classification using a popular pre-trained language model. |
Sentence-Level Propaganda Detection in News Articles with Transfer Learning and BERT-BiLSTM-Capsule Model (D19-50)
Copied to clipboard
| Challenge: | a new task is needed to detect propaganda in news articles . the need for communication has increased in online social media platforms . a proposed solution to the problem of sentence-level propaganda classification is ranked 12th . |
| Approach: | They propose to build a binary classifier able to provide corresponding propaganda labels . their solution ranks 12th among 26 teams in the NLP4IF-2019 Shared Task SLC . |
| Outcome: | The proposed model outperforms baseline approach and the winning system on a similar task. |
NSIT@NLP4IF-2019: Propaganda Detection from News Articles using Transfer Learning (D19-50)
Copied to clipboard
| Challenge: | In this paper, we describe our approach and system description for NLP4IF 2019 Workshop: Shared Task on Fine-Grained Propaganda Detection. |
| Approach: | They propose to use document Embeddings and LSTM to detect whether a sentence contains a propagandistic agenda. |
| Outcome: | The proposed approach ranked 21st in the NLP4IF 2019 Workshop: Shared Task on Fine-Grained Propaganda Detection. |
Pretrained Ensemble Learning for Fine-Grained Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Propaganda detection is a reallife challenge that can affect how people understand news . |
| Approach: | They propose to use a manually annotated dataset to tackle the propaganda detection on sentence level classification task of NLP4IF 2019 workshop co-located with EMNLP-IJCNLP 2019 conference. |
| Outcome: | The proposed model is ranked in the first place with 68.8312 F1-score on the development dataset and in the sixth place with 61.3990 F1 score on the testing dataset. |
Cost-Sensitive BERT for Generalisable Sentence Classification on Imbalanced Data (D19-50)
Copied to clipboard
| Challenge: | Popular NLP tasks such as sentiment analysis and event extraction from social media are examples of imbalanced classification problems. |
| Approach: | They propose a method to generalise on dissimilar training and test data using a measure of similarity between datasets. |
| Outcome: | The proposed method achieves the second highest score on sentence-level propaganda classification. |
On Sentence Representations for Propaganda Detection: From Handcrafted Features to Word Embeddings (D19-50)
Copied to clipboard
| Challenge: | The rise of fake and hyperpartisan news on social media and online news outlets calls for improved automatic detection of propaganda in texts. |
| Approach: | They propose to use handcrafted features and learn dense semantic representations to detect propaganda in sentence-level and with random undersampling of the majority class (non-propaganda) |
| Outcome: | The proposed system achieves a ranking of 10 among 25 participants, with 59.5 F1-score. |
Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | A shared task on fine-grained propaganda detection was organized at EMNLP-IJCNLP 2019 . 12 systems submitted systems for the FLC task, 25 for the SLC task, and 14 teams submitted a system description paper . |
| Approach: | They present a task on fine-grained propaganda detection as part of the NLP4IF workshop at EMNLP-IJCNLP 2019 . they used a corpus of news articles annotated with an inventory of propagandist techniques at the fragment level to determine the propaganda technique used in each fragment . |
| Outcome: | The shared task on fine-grained propaganda detection was organized at the EMNLP-IJCNLP 2019 . 12 systems submitted for the FLC task, 25 for the SLC task, and 14 submitted a system description paper . |
Fine-Grained Analysis of Propaganda in News Article (D19-1)
Copied to clipboard
| Challenge: | Existing methods for detecting propaganda are noisy and lack of explainability. |
| Approach: | They propose to perform fine-grained analysis of texts by detecting all fragments that contain propaganda techniques as well as their type. |
| Outcome: | The proposed model outperforms several strong BERT-based baselines. |