Evaluating Unsupervised Representation Learning for Detecting Stances of Fake News (2020.coling-main)
Copied to clipboard
| Challenge: | Using unsupervised representation learning, automated Fake News detection is a challenge for researchers. |
| Approach: | They examine pre-trained language models with respect to their performance on two Fake News related data sets. |
| Outcome: | The proposed models outperform the autoregression-based models on two Fake News related data sets. |
Similar Papers
Transfer Learning from Transformers to Fake News Challenge Stance Detection (FNC-1) Task (2020.lrec-1)
Copied to clipboard
| Challenge: | In the last two years, significant improvements have occurred in NLP with the development of large language models using contextualized word embeddings based on the Google Transformer architecture. |
| Approach: | They performed experiments on data from the Fake News Challenge stage 1 (FNC-1) they used BERT sentence embeddings as a model feature and BERT, XLNet, and RoBERTa transformers to fine-tune them. |
| Outcome: | The proposed model outperforms the winner's system on class-wise F1 scores and achieves state-of-the-art on the stance detection task. |
A Retrospective Analysis of the Fake News Challenge Stance-Detection Task (C18-1)
Copied to clipboard
Andreas Hanselowski, Avinesh PVS, Benjamin Schiller, Felix Caspelherr, Debanjan Chaudhuri, Christian M. Meyer, Iryna Gurevych
| Challenge: | 2017 Fake News Challenge Stage 1 (FNC-1) shared task addressed a stance classification task as a crucial first step towards detecting fake news. |
| Approach: | They propose a new evaluation metric favoring the majority class, which can be easily classified, and propose stacked LSTM models that perform on par with the best systems, but is superior in predicting minority classes. |
| Outcome: | The proposed evaluation metric favors the majority class, which can be easily classified, and overestimates the true discriminative power of the methods. |
Threat Scenarios and Best Practices to Detect Neural Fake News (2022.coling-1)
Copied to clipboard
| Challenge: | During the COVID-19 pandemic, inaccurate information made it hard for people to find reliable guidance when they needed it. |
| Approach: | They propose to use pretrained language models to generate fluent, original text . they argue that strong detectors should be released along with new generators . |
| Outcome: | The proposed system is prone to shortcut learning and should be released along with new generators. |
BREAKING! Presenting Fake News Corpus for Automated Fact Checking (P19-2)
Copied to clipboard
| Challenge: | a new study shows that fake news spreads faster than mainstream articles on the same topic . however, there is no dataset containing compelling fake and questionable news articles . |
| Approach: | They introduce manually verified corpus of compelling fake and questionable news articles on the USA politics . they plan to extend the corpus in the future and use it for automated fake news detection. |
| Outcome: | The proposed model is based on linguistic features and will be extended in the future . it will be used to improve the existing model and improve the tools in the field of fake news detection . |
Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitations (2024.lrec-main)
Copied to clipboard
| Challenge: | Graph Neural Networks (GNNs) are used to train neural networks to detect fake news based on context-based methods. |
| Approach: | They propose to combine the two by applying pre-training of Graph Neural Networks (GNNs) in the domain of context-based fake news detection. |
| Outcome: | The proposed methods show that transfer learning does not lead to significant improvements over training a model from scratch in the domain of context-based fake news detection. |
Demystifying Neural Fake News via Linguistic Feature-Based Interpretation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent advances to neural fake news generators have made it difficult to understand how misinformation generated by these models may best be confronted. |
| Approach: | They conduct feature-based analysis to gain an interpretative understanding of the linguistic attributes that neural fake news generators may most effectively exploit. |
| Outcome: | The proposed models are compared with models trained on subsets of features and confronted with increasingly advanced neural fake news. |
Adapting Fake News Detection to the Era of Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | a gap exists in understanding the interplay between machine-paraphrased real news, machine-generated fake news, and human-written real news . false information is easier to generate but harder to detect due to the bias of detectors against machine-generated texts . |
| Approach: | They propose a strategy to adapt fake news detectors to the era of large language models and AI-driven content creation . |
| Outcome: | The proposed detectors perform well on human-written articles but not vice versa . the proposed detector should be trained on datasets with lower machine-generated news ratio than the test set . |
Neural Multi-Task Learning for Stance Prediction (D19-66)
Copied to clipboard
| Challenge: | Existing models for fact checking are limited in size due to limited data available . stance detection is a key component of fact checking for journalists and news agencies . |
| Approach: | They propose to use textual information from existing datasets to improve stance prediction. |
| Outcome: | The proposed model outperforms state-of-the-art systems on a public benchmark dataset by 6.0 and 14.4 points in weighting. |
Tribrid: Stance Classification with Neural Inconsistency Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | a new neural architecture can be used to classify stances on social media without relying on linguistic features. |
| Approach: | They propose a neural architecture where the input also includes automatically generated negated perspectives over a given claim. |
| Outcome: | The proposed model improves on the original input and removes doubtful predictions over the retained information. |
Automatic Detection of Fake News (C18-1)
Copied to clipboard
| Challenge: | a growing number of fake news detection tools are needed to identify trustworthy news sources. |
| Approach: | They propose to use two novel datasets to automate the identification of fake news . they propose learning experiments to build accurate fake news detectors . |
| Outcome: | The proposed algorithms achieve accuracies of up to 76% and compare them with other tools . the proposed algorithms are based on satirical news sources and fact-checking websites . |