A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis (2026.findings-acl)
Copied to clipboard
Muhammad Arslan Manzoor, Dilshod Azizov, Daniil Orel, Umer Siddique, Zain Muhammad Mujahid, Yufang Hou, Preslav Nakov
| Challenge: | a large-scale label set for media outlets from Media Bias/Fact Check (MBFC) is lacking in the field. |
| Approach: | They propose to use a large-scale label set to analyze outlets' representations . they also propose to evaluate embedding views and fusion strategies . |
| Outcome: | The proposed method achieves state-of-the-art results on ACL-2020 and establishes strong benchmarks on MBFC-2025. |
Similar Papers
Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts (2025.findings-acl)
Copied to clipboard
| Challenge: | Important efforts to characterize news media outlets in terms of their political bias and factuality are labor-intensive and prone to human biases. |
| Approach: | They propose a method that emulates criteria used by professional fact-checkers to assess the factuality and political bias of an entire outlet. |
| Outcome: | The proposed method improves on baselines and with multiple LLMs. |
A Survey on Predicting the Factuality and the Bias of News Media (2024.findings-acl)
Copied to clipboard
| Challenge: | a growing number of scholars are profiling entire news outlets to profile fake content . political bias detection is also an important topic, but the two problems have been addressed separately . |
| Approach: | They argue that media profiling should be based on factuality and bias together . they argue that it is difficult to fact-check every single suspicious claim or article manually . |
| Outcome: | The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. |
MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Media (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for profiling news media focus on textual features, causing them to overlook complex relationships between entities. |
| Approach: | They propose a framework for profiling news media from the lens of political bias and factuality. |
| Outcome: | The proposed framework improves existing models and improves them by integrating structural information from similar nodes. |
Measuring and Mitigating Media Outlet Name Bias in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have explored the potential political biases of large language models, but limited attention has been devoted to the effects of media outlet names. |
| Approach: | They propose to quantify media outlet name biases in large language models and leverage this metric to develop an automated prompt optimization framework. |
| Outcome: | The proposed framework mitigates media outlet name biases, offering a scalable approach to enhancing the fairness of LLMs in news-related applications. |
An Interactive Framework for Profiling News Media Sources (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing tools for detecting fake news are difficult for automated systems . e.g., we focus on the source level, and ask: Is this source factual or politically biased? |
| Approach: | They propose an interactive framework for news media profiling that uses graphs and pre-trained large language models to characterize social context on social media. |
| Outcome: | The proposed framework can detect fake and biased news media with as little as 5 human interactions . it can scale better, as often sources publish have same factuality/political bias as source . |
In Plain Sight: Media Bias Through the Lens of Factual Reporting (D19-1)
Copied to clipboard
| Challenge: | lexical bias stems from content realization, or how things are said, but other forms of bias stem from content selection and organization. |
| Approach: | They use a dataset to analyze news articles annotated with 1,727 bias spans to investigate informational bias. |
| Outcome: | The proposed model shows that informational bias appears more frequently than lexical bias. |
Hidden Biases in Unreliable News Detection Datasets (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent studies show that automatic unreliable news detection models only use the article itself without resorting to fact-checking mechanisms. |
| Approach: | They propose to use a simple model as a difficulty/bias probe instead of a complex one . they observe a significant drop in accuracy for all models tested in a clean split . |
| Outcome: | The proposed model can achieve good performance by memorizing site-label mapping instead of modeling the real task. |
Discovering Biased News Articles Leveraging Multiple Human Annotations (2020.lrec-1)
Copied to clipboard
| Challenge: | Political propaganda and one-sided views can be found in the news and can cause distrust in media. |
| Approach: | They propose to annotate politically biased news articles by an algorithm annotated by domain experts and crowd workers and to compare them to crowd workers. |
| Outcome: | The proposed method compares domain experts to crowd workers and shows that bias can be detected automatically. |
MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims (D19-1)
Copied to clipboard
Isabelle Augenstein, Christina Lioma, Dongsheng Wang, Lucas Chaves Lima, Casper Hansen, Christian Hansen, Jakob Grue Simonsen
| Challenge: | Existing efforts to verify factual claims are limited by small datasets or artificially constructed datasets. |
| Approach: | They propose to use the largest publicly available dataset of naturally occurring factual claims for automatic claim verification. |
| Outcome: | The proposed model outperforms baseline models and evidence pages significantly. |
Neural Media Bias Detection Using Distant Supervision With BABE - Bias Annotations By Experts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on the detection and aggregation of media bias lack a gold standard data set and high context dependencies. |
| Approach: | They propose to use a data set to identify media bias by word and sentence level . they propose to train a model to detect bias-inducing sentences in news articles automatically . |
| Outcome: | The proposed model outperforms existing methods on a large corpus of labels on the word and sentence level. |