Papers by Zain Mujahid
SAFARI: Cross-lingual Bias and Factuality Detection in News Media and News Articles (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new corpus of news media and articles is developed to assess political bias and factuality in cross-lingual contexts . integrity and objectivity of news are crucial in an age of information sharing across cultural and language landscapes - a recent study shows . |
| Approach: | They propose a corpus of news media and articles for predicting political bias and factuality . they evaluate the cross-lingual ability of the models; however, they evaluate on English data . |
| Outcome: | The proposed corpus is unprecedented in its collection and evaluates on English data. |
LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection (2024.emnlp-demo)
Copied to clipboard
Mervat Abassy, Kareem Elozeiri, Alexander Aziz, Minh Ta, Raj Tomar, Bimarsha Adhikari, Saad Ahmed, Yuxia Wang, Osama Mohammed Afzal, Zhuohan Xie, Jonibek Mansurov, Ekaterina Artemova, Vladislav Mikhailov, Rui Xing, Jiahui Geng, Hasan Iqbal, Zain Mujahid, Tarek Mahmoud, Akim Tsvigun, Alham Aji, Artem Shelmanov, Nizar Habash, Iryna Gurevych, Preslav Nakov
| Challenge: | a large number of machine-generated texts are often hard to distinguish between human-written and machine-generated text . this raises concerns about potential misuse, especially within educational and academic domains . |
| Approach: | They propose a system that can detect whether a text is human-written or machine-generated . they use a fine-grained classification schema to identify the use of machine-generated text . |
| Outcome: | The proposed system can distinguish between human-written and machine-generated text . it can detect attempts to obfuscate the fact that a text was machine- generated . |
Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers (2024.findings-emnlp)
Copied to clipboard
Yuxia Wang, Revanth Gangi Reddy, Zain Mujahid, Arnav Arora, Aleksandr Rubashevskii, Jiahui Geng, Osama Mohammed Afzal, Liangming Pan, Nadav Borenstein, Aditya Pillai, Isabelle Augenstein, Iryna Gurevych, Preslav Nakov
| Challenge: | Large language models generate naturally sounding answers over a broad range of human inquiries, but they often generate answers that contradict real-world facts. |
| Approach: | They propose a framework for annotating and evaluating the factuality of large language models . they propose 'factcheck-bench' which provides a multi-stage annotation scheme . |
| Outcome: | The proposed framework outperforms several popular LLM fact-checkers in claim, sentence, and document levels. |
A Survey on Predicting the Factuality and the Bias of News Media (2024.findings-acl)
Copied to clipboard
| Challenge: | a growing number of scholars are profiling entire news outlets to profile fake content . political bias detection is also an important topic, but the two problems have been addressed separately . |
| Approach: | They argue that media profiling should be based on factuality and bias together . they argue that it is difficult to fact-check every single suspicious claim or article manually . |
| Outcome: | The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. |