Papers with detection
A New Approach to Animacy Detection (C18-1)
Copied to clipboard
| Challenge: | Animacy is a property for a referent to be an agent, and prior work has classified words as either animate or inanimate. |
| Approach: | They propose a method that uses supervised machine learning and hand-built rules to classify the animacy of co-reference chains. |
| Outcome: | The proposed method achieves state-of-the-art performance on a 142-text dataset . it leverages word embeddings over referring expressions, parts of speech, and grammatical and semantic roles . |
How Many Users Are Enough? Exploring Semi-Supervision and Stylometric Features to Uncover a Russian Troll Farm (D19-50)
Copied to clipboard
| Challenge: | Social media has been used by troll farms to promote political agendas . trolled farms employ people to provoke conflict via the use of inflammatory or provocative comments. |
| Approach: | They analyze the use of self-supervision with less than 100 troll accounts as training data to determine whether a trolled account is labeled as a Russian trol farm. |
| Outcome: | The proposed methods improve classification performance by nearly 4% F1 and use self-supervision with less than 100 troll accounts as training data. |
On the Influence of Coreference Resolution on Word Embeddings in Lexical-semantic Evaluation Tasks (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing word embeddings rely on local information delimited by context windows or dependency parents to predict word relations. |
| Approach: | They propose to use coreference resolution to find all spans of a text that refer to the same entity to improve the F1-Scores. |
| Outcome: | The proposed methods do not benefit significantly from pronoun substitution. |
Darkness can not drive out darkness: Investigating Bias in Hate SpeechDetection Models (2022.acl-srw)
Copied to clipboard
| Challenge: | a recent study shows that machine learning models are biased and they might make the wrong decisions for the wrong reasons. |
| Approach: | They investigate the impact of social bias on the performance of hate speech detection models . they also investigate the causal effect of intersectional bias on models' unfairness . |
| Outcome: | The proposed model is biased and makes the wrong decisions for the wrong reasons. |
NoEl: An Annotated Corpus for Noun Ellipsis in English (2020.lrec-1)
Copied to clipboard
| Challenge: | Ellipsis resolution is an important step to improve the accuracy of mainstream natural language processing tasks such as information retrieval, event extraction, dialog systems, etc. |
| Approach: | They extend the study of ellipsis by annotating a corpus for noun ellippsis and closely related phenomenon using the first hundred movies of Cornell Movie Dialogs Dataset. |
| Outcome: | The proposed corpus has 946 instances of exophoric and endophorical noun ellipsis, making it the biggest resource of nouns in English, to the best of our knowledge. |
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field. |
| Approach: | This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques . |
| Outcome: | This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches . |
HALLUCANA: Fixing LLM Hallucination with A Canary Lookahead (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to detect factual hallucinations w.r.t. world knowledge require assistive generations (samples, drafts, etc.) Existing approaches to factuality hallucinism detection, such as SelfCheckGPT, require assistively generation (sequences, Drafts, and etc.). Existing studies on factualism hallucinosation detection require assistives generations (Sample, draft, etc). |
| Approach: | They propose a canary lookahead which detects and corrects factual hallucinations of Large Language Models in long-form generation by exploiting the internal factuality representation in the LLM hidden space. |
| Outcome: | The proposed method improves generation quality by 2.5x while consuming over 6 times less compute. |
A Symmetric Local Search Network for Emotion-Cause Pair Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for Emotion-cause pair extraction are not effective because of their lack of annotation. |
| Approach: | They propose a new task which aims at extracting the potential clause pairs of emotions and corresponding causes in a document. |
| Outcome: | The proposed method outperforms existing state-of-the-art methods on the ECPE corpus. |
Neural Architectures for Fine-Grained Propaganda Detection in News (D19-50)
Copied to clipboard
| Challenge: | MIC-CIS is a fine grained propaganda detection system . previous work focused on document level, labeling articles as propaganda . |
| Approach: | They propose to use different neural architectures to jointly perform propaganda detection tasks . they also investigate different ensemble schemes such as majority-voting, relax-vote, etc. |
| Outcome: | The proposed system performs sentences and fragment level propaganda detection tasks. |
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)
Copied to clipboard
Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang
| Challenge: | Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations. |
| Approach: | They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation. |
| Outcome: | The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement. |
Inconsistent dialogue responses and how to recover from them (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to assess and bolster utterance consistency of chat systems have been shown difficult to detect. |
| Approach: | They propose to use annotators to write dialogue responses and recovery utterances to assess and bolster utteration consistency of chat systems. |
| Outcome: | The proposed dataset significantly improves the detection and resolution of inconsistencies in chat conversations. |
The SUMMA Platform: A Scalable Infrastructure for Multi-lingual Multi-media Monitoring (P18-4)
Copied to clipboard
| Challenge: | The SUMMA Platform is a highly scalable distributed architecture for monitoring a large number of media broadcasts in parallel, with a lag behind actual broadcast time of at most a few minutes. |
| Approach: | The open-source SUMMA Platform is a highly scalable distributed architecture for monitoring a large number of media broadcasts in parallel . it offers a fully automated media ingestion pipeline capable of recording live broadcasts, detection and transcription of spoken content, translation of all text (original or transcribed) into English, recognition and linking of Named Entities, topic detection, clustering and cross-lingual multi-document summarization of related media items and extraction and storage of factual claims in these news items. |
| Outcome: | The SUMMA Platform is a highly scalable distributed architecture for monitoring a large number of media broadcasts in parallel, with a lag behind actual broadcast time of at most a few minutes. |
Learning Domain Terms - Empirical Methods to Enhance Enterprise Text Analytics Performance (2020.coling-industry)
Copied to clipboard
| Challenge: | Standard text analytics algorithms are degraded on consumer generated data, a study finds . enterprise data contains domain terms that are not available in general purpose thesaurus . |
| Approach: | They propose unsupervised methods for cleaning noisy repositories after domain terms are segregated from true noise terms. |
| Outcome: | The proposed method improves classification accuracy after noise correction . it is based on a systematic analysis of enterprise data . |
Corpus Creation and Emotion Prediction for Hindi-English Code-Mixed Social Media Text (N18-4)
Copied to clipboard
| Challenge: | Emotion Prediction is a natural language processing task dealing with detection and classification of emotions in monolingual and bilingual texts. |
| Approach: | They propose a machine learning system which uses various machine learning techniques to detect emotion associated with tweets. |
| Outcome: | The proposed system uses various machine learning techniques to detect emotion associated with the text. |
ANHALTEN: Cross-Lingual Transfer for German Token-Level Reference-Free Hallucination Detection (2024.acl-srw)
Copied to clipboard
| Challenge: | ANHALTEN is a new evaluation dataset that extends the English hallucination detection dataset to German. |
| Approach: | They propose a dataset that extends the English hallucination detection dataset to German . they show that larger context length leads to better halluciation detection in german . |
| Outcome: | ANHALTEN is the first evaluation dataset that extends the English hallucination detection dataset to German. |
TMID: A Comprehensive Real-world Dataset for Trademark Infringement Detection in E-Commerce (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Annually, e-commerce platforms incur substantial financial losses due to trademark infringements. |
| Approach: | They propose a dataset to detect trademark infringement in merchant registrations . they use legal rules and contextual information from Alipay to gather contextual information with annotations from legal experts. |
| Outcome: | The proposed dataset is sourced from Alipay, one of the world’s largest e-commerce and digital payment platforms. |
Estimating Soft Labels for Out-of-Domain Intent Detection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to detect out-of-dominance (OOD) intents are limited by the lack of OOD samples. |
| Approach: | They propose an adaptive soft pseudo labeling method that can estimate soft labels for pseudo OOD samples when training OOD detectors. |
| Outcome: | The proposed method outperforms competing methods on three benchmark datasets and consistently outperformed previous methods. |
Exploring Statistical and Neural Models for Noun Ellipsis Detection and Resolution in English (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing approaches to noun ellipsis resolution have been sparse, using syntactic feature constraints for marking licensors and selecting their antecedents. |
| Approach: | They propose to use supervised machine learning to improve the existing F1 score by 16.55% and resolution by 14.97% for noun ellipsis subtasks. |
| Outcome: | The proposed framework improves the existing F1 score by 16.55% and the resolution subtask by 14.97%. |
Source Code is a Graph, Not a Sequence: A Cross-Lingual Perspective on Code Clone Detection (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods for code clone detection are fast and scalable, but they may fail to detect clones that have different syntax or structure. |
| Approach: | They propose to use graph-based methods for code clone detection instead of sequence-based models. |
| Outcome: | The proposed graph-based methods outperforms sequence-based models on cross-lingual code clones. |
Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have focused on the models, neglecting the full deployment pipeline . previous studies have underestimated the practical success of these attacks . |
| Approach: | They evaluate the effectiveness of jailbreak attacks targeting LLM safety alignment . they highlight critical gaps and call for further refinement of detection accuracy and usability . |
| Outcome: | The proposed attacks can detect at least one safety filter across the entire deployment pipeline. |
Learning Lexical Subspaces in a Distributional Vector Space (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing word embeddings that can cluster distributionally related words are weak, but they can be used to cluster words that might not be semantically similar. |
| Approach: | They propose a framework that injects lexical-semantic relations into distributional word embeddings by defining subspaces of the distributional vector space in which a lexically related relation should hold. |
| Outcome: | The proposed framework outperforms existing systems on relatedness and hypernymy tasks while being competitive on word similarity tasks. |
Efficient Out-of-Scope Detection in Dialogue Systems via Uncertainty-Driven LLM Routing (2025.acl-industry)
Copied to clipboard
| Challenge: | Out-of-scope (OOS) intent detection is critical in task-oriented dialogue systems . without effective OOS detection, such inputs could lead to incorrect responses, reduced user trust, and eventual system failures. |
| Approach: | They propose a modular framework that combines uncertainty modeling with fine-tuned large language models (LLMs) their method yields state-of-the-art results on key OOS detection benchmarks . |
| Outcome: | The proposed framework yields state-of-the-art results on key OOS detection benchmarks including real-world OOS data. |
Automatic Detection of Stigmatizing Uses of Psychiatric Terms on Twitter (2022.lrec-1)
Copied to clipboard
| Challenge: | Psychiatry and people suffering from mental disorders have often been given a pejorative label that induces social rejection. |
| Approach: | They propose to use deep learning to detect polarity and type of use in tweets . they propose to combine polarization detection with typeof use detection to improve polarities . |
| Outcome: | The proposed models can detect the polarity of a tweet and the types of use on a dataset that is not yet available. |
Who Plays Which Role? Protagonist Detection and Classification in Moral Discourse (2026.eacl-srw)
Copied to clipboard
| Challenge: | a systematic study of phrase-level protagonist detection and classification in moral discourse focuses on moral values rather than the actors involved. |
| Approach: | They propose to decompose a task into identifying protagonist mentions and classifying them by what kind of actor they are and what function they serve in the moral argument. |
| Outcome: | The proposed model outperforms previous models on the Moralization Corpus and fine-tuned lightweight models and prompting-based large language models. |
MTP: A Dataset for Multi-Modal Turning Points in Casual Conversations (2024.acl-short)
Copied to clipboard
| Challenge: | a new problem setting is designed to detect critical moments in conversations . a human-annotated multi-modal dataset is used to classify and detect turning points . |
| Approach: | They propose a problem setting focusing on turning points in conversations as TPs . they propose MTPC, MTPD, & MTPR tasks to classify and detect turning points . |
| Outcome: | The proposed model achieves an F1-score of 0.88 in classification and 0.61 in detection . it uses state-of-the-art vision-language models to construct a narrative from the videos . |
All-in-One: A Deep Attentive Multi-task Learning Framework for Humour, Sarcasm, Offensive, Motivation, and Sentiment on Memes (2020.aacl-main)
Copied to clipboard
| Challenge: | Empirical results show the efficacy of our proposed multi-task framework over existing state-of-the-art systems. |
| Approach: | They propose a multi-task, multi-modal deep learning framework to solve multiple tasks simultaneously. |
| Outcome: | The proposed framework performs better than existing state-of-the-art systems on a complicated form of information, i.e., memes. |
Pouring Your Heart Out: Investigating the Role of Figurative Language in Online Expressions of Empathy (2024.acl-long)
Copied to clipboard
| Challenge: | Empathy is a social mechanism used to support and strengthen emotional connection with others, including in online communities. |
| Approach: | They propose to use a subcategory of linguistic phenomena, figurative language, to detect online expressions of empathy. |
| Outcome: | The proposed model improves on the use of metaphor, idiom, and hyperbole in online expressions of empathy, with 0.942 and 0.809 F1 scores. |
Fine-grained Fallacy Detection with Human Label Variation (2025.naacl-long)
Copied to clipboard
| Challenge: | Fallacy detection is an open challenge in NLP and has shown to be intrinsically difficult for both humans and machines. |
| Approach: | They propose a framework that minimizes annotation errors whilst keeping signals of human label variation. |
| Outcome: | The proposed framework minimizes annotation errors while keeping signals of human label variation. |
Aspect-Controlled Neural Argument Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Current argument generation models produce lengthy texts and allow the user little control over the aspect the argument should address. |
| Approach: | They propose a language model that can be controlled to generate sentence-level arguments for a given topic, stance, and aspect. |
| Outcome: | The proposed model generates high-quality arguments for argumentation and counter-arguments. |
DPDLLM: A Black-box Framework for Detecting Pre-training Data from Large Language Models (2024.findings-acl)
Copied to clipboard
Baohang Zhou, Zezhong Wang, Lingzhi Wang, Hongru Wang, Ying Zhang, Kehui Song, Xuhui Sui, Kam-Fai Wong
| Challenge: | Existing methods to detect pretraining data from large language models are unrealistic to them. |
| Approach: | They propose to detect pre-training data from LLM in a black-box way by using GPT-2 as reference model and feed it with sequence probabilities to detect whether it was used to train it. |
| Outcome: | The proposed framework outperforms existing methods on the benchmark datasets and shows that it is effective on different popular LLMs. |
A Closer Look at Few-Shot Out-of-Distribution Intent Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for few-shot out-of-distribution (OOD) intent detection are not adequate . despite its importance, few- shot OOD intent detection is a challenging problem . |
| Approach: | They propose a latent representation generation and self-supervision approach to solve few-shot OOD intent detection problem. |
| Outcome: | The proposed approach is highly effective and could improve state-of-the-art methods for few-shot OOD intent detection. |
CoCoLoFa: A Dataset of News Comments with Common Logical Fallacies Written by LLM-Assisted Crowds (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing algorithms for detecting logical fallacies in texts are expensive and require large-scale labeled datasets. |
| Approach: | They introduce CoCoLoFa, the largest known logical fallacy dataset, with 7,706 comments for 648 news articles labeled for fallacy presence and type. |
| Outcome: | The proposed dataset outperforms state-of-the-art LLMs in fallacy detection and classification. |
Cross-document Misinformation Detection based on Event Graph Reasoning (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for misinformation detection are limited to judging each document in isolation. |
| Approach: | They propose a task of cross-document misinformation detection that detects fake news from a cluster of topically related news documents. |
| Outcome: | The proposed method outperforms existing methods by up to 7 F1 points on this task. |
Claim Check-Worthiness Detection as Positive Unlabelled Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a unified approach to claim check-worthiness detection is a critical component of fact checking systems. |
| Approach: | They propose a unified approach which corrects for misinformation by positive unlabelled learning . they propose citation needed detection from Wikipedia and a ranking task which is a critical component of automatic fact checking systems. |
| Outcome: | The proposed method outperforms the state of the art in two of the three tasks studied in English. |
OutFlip: Generating Examples for Unknown Intent Detection with Natural Language Attack (2021.findings-acl)
Copied to clipboard
| Challenge: | Out-of-domain (OOD) input detection is vital in task-oriented dialogue systems . accepted OOD inputs lead to incorrect response of the system . |
| Approach: | They propose a method to generate out-of-domain samples from in-domain training datasets using OutFlip. |
| Outcome: | The proposed method significantly improves an intent classification model's out-of-domain detection performance. |
Fake News Detection Strategies under Dataset Bias: Using Large-scale Coarse-grained Labels (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing datasets differ substantially in content distributions and annotation policies, complicating fair evaluation and generalization assessment. |
| Approach: | They quantitatively analyze dataset bias across multiple public fake news datasets with different annotation granularities, including article-level and publisher-level labels. |
| Outcome: | The proposed approach improves detection performance under in-dataset and cross-data set evaluation settings. |
LLM-Human Pipeline for Cultural Grounding of Conversations (2025.naacl-long)
Copied to clipboard
| Challenge: | addressing parents by name is commonplace in the West, but it is rare in most Asian cultures. |
| Approach: | They propose a Cultural Context Schema for conversations that incorporates conversational information and cultural information such as social norms, violations, etc. |
| Outcome: | The proposed model significantly improves the empirical performance of a Chinese conversational norm and violation description using an interactive human-in-loop framework. |
The Unintended Trade-off of AI Alignment: Balancing Hallucination Mitigation and Safety in LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Hallucination in large language models has been studied, but a side effect remains unrecognized . a new study examines the trade-off between truthfulness and safety alignment . |
| Approach: | They propose a method that disentangles hallucination from hallucinian features using sparse autoencoders. |
| Outcome: | The proposed method preserves refusal behavior and task utility while maintaining safety alignment. |
Enhancing Out-of-Distribution Detection in Natural Language Understanding via Implicit Layer Ensemble (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. |
| Approach: | They propose a framework that encourages intermediate features to learn layer-specialized representations and assembles them implicitly into a single representation to absorb rich information in the pre-trained language model. |
| Outcome: | The proposed framework is significantly more effective than previous studies in intent classification and OOD datasets. |
Multi-Scale Spectral Selection and Entropy-Guided Uncertainty Fusion for Multimodal Rumor Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal content detection fail to capture cross-modal semantic inconsistencies and ignore inherent noise in multimodal features. |
| Approach: | They propose a multimodal rumor detection method based on a frequency domain spectral selection method and entropy-guided uncertainty fusion method to capture cross-modal semantic inconsistencies. |
| Outcome: | The proposed method outperforms state-of-the-art methods in multimodal rumor detection . it shows stronger detection capability and robustness on multiple datasets . |
Detecting Overflow in Compressed Token Representations for Retrieval-Augmented Generation (2026.eacl-srw)
Copied to clipboard
| Challenge: | Efficient long-context processing remains a challenge for large language models (LLMs) however, the limits of compressibility remain underexplored. |
| Approach: | They propose a method to characterize and detect token overflow in xRAG soft-compression by mapping long contexts into dense vectors that can be directly consumed by the model. |
| Outcome: | The proposed method identifies token overflow with query-agnostic saturation statistics but lacks the capability to detect it. |
How Large Language Models are Transforming Machine-Paraphrase Plagiarism (2022.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive paraphrasing tools can be used to generate convincing plagiarized texts with minimal effort. |
| Approach: | They evaluate the detection performance of large autoregressive models for machine-paraphrase generation on scientific articles from arXiv, student theses, and Wikipedia. |
| Outcome: | The proposed models generate paraphrases indistinguishable from original work and human experts rate the quality of generated examples as high as originals. |
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent research shows promising results by jointly learning of slot filling and intent detection tasks. |
| Approach: | They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results. |
| Outcome: | The proposed model outperforms existing methods on benchmark datasets and ATIS datasets. |
Dialogue Act-based Breakdown Detection in Negotiation Dialogues (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent studies have succeeded in modeling a negotiating agent in natural language that can control both text generation and reasoning in goal-oriented dialogue systems. |
| Approach: | They propose a human-human negotiation dialogue dataset that features increased complexities in terms of the number of possible solutions and a utility function. |
| Outcome: | The proposed method performs comparable to text-based approaches in existing corpora and better results in the proposed dataset. |
StressTest: Can YOUR Speech LM Handle the Stress? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent speech-aware language models (SLMs) have enabled direct audio processing, allowing models to access the full expressive range of spoken language. |
| Approach: | They propose a data generation pipeline that simulates change of meaning implied by stress variation and propose 'stresstest' to evaluate models' ability to distinguish between meanings of speech based on stress pattern. |
| Outcome: | The proposed model outperforms existing models on sentence stress reasoning and detection. |
Pioneering Bot Detection on Polish Reddit at the Comment Level (2026.eacl-srw)
Copied to clipboard
| Challenge: | 40,000 comments, 58% bot-comment prevalence, are used for comment-level bot detection within Polish Reddit communities. |
| Approach: | They construct a dataset with 40,000 comments, 58% bot-comment prevalence, which provides labels for the subsequent model training. |
| Outcome: | The proposed model trains on a Polish Reddit dataset with a linguistically mixed dataset and achieves strong performance and temporal generalization to 2025. |
Event Coreference Resolution with Non-Local Information (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing joint models for event coreference resolution are understudied and underexploited . current models only learn trigger detection and event coreference from annotated training data . |
| Approach: | They propose to add a topic-based trigger detection module and a preprocessing module to improve event coreference. |
| Outcome: | The proposed model yields the best results on the KBP 2017 English and Chinese datasets. |
Chain-of-Thought Prompting Obscures Hallucination Cues in Large Language Models: An Empirical Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can mitigate hallucinations by encouraging step-by-step reasoning, but its impact on halluciation detection remains underexplored. |
| Approach: | They conduct an empirical evaluation of CoT prompting in Large Language Models (LLMs) to examine their impact on hallucination detection methods. |
| Outcome: | The proposed method significantly affects the internal states and token probability distributions of the LLM. |
HYPHEN: Hyperbolic Hawkes Attention For Text Streams (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods for text stream modeling ignore fine-grained timing irregularities and time-varying scale-free properties of texts. |
| Approach: | They propose a hyperbolic Hawkes Attention Network which learns a data-driven hyperbolical space and models irregular powerlaw excitations using a Hawke's process. |
| Outcome: | The proposed model can model online text sequences in a geometry agnostic manner. |
Effective Use of Transformer Networks for Entity Tracking (D19-1)
Copied to clipboard
| Challenge: | Existing pre-trained language models for entity-related tasks are not able to handle the nuances of procedural text. |
| Approach: | They propose to use pre-trained transformer networks to track entities in procedural text by restructuring input to focus on a particular entity. |
| Outcome: | The proposed models outperform baseline models on ingredient detection in recipes and QA over scientific processes on two different tasks. |
Improving Unsupervised Out-of-domain detection through Pseudo Labeling and Learning (2023.findings-eacl)
Copied to clipboard
| Challenge: | Unsupervised OOD detection is a task aimed at discriminating whether given samples are from the in-domain (IND) . previous studies adopted the one-class classification approach, assuming that the training samples come from a single domain. |
| Approach: | They propose a framework that leverages latent categorical information to improve representation learning for textual OOD detection. |
| Outcome: | The proposed framework significantly outperforms baseline models on three datasets. |
NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey (2026.findings-eacl)
Copied to clipboard
| Challenge: | Social media platforms such as X (formerly Twitter), Facebook, and Reddit generate user-generated content. |
| Approach: | They propose a framework to assess privacy risks in social media by evaluating vulnerabilities across six dimensions: data collection, preprocessing, visibility, fairness, computational risk, and regulatory compliance. |
| Outcome: | The proposed framework assesses privacy risks across six dimensions . it achieves F1-scores of 0.58–0.84, but incurs 1% - 23% drop under fine-tuning . |
“Define Your Terms” : Enhancing Efficient Offensive Speech Classification with Definition (2024.eacl-long)
Copied to clipboard
| Challenge: | Multiple studies have proposed various semantically related yet subtle distinct categories of offensive speech. |
| Approach: | They propose a meta-learning architecture that incorporates the input’s label and definition for classification via Prototypical Network. |
| Outcome: | The proposed model achieves 75% of the maximal F1-score while using less than 10% of the available training data across 4 datasets. |
Explainable Abuse Detection as Intent Classification and Slot Filling (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing models learn what abuse is from labeled examples and base their predictions on spurious cues. |
| Approach: | They propose a machine-friendly representation of the policy that moderators wish to enforce by breaking it down into intents and slots. |
| Outcome: | The proposed model breaks down a social media policy into intents and slots and provides a rationale for its decisions. |
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection. |
| Approach: | They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance. |
| Outcome: | The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality. |
MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection (2026.acl-industry)
Copied to clipboard
| Challenge: | Traditional phishing website detection relies on static heuristics or reference lists, which lag behind rapidly evolving attacks. |
| Approach: | They propose a memory-augmented multi-modal LLM agent that leverages episodic memories to guide decisions on recurring and novel threats. |
| Outcome: | The proposed agent outperforms state-of-the-art phishing detection tools on two public datasets and improves recall by 20%. |
Enhancing Society-Undermining Disinformation Detection through Fine-Grained Sentiment Analysis Pre-Finetuning (2024.findings-eacl)
Copied to clipboard
| Challenge: | a new method for disinformation detection is needed to address the issue of disinformation, authors argue . a series of rigorous experiments establishes a notable connection between disinformation and fine-grained sentiment labels . |
| Approach: | They propose a method leveraging pre-finetuning concept for efficient detection and removal of disinformation that may undermine society. |
| Outcome: | The proposed method improves performance across languages and languages, showing promising results. |
Learning Auxiliary Tasks Improves Reference-Free Hallucination Detection in Open-Domain Long-Form Generation (2025.acl-short)
Copied to clipboard
Chengwei Qin, Wenxuan Zhou, Karthik Abinav Sankararaman, Nanshu Wang, Tengyu Xu, Alexander Radovic, Eryk Helenowski, Arya Talebzadeh, Aditya Tayade, Sinong Wang, Shafiq Joty, Han Fang, Hao Ma
| Challenge: | Existing methods for detecting hallucination in long-form tasks focus on limited domains or rely heavily on external fact-checking tools, which may not always be available. |
| Approach: | They propose a new paradigm that augments fine-tuning with an auxiliary task for the model to jointly learn with the main task of hallucination detection. |
| Outcome: | The proposed method outperforms existing methods for detecting hallucination in open-domain long-form generation and is more accurate than random guessing. |
Author Profiling for Abuse Detection (C18-1)
Copied to clipboard
| Challenge: | Existing methods for detecting abusive content rely on textual cues and lexical cue information. |
| Approach: | They propose a method that incorporates community-based profiling features of Twitter users to detect abusive content by using a dataset of 16k tweets. |
| Outcome: | The proposed approach outperforms the current state-of-the-art in abuse detection on a dataset of 16k tweets. |
Toward Informal Language Processing: Knowledge of Slang in Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have offered a strong potential for natural language systems to process informal language. |
| Approach: | They propose to use movie subtitles to evaluate slang in large language models . they find that smaller LLMs finetuned on the dataset achieve comparable performance . |
| Outcome: | The proposed dataset can be used to evaluate LLMs on slang detection and identification of regional and historical sources for interpretive insights. |
Detection-Correction Structure via General Language Model for Grammatical Error Correction (2024.acl-long)
Copied to clipboard
| Challenge: | Grammatical error correction (GEC) is a task dedicated to rectifying texts with minimal edits. |
| Approach: | They propose a detection-correction structure based on the general language model which integrates detection and correction into a single model. |
| Outcome: | The proposed model outperforms the state-of-the-art models on English and Chinese datasets. |
Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect category detection (ACD) aims to automatically identify user-concerned aspects from online reviews. |
| Approach: | They propose a method that relies on the category name of each aspect and a pretrained language model to generate constraints for clustering. |
| Outcome: | The proposed framework performs better than existing weakly supervised methods on nine benchmark datasets. |
Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for unknown intent detection are limited by prior knowledge of class labels. |
| Approach: | They propose to use a Gaussian mixture model to model utterance embeddings with a distribution and inject dynamic class semantic information into Gausssian means. |
| Outcome: | The proposed model performs well on three real task-oriented dialogue datasets in two languages. |
Detection of Adversarial Prompts with Model Predictive Entropy (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly deployed in high-impact scenarios raising concerns about their safety and security. |
| Approach: | They propose an attack-agnostic pipeline for detecting adversarial inputs without prior knowledge of attack specifications. |
| Outcome: | The proposed pipeline outperforms traditional defenses in terms of adaptability and resource efficiency. |
Identifying Bias in Machine-generated Text Detection (2026.acl-long)
Copied to clipboard
| Challenge: | a growing number of generative AI systems are detecting text generated by a model or written by . humans perform poorly at the detection task, but show no significant biases on the studied attributes. |
| Approach: | They examine gender, race/ethnicity, English-language learner status, and economic status . they find several models tend to classify disadvantaged groups as machine-generated . |
| Outcome: | The proposed models show strong performance but can cause negative impacts . the models classify disadvantaged groups as machine-generated, while economically disadvantaged students' essays are less likely to be classified as machine generated . |
Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformation (2022.naacl-main)
Copied to clipboard
| Challenge: | Detecting out-of-context media is a problem in domains of public significance . a method that leverages automatically generated hard image-text mismatches is proposed . |
| Approach: | They propose a method that leverages automatically generated hard image-text mismatches to detect out-of-context media . they analyze tweets relevant to topics such as COVID-19, Climate Change and Military Vehicles . |
| Outcome: | The proposed method improves detection accuracy over a strong baseline on a set of fakes created by humans. |
RAG-HAT: A Hallucination-Aware Tuning Pipeline for LLM in Retrieval-Augmented Generation (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) has emerged as a significant advancement in the field of large language models (LLMs). |
| Approach: | They propose a method that uses hallucination detection labels to correct hallucines by integrating up-to-date information into their initial training. |
| Outcome: | The proposed method is based on the Retrieval Augmented Generation (RAG) method, which has shown to be effective in mitigating hallucinations and improving answer quality. |
HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter (2025.acl-long)
Copied to clipboard
Manuel Tonneau, Diyi Liu, Niyati Malhotra, Scott A. Hale, Samuel Fraiberger, Victor Orozco-Olvera, Paul Röttger
| Challenge: | Prior work on automated hate speech detection models has been limited due to systematic biases in evaluation datasets and poor performance across geographies. |
| Approach: | They propose to construct a global hate speech dataset representative of social media settings from tweets posted on September 21, 2022. |
| Outcome: | The proposed dataset covers eight languages and four English-speaking countries and covers eight countries where English is the main language on Twitter. |
Open-Set Semi-Supervised Text Classification via Adversarial Disagreement Maximization (2024.acl-long)
Copied to clipboard
| Challenge: | Open-Set Semi-Supervised Text Classification (OSTC) aims to train a classification model on a limited set of labeled texts along with plenty of unlabeled examples. |
| Approach: | They propose to train a classification model on a limited set of labeled texts alongside plenty of unlabeled examples that include both in-distribution and out-of-difference examples. |
| Outcome: | The proposed model improves on outlier detection and abnormal example detection and calibration. |
Searching for fingerspelled content in American Sign Language (2022.acl-long)
Copied to clipboard
| Challenge: | Sign language processing is gaining interest in the computer vision and natural language processing communities. |
| Approach: | They propose a model that jointly detects fingerspelling and matches it to a text sequence. |
| Outcome: | The proposed model outperforms baseline methods on a large public dataset of ASL fingerspelling in the wild. |
Behind Closed Words: Creating and Investigating the forePLay Annotated Dataset for Polish Erotic Discourse (2025.acl-long)
Copied to clipboard
| Challenge: | specialized Polish language models are more effective at detecting harmful content than traditional methods. |
| Approach: | They propose a Polish-language dataset for erotic content detection that captures ambiguity, violence, and socially unacceptable behaviors. |
| Outcome: | The proposed dataset shows that specialized Polish language models achieve superior performance compared to multilingual alternatives, with transformer-based architectures showing particular strength in handling imbalanced categories. |
Adaptive Prompting: Ad-hoc Prompt Composition for Social Bias Detection (2025.naacl-long)
Copied to clipboard
Maximilian Spliethöver, Tim Knebler, Fabian Fumagalli, Maximilian Muschalik, Barbara Hammer, Eyke Hüllermeier, Henning Wachsmuth
| Challenge: | Existing prompting techniques for large language models depend on several parameters, such as the task, language model, and context provided. |
| Approach: | They propose an adaptive prompting approach that predicts the optimal prompt composition ad-hoc for a given input. |
| Outcome: | The proposed approach ensures high detection performance and is best in several settings. |
LLMDet: A Third Party Large Language Models Generated Text Detection Tool (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing detection tools rely on access to LLMs and can only distinguish between machine-generated and human-authored text. |
| Approach: | They propose a model-specific, secure, efficient, and extendable detection tool that can source text from specific LLMs. |
| Outcome: | The proposed tool can source text from specific LLMs, such as GPT-2, OPT, LLaMA, and others. |
DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects (2026.acl-long)
Copied to clipboard
| Challenge: | Current disinformation detection systems are predominantly developed and evaluated on Standard American English (SAE) . however, their robustness to dialectal variation is unexplored. |
| Approach: | They propose a benchmark for evaluating disinformation detection robustness across 50 English dialects . they use multi-value's linguistically-grounded transformations to introduce D-CUBE (Dialectal Disinformation Detection Corpus) |
| Outcome: | The proposed model outperforms zero-shot LLMs in human-written dialects while AI-generated content remains stable. |
Detecting cognitive impairments by agreeing on interpretations of linguistic features (N19-1)
Copied to clipboard
| Challenge: | Linguistic features have shown promising applications for detecting cognitive impairments. |
| Approach: | They propose a framework to classify after reaching agreements between modalities by using linguistic features to divide linguistic subsets into subset and let neural networks learn low-dimensional representations that agree with each other. |
| Outcome: | The proposed framework outperforms existing classifiers using all of the 413 linguistic features. |
PromptKeeper: Safeguarding System Prompts for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | PromptKeeper is a defense mechanism designed to safeguard system prompts . adversarial and regular queries can exploit LLM vulnerabilities to expose hidden prompts. |
| Approach: | PromptKeeper is a defense mechanism designed to safeguard system prompts . it detects both explicit and subtle leakage and regenerates responses using a dummy prompt . |
| Outcome: | PromptKeeper detects and mitigates side-channel vulnerabilities when prompts are exposed . it regenerates responses using a dummy prompt, ensuring outputs remain indistinguishable from typical interactions . |
Iron Sharpens Iron: Defending Against Attacks in Machine-Generated Text Detection with Adversarial Training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing MGT detectors are vulnerable to simple perturbations and adversarial attacks. |
| Approach: | They propose an adversarial framework for training a robust machine-generated text detector called GREedy Adversary PromoTed DefendER. |
| Outcome: | The proposed framework reduces the Attack Success Rate (ASR) by 0.67% compared with SOTA defense methods. |
WaterSeeker: Pioneering Efficient Detection of Watermarked Segments in Large Documents (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on distinguishing fully watermarked text from non-watermarked text, overlooking real-world scenarios where LLMs generate only brief segments within longer documents. |
| Approach: | They propose a method to detect watermarked segments in large documents using an anomaly extraction method and a local traversal. |
| Outcome: | The proposed method achieves a superior balance between detection accuracy and computational efficiency. |
Early Rumour Detection (N19-1)
Copied to clipboard
| Challenge: | Existing studies on rumour detection are concerned with timing, but few are interested in how early we can detect them. |
| Approach: | They propose a method that integrates reinforcement learning to learn the minimum number of posts required before classifying an event as a rumour. |
| Outcome: | The proposed model detects rumours earlier than state-of-the-art systems while maintaining comparable accuracy. |
Automatic Detection of Generated Text is Easiest when Humans are Fooled (2020.acl-main)
Copied to clipboard
| Challenge: | Recent advances in neural language modelling make it possible to rapidly generate vast amounts of human-sounding text. |
| Approach: | They compare decoding methods with popular sampling-based decoding strategies . they show that multi-sentence excerpts can fool expert human raters over 30% of the time . |
| Outcome: | The proposed methods improve with longer excerpt length, but multi-sentence excerpts fool human raters over 30% of the time. |
LazyReview: A Dataset for Uncovering Lazy Thinking in NLP Peer Reviews (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models struggle to detect lazy thinking in a zero-shot setting, but instruction-based fine-tuning significantly boosts performance by 10-20 performance points. |
| Approach: | They propose to use LazyReview to train junior reviewers in the community to detect lazy thinking in peer-review sentences annotated with fine-grained lazy thinking categories. |
| Outcome: | The proposed dataset shows that LLMs struggle to detect lazy thinking instances in a zero-shot setting, while instruction-based fine-tuning significantly boosts performance by 10-20 performance points. |
Mitigating Bias in Session-based Cyberbullying Detection: A Non-Compromising Approach (2021.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to enhance the performance of session-based cyberbullying detection have overlooked unintended social biases in existing datasets. |
| Approach: | They propose a model-agnostic debiasing strategy that leverages a reinforcement learning technique to mitigate unintended biases in existing datasets. |
| Outcome: | The proposed approach can mitigate unintended biases without impairing the detection performance. |
Detection of Human and Machine-Authored Fake News in Urdu (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fake news detection focus on binary classification and English texts, ignoring the distinction between machine-generated true vs. fake news and low-resource languages. |
| Approach: | They propose to include machine-generated news focusing on Urdu to improve accuracy and robustness. |
| Outcome: | The proposed strategy improves accuracy and robustness across four datasets in various settings. |
WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for moderation of abusive content are limited by the lack of large corpora of conversations. |
| Approach: | They propose a framework with comment-level abuse annotations based on the Wikipedia Comment corpus . they propose 'context-based' approaches to detect abusive content based upon conversational context . |
| Outcome: | The proposed framework can be used to improve the moderation process of abusive content on the Internet. |
FlowMalTrans: Unsupervised Binary Code Translation for Malware Detection Using Flow-Adapter Architecture (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using deep learning to detect malware has attracted great attention due to its notable performance. |
| Approach: | a new approach uses Neural Machine Translation and Normalizing Flows to apply deep learning to malware detection. |
| Outcome: | The proposed approach reduces the burden of data collection by enabling malware detection across multiple ISAs. |
Task-Agnostic Detector for Insertion-Based Backdoor Attacks (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for textual backdoor detection are task-specific and less effective beyond sentence classification. |
| Approach: | They propose a task-agnostic method for backdoor detection that leverages final layer logits and an efficient pooling technique. |
| Outcome: | TABDet can jointly learn from diverse task-specific models, demonstrating superior detection efficacy over traditional methods. |
Open-Topic False Information Detection on Social Networks with Contrastive Adversarial Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for false information detection on social networks are too harsh for actual social networks that contain both seen and unseen topics simultaneously. |
| Approach: | They propose an open-topic scenario that assumes that all test data topics are seen or unseen by the model, but which is too harsh for actual social networks that contain both seen and unseened topics simultaneously. |
| Outcome: | The proposed model improves on two benchmark datasets and a variety of graph neural networks on two social networks and shows that it is more accurate than existing models. |
Neural Deepfake Detection with Factual Structure of Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to deepfake detection typically represent documents with coarse-grained representations, but they struggle to capture factual structures of documents. |
| Approach: | They propose a graph-based model that captures factual structures of documents for deepfake detection. |
| Outcome: | The proposed model improves strong base models built with RoBERTa on two public deepfake datasets. |
What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection (2024.acl-long)
Copied to clipboard
| Challenge: | Social media bot detection has always been an arms race between advancements in machine learning and adversarial bot strategies to evade detection. |
| Approach: | They propose a mixture-of-heterogeneous-experts framework to divide and conquer diverse user information modalities and propose LLM-guided manipulation of user textual and structured information to evade detection. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines on 1,000 annotated examples while bringing down existing detectors by 29.6% and harming calibration and reliability of bot detection systems. |
HENIN: Learning Heterogeneous Neural Interaction Networks for Explainable Cyberbullying Detection on Social Media (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting cyberbullying rely on text analysis of social media sessions. |
| Approach: | They propose a deep model that uses a comment encoder and a post-comment co-attention sub-network to explain why a media session is identified as cyberbullying. |
| Outcome: | The proposed model outperforms existing models on real datasets and shows evidential comments in the model explainability of cyberbullying detection. |
End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to detect depression from social media posting history are limited by frozen screening models and lack of learning. |
| Approach: | They propose to use a frozen screening model to train a risky post detection model with psychiatric scales to enable a learnable end-to-end learning process. |
| Outcome: | The proposed model outperforms several strong baseline methods and qualitative analysis confirms that it better captures users’ mental states than others. |
An Event-comment Social Media Corpus for Implicit Emotion Analysis (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for identifying implicit emotions have been poor in analyzing explicit emotions. |
| Approach: | They propose to construct a Chinese eventcomment social media emotion corpus which deals with both explicit and implicit emotions with more emphasis being placed on the implicit ones. |
| Outcome: | The proposed corpus will be useful for both explicit and implicit emotion classification and detection as well as event classification. |
Open Schrödinger’s Closed Box: Identifying Retrieval Augmented Generation in API-Accessible Large Language Model Services (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are powerful at question-answering but prone to hallucinations due to limited domain-specific or up-to-date knowledge. |
| Approach: | They propose a framework for IDentifying RAG properties in LLM services that integrates LLMs with retrieval systems and adds an external retriever and knowledge database to mitigate hallucinations. |
| Outcome: | The proposed framework detects RAG-enhanced LLMs with 99.97% accuracy with partial or no optional knowledge and nearly 100% when the LLM and database are known. |
WaterPool: A Language Model Watermark Mitigating Trade-Offs among Imperceptibility, Efficacy and Robustness (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to trace the usage of large language models often face trade-offs between imperceptibility and robustness. |
| Approach: | They propose a key-centered scheme to unify existing methods by decomposing a watermark into two components: a 'key module' and a "mark module". |
| Outcome: | The proposed method can be integrated with existing methods and achieve near-optimal imperceptibility and detection efficacy. |
Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detection (2024.lrec-main)
Copied to clipboard
Pei Wang, Keqing He, Yejie Wang, Xiaoshuai Song, Yutao Mou, Jingang Wang, Yunsen Xian, Xunliang Cai, Weiran Xu
| Challenge: | Out-of-domain (OOD) intent detection is crucial for task-oriented dialogue systems. |
| Approach: | They conduct a comprehensive evaluation of large language models (LLMs) under various experimental settings and outline their strengths and weaknesses. |
| Outcome: | The proposed models exhibit strong zero-shot and few-shot capabilities, but is still at a disadvantage compared to models fine-tuned with full resource. |
Self-contradictory reasoning evaluation and detection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown impressive reasoning ability, but many downstream reasoning tasks focus on performance-wise evaluation. |
| Approach: | They define and assess the Self-Contra rate across three datasets and delve into finer-grained categories of Self-contra reasoning. |
| Outcome: | The proposed model can detect self-contra reasoning with a 52.2% F1 score, much lower than for humans. |
StereoDetect: Detecting Stereotypes and Anti-stereotypes the Correct Way Using Social Psychological Underpinnings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Stereotypes are known to have harmful effects, making their detection critical . current research focuses on detecting and evaluating stereotypical biases . |
| Approach: | They propose a five-tuple definition and provide precise terminologies disentangling stereotypes, antistereotypes, stereotypical bias, and general bias. |
| Outcome: | The proposed framework disentangles stereotypes, antistereotypes, stereotypical bias, and general bias. |
Sanitizing Large Language Models in Bug Detection with Data-Flow (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have potential in code reasoning tasks but the hallucination effect can compromise the reliability of bug reports. |
| Approach: | They propose a new schema of bug detection that enforces LLMs to emit data-flow paths in few-shot chain-of-thought prompting and validates them via the program-property decomposition. |
| Outcome: | The proposed approach achieves 91.03% precision and 74.00% recall upon synthetic benchmarks and boosts precision by 21.99% with the sanitization. |
Joint Detection and Location of English Puns (N19-1)
Copied to clipboard
| Challenge: | Existing research on puns has focused on understanding the meanings of words and phrases. |
| Approach: | They propose a model that addresses pun detection and pun location jointly from a sequence labeling perspective. |
| Outcome: | Empirical results show that the proposed model can handle both homographic and heterographic puns. |
ImaRA: An Imaginative Frame Augmented Method for Low-Resource Multimodal Metaphor Detection and Explanation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for multimodal metaphor detection neglect cross-domain and attribute similarity characteristics underlying multimodal understanding. |
| Approach: | They propose an Imaginative FRame Augmented method for multimodal metaphor detection and explanation . they use a cross-modal imagination dataset rich in multimodal multimodal expressions . |
| Outcome: | The proposed method outperforms existing methods with training data on two datasets. |
Uncovering Temporal Framing in the News (2026.acl-long)
Copied to clipboard
Tarek Mahmoud, Veronika Solopova, Premtim Sahitaj, Ariana Sahitaj, Max Upravitelev, Mervat Abassy, Hana Fatima Shaikh, Neda Foroutan, Vera Schmitt, Preslav Nakov
| Challenge: | Temporal language is used to structure meaning rather than report chronology in news discourse . a recent study focused on temporal expression extraction and temporal reasoning . |
| Approach: | They propose a taxonomy of eight temporal frames grounded in prior work on time and framing . they analyze frame prevalence, co-occurrence patterns, and lexical cues from a news corpus . |
| Outcome: | The proposed taxonomy outperforms zero-shot models at the sentence level . it shows that temporal framing is learnable at the sentences level compared to other methods . |
Advancing Beyond Identification: Multi-bit Watermark for Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to detect machine-generated text focus on detection, but some misuses require tracing the adversary user for counteracting them. |
| Approach: | They propose a method for embedding traceable multi-bit information during language model generation. |
| Outcome: | The proposed method outperforms existing methods in terms of robustness and latency while maintaining text quality. |
Bi-DCSpell: A Bi-directional Detector-Corrector Interactive Framework for Chinese Spelling Check (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Chinese Spelling Check (CSC) aims to detect and correct potentially misspelled characters in Chinese sentences. |
| Approach: | They propose a bi-directional Detector-Corrector framework for Chinese Spelling Check which mutually enhances the feature representation for detection and correction subtasks. |
| Outcome: | The proposed framework reduces the risk of over-correction and under-corrections while preserving the knowledge learnt from correction. |
Negative Focus Detection via Contextual Attention Mechanism (D19-1)
Copied to clipboard
| Challenge: | Negation is a universal but complicated linguistic phenomenon that reverses the polarity of a statement or its property into opposite. |
| Approach: | They propose a framework which consists of a Bidirectional Long Short-Term Memory neural network and a Conditional Random Fields layer to capture contextual information. |
| Outcome: | The proposed framework improves on the SEM’12 shared task corpus, yielding an absolute improvement of 2.11% over the state-of-the-art. |
CEDAR: A Chinese Evaluation Dataset for Computational Argumentation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing debate datasets neglect important labels for argument mining, generation, and evaluation. |
| Approach: | They propose a Chinese Evaluation Dataset for Computational Argumentation that includes key arguments and key rhetorical figures, debater roles, modal words, debate results and transcripts. |
| Outcome: | The proposed dataset covers 600 debates about 318 topics from Chinese debate competitions. |
Uncertainty-Guided Modal Rebalance for Hateful Memes Detection (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for integrating hate information from different modalities ignore the modality uncertainty caused by the contribution degree of each modality to hate sentiment. |
| Approach: | They propose an Uncertainty-guided Modal Rebalance framework for hateful memes detection . they propose to combine cross-modal fusion features with unimodal features . |
| Outcome: | The proposed framework produces state-of-the-art performance on four widely-used datasets. |
Revisiting Early Detection of Sexual Predators via Turn-level Optimization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to detect online grooming rely on chat-level risk labels and fail to identify optimal intervention points. |
| Approach: | They propose a speed control reinforcement learning strategy based on luring communication theory to capture the predator’s turn-level entrapment and a new reward function that balances the trade-off between speed and accuracy based upon the LCT. |
| Outcome: | The proposed method preempts online grooming while identifying optimal early intervention points. |
CLoSE: Contrastive Learning of Subframe Embeddings for Political Bias Classification of News Media (2022.coling-1)
Copied to clipboard
| Challenge: | Framing is a political strategy in which journalists and politicians emphasize certain aspects of an issue to influence and sway public opinion. |
| Approach: | They propose a BERT-based model which embeds indicators of frames from news articles in order to predict political bias. |
| Outcome: | The proposed model performs on subframes and political bias classification tasks and is able to detect political bias on both zero-shot and few-shot learning tasks. |
Syntactic Graph Convolutional Network for Spoken Language Understanding (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on slot filling and intent detection builds joint models without prior knowledge of linguistic knowledge. |
| Approach: | They propose a joint model that integrates syntactic structure for learning slot filling and intent detection jointly. |
| Outcome: | The proposed model outperforms existing models on two public benchmark datasets and further improves on slot filling and intent detection. |
Multimodal Event Transformer for Image-guided Story Ending Generation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods focus on cross-modal feature fusion but overlook reasoning and mining implicit information from story plots and ending image. |
| Approach: | They propose a multimodal event transformer framework for image-guided story ending generation. |
| Outcome: | The proposed method achieves state-of-the-art performance for image-guided story ending generation. |
Pre- and In-Parsing Models for Neural Empty Category Detection (P18-1)
Copied to clipboard
| Challenge: | Existing studies on empty category detection have shown positive effects on syntactic parsing . empty categories are used to indicate long-distance dependencies, discontinuous constituents, and certain dropped elements. |
| Approach: | They propose to use ECD to detect empty categories without syntactic analysis. |
| Outcome: | The proposed models outperform the prior state-of-the-art by significant margins. |
Bridging Attribution and Open-Set Detection using Graph-Augmented Instance Learning in Synthetic Speech (2026.eacl-long)
Copied to clipboard
| Challenge: | Synthetic speech detection is a critical part of safeguarding digital communication, enabling systems to identify and mitigate the risks posed by highly realistic, machine-generated voices. |
| Approach: | They propose a framework that combines SFMs with graph-based modeling and open-set generalization to capture meaningful relationships between utterances and recognize speech that doesn’t belong to any known generator. |
| Outcome: | The proposed framework improves performance across both tasks, with Mamba-based embeddings delivering particularly strong results. |
TWEETSPIN: Fine-grained Propaganda Detection in Social Media Using Multi-View Representations (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies on propaganda detection involve document and fragment-level analyses of news articles. |
| Approach: | They propose a neural approach to detect and categorize propaganda tweets across fine-grained categories . they use a dataset containing tweets weakly annotated with different propaganda techniques . |
| Outcome: | The proposed method outperforms benchmark methods and transfers knowledge to low-resource news domains. |
A Multi-Task Learning Framework for Modeling Engagement and Topic-Sensitive Responses in Arabic Women’s Discourse (2026.findings-eacl)
Copied to clipboard
| Challenge: | a corpus of 158k arab Facebook posts spanning women's rights, gender debates, and economic empowerment reveals patterns of public opinion that vary dramatically across regional and cultural contexts. |
| Approach: | They propose a multi-task learning framework that learns audience reaction classification and engagement magnitude regression and non-engagement detection. |
| Outcome: | The proposed model achieves a test macro-F1 of 72.4 and weighted-F1. It measures 158k posts across gender issues, legal rights advocacy, gender identity discussions, and economic empowerment. |
Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: A Case Study on Hateful Memes (2024.lrec-main)
Copied to clipboard
| Challenge: | Causal analyses define semantics, while gradient-based methods are essential to eXplainable AI (XAI), interpreting the model’s ‘black box’. |
| Approach: | They propose to integrate causal analysis and XAI to integrate a model's mechanisms into their analysis by integrating a dataset of hateful meme detection models. |
| Outcome: | The proposed model can detect hateful memes using intersectionality principles and summarized attention scores highlight distinct behaviors of three Transformer models. |
Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Mis- and disinformation online are a major source of harms of different kinds . out-of-context information is where different pieces of information are falsely associated . past studies have attempted to defend against OOC mis- and deinformation through external evidence, but they disregard the role of different pieces with different stances. |
| Approach: | They propose a stance extraction network that can extract stances of different pieces of evidence in a single framework. |
| Outcome: | The proposed model outperforms the state-of-the-art models on a public large-scale dataset with a performance gain of 3.2% in accuracy. |
From the Detection of Toxic Spans in Online Discussions to the Analysis of Toxic-to-Civil Transfer (2022.acl-long)
Copied to clipboard
| Challenge: | a dataset of English posts with annotations of toxic spans is released . sequence labeling models perform best, but rationale extraction methods are promising . |
| Approach: | They propose a dataset for toxic spans detection that includes an annotation of toxic posts . they propose to add generic rationale extraction mechanisms to the model to obtain toxic span information . |
| Outcome: | The proposed framework is based on a dataset of English posts with toxic span annotations . it shows that sequence labeling models perform best, but that rationale extraction methods are promising . |
PsyGUARD: An Automated System for Suicide Detection and Risk Assessment in Psychological Counseling (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems for fine-grained suicide detection and risk assessment are lacking . a lack of domain-specific systems for this task poses a challenge to automated crisis intervention aimed at suicide prevention. |
| Approach: | They propose to use a fine-grained suicide detection system to assess risk in counseling . they develop a taxonomy for detecting suicide ideation and a large-scale dataset . |
| Outcome: | The proposed system detects suicidal ideation and assesses risk in counseling . it can provide safe, helpful, and tailored responses for further assessment . |
Detecting Continuously Evolving Scam Calls under Limited Annotation: A LLM-Augmented Expert Rule Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to detect scam calls rely on labeled data and assume static distribution of scam narratives. |
| Approach: | They propose a method leveraging large language models to detect continuously evolving scam calls . scammers continuously evolve their tactics, making these methods less effective . |
| Outcome: | The proposed approach is based on large language models to detect continuously evolving scam calls. |
Standardizing Distress Analysis: Emotion-Driven Distress Identification and Cause Extraction (DICE) in Multimodal Online Posts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for identifying hate speech have been limited to analyzing textual content. |
| Approach: | They propose a method for distress identification and cause extraction from social media posts using emotional information. |
| Outcome: | The proposed method improves F1 and ROS scores by 1.95% and 3% relative to the best-performing baseline. |
An Error-Guided Correction Model for Chinese Spelling Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural network approaches have achieved great progress on Chinese spelling correction, but there is still room for improvement. |
| Approach: | They propose an error-guided correction model that uses pre-trained BERT models to detect errors and integrate the error confusion set into the model. |
| Outcome: | The proposed model outperforms state-of-the-art models on widely used benchmarks and achieves superior performance on both quality and computation speed. |
Text Meets Topology: Rethinking Out-of-distribution Detection in Text-Rich Networks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for out-of-distribution (OOD) detection ignore textual-structural diversity . text-rich networks (TrNs) represent complex interplay between textual content and relational structures . |
| Approach: | They propose a framework for evaluating out-of-distribution detection in text-rich networks . they propose augmentations, structural shifts, and domain-based divisions to model interplay . |
| Outcome: | Experiments on 11 datasets show the framework is effective in out-of-distribution detection. |
Modeling Users and Online Communities for Abuse Detection: A Position on Ethics and Explainability (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abuse on the Internet is an important societal problem of our time. |
| Approach: | They propose to use user and community information to enhance detection of abusive language . they propose to propose properties that an explainable method should aim to exhibit . |
| Outcome: | The proposed methods leverage user and community information to enhance detection of abusive language. |
Exploring the Limitations of Detecting Machine-Generated Text (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in the quality of the generation of text by large language models have spurred research into identifying machine-generated text. |
| Approach: | They audit classification performance for detecting machine-generated text by evaluating on texts with varying writing styles. |
| Outcome: | The proposed methods are highly sensitive to stylistic changes and complexity, and in some cases degrade entirely to random classifiers. |
MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods neglect stylistic modeling and rely on static thresholds, which greatly limits the detection performance. |
| Approach: | They propose a framework that enables stylistics-aware uncertainty quantification through conditional threshold estimation. |
| Outcome: | The proposed framework achieves an average improvement 11.34% in detection performance compared to baselines. |
FactSelfCheck: Fact-Level Black-Box Hallucination Detection for LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to detect hallucinated content are limited by their tendency to generate factual errors. |
| Approach: | They propose a black-box sampling-based method that enables fine-grained fact-level detection by representing text as interpretable knowledge graphs consisting of facts in the form of triples. |
| Outcome: | The proposed method improves hallucination correction by 35.5% compared to baseline methods while sentence-level SelfCheckGPT yields only 10.6% improvement. |
Towards Intention Understanding in Suicidal Risk Assessment with Natural Language Processing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Suicide is a global problem, with one suicide case for every 100 deaths worldwide . social networking sites are an essential forum for communication and information sharing . |
| Approach: | This paper compares natural language processing to suicidal ideation detection and risk assessment . it urges better intention understanding for reliable suicide risk assessment with computational methods . |
| Outcome: | This paper compares the performance of natural language processing to suicidal ideation detection and risk assessment tasks. |
Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak attacks primarily utilize scenario camouflage techniques, however their explicit mention of malicious intent will be easily recognized and defended by LLMs. |
| Approach: | They propose an indirect jailbreak attack approach, Puzzler, which can bypass LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
| Outcome: | The proposed approach can bypass the LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
QuantileMark: A Message-Symmetric Multi-bit Watermark for LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | a number of large language models (LLMs) require multi-bit watermarking to ensure provenance. |
| Approach: | They propose a multi-bit watermark that embeds messages within a continuous cumulative probability interval. |
| Outcome: | The proposed watermark breaks message symmetry in low-entropy decoding, showing it can be used for verification and quality verification. |
LLM Jailbreak Detection for (Almost) Free! (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detecting jailbreak prompts entail significant computational costs . |
| Approach: | They propose a free jailbreak detection method which scales logits by temperature to detect jailbreak prompts . |
| Outcome: | The proposed method detects jailbreak prompts with no additional computational costs. |
VoteTRANS: Detecting Adversarial Text without Training by Voting on Hard Labels of Transformations (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting adversarial attacks need original/adversarial data. |
| Approach: | They propose to detect adversarial text by voting on hard labels from predictions of transformations using a model that uses original/adversarial data. |
| Outcome: | The proposed method detects adversarial text across various state-of-the-art attacks, models, and datasets without training. |
Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbations (2022.lrec-1)
Copied to clipboard
| Challenge: | toxicity classifiers rely on lexical cues, so creative language use can be detrimental to utility of current corpora and state-of-the-art models. |
| Approach: | They propose to use model-agnostic adversarial behavior to enhance toxic content classification models. |
| Outcome: | The proposed model-agnostic adversarial behavior and augmentation for cyberbullying detection are robust against word-level perturbations at a slight trade-off in overall task performance. |
Faithfulness-Aware Uncertainty Quantification for Fact-Checking the Output of Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
Ekaterina Fadeeva, Aleksandr Rubashevskii, Dzianis Piatrashyn, Roman Vashurin, Shehzaad Dhuliawala, Artem Shelmanov, Timothy Baldwin, Preslav Nakov, Mrinmaya Sachan, Maxim Panov
| Challenge: | Existing approaches to mitigating hallucinations conflate factuality with faithfulness to the retrieved evidence, incorrectly labeling factually correct statements as hallucinos . Existing methods to mitigate hallucinics rely on a lack of training data coverage, input ambiguity, and architectural constraints. |
| Approach: | They propose a method for hallucination detection in Large Language Models enhanced with knowledge retrieval based on faithfulness to the retrieved context. |
| Outcome: | The proposed method outperforms unsupervised UQ baselines, RAG-specific methods, and supervised classifiers across multiple tasks and LLMs. |
Invisible Entropy: Towards Safe and Efficient Low-Entropy LLM Watermarking (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to watermark low-entropy content are expensive and risky . IE reduces parameter size by 99% while achieving performance on par with state-of-the-art methods . |
| Approach: | They propose a logit-based watermarking paradigm that uses entropy-based features to predict whether the next token is high or low. |
| Outcome: | The proposed method reduces parameter size by 99% while achieving performance on par with state-of-the-art methods. |
Multi-Aspect Transfer Learning for Detecting Low Resource Mental Disorders on Social Media (2022.lrec-1)
Copied to clipboard
| Challenge: | Mental disorders are an important and pervasive public health issue. |
| Approach: | They propose to use linguistic features to improve mental disorder detection . they propose to apply multi-aspect transfer learning to detecting disorders from social media . |
| Outcome: | The proposed methods can be used to improve mental disorder detection in the context of data scarcity and understanding the overlapping symptoms between disorders. |
Identifying Medical Self-Disclosure in Online Communities (2021.naacl-main)
Copied to clipboard
| Challenge: | a new dataset of health-related posts from online social platforms is available for analysis . medical self-disclosure may be useful for early detection and treatment of medical issues . |
| Approach: | They propose to analyze medical self-disclosure in online health conversations . they release a dataset of health-related posts from online social platforms with high inter-annotator agreement . |
| Outcome: | The proposed model achieves an accuracy of 81.02% and sets a strong performance benchmark. |
Exploring Large Language Models for Multi-Modal Out-of-Distribution Detection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. |
| Approach: | They propose to apply world knowledge to enhance OOD detection performance through selective generation from large language models (LLMs) they propose to extract visual objects from each image to fully capitalize on the aforementioned world knowledge. |
| Outcome: | The proposed method outperforms the state-of-the-art on visual OOD detection on in-distribution (ID) samples. |
ControversialQA: Exploring Controversy in Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on controversy define it based on vague assumptions of its relation to sentiment . experimental results show controversy detection is essential and challenging . |
| Approach: | They propose a question-answering dataset that defines content controversy by user perception . they show controversy detection is essential and challenging . |
| Outcome: | The proposed dataset defines controversy by user perception, i.e., votes from plenty of users. |
Constrained Multi-Task Learning for Event Coreference Resolution (2021.naacl-main)
Copied to clipboard
| Challenge: | a neural event coreference model is based on a task of determining whether two event mentions refer to the same event . event coreferent tasks require nontrivial tasks such as identifying potential arguments and linking arguments to their event mention. |
| Approach: | They propose a neural event coreference model in which event coreference is jointly trained with five tasks. |
| Outcome: | The proposed model achieves state-of-the-art on the KBP 2017 event coreference dataset. |
ToXCL: A Unified Framework for Toxic Speech Detection and Explanation (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models that focus on explicit toxic speech detection and explanation are prone to error propagation problems . et al., 2018) show that toxic speech models can be prone for generating errors . |
| Approach: | They propose a framework that can detect and explain toxic speech using a target group generator and an encoder-decoder model. |
| Outcome: | The proposed model outperforms baseline models and achieves state-of-the-art effectiveness . the proposed model generates a toxic explanation that matches the ground truth explanation . |
Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models can be used to produce text that is coherent, well-written, and persuasive . some individuals have misused LLMs for nefarious purposes, such as creating fake news articles or engaging in cheating . |
| Approach: | They propose to incorporate a Bayesian surrogate model to improve query efficiency . they propose to select typical samples based on Bayes' uncertainty and interpolate scores . |
| Outcome: | The proposed method significantly outperforms existing approaches under a low query budget. |
Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning (2025.coling-main)
Copied to clipboard
| Challenge: | Online abusive content detection, particularly in low-resource settings, remains underexplored. |
| Approach: | They propose to use pre-trained audio representations to detect abusive language in Indian languages using Few Shot Learning (FSL) . |
| Outcome: | The proposed model can be used to classify abusive language in 10 languages using the ADIMA dataset with FSL. |
Turning the Tide: Repository-based Code Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Code large language models (LLMs) enhance programming by understanding and generating code across languages. |
| Approach: | a new benchmark evaluates code understanding and generation in repositories using code large language models. |
| Outcome: | The proposed model improves code understanding and generation in repositories by evaluating 1,888 test cases across 6 programming languages. |
Detecting Media Bias in News Articles using Gaussian Bias Distributions (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a new study shows that media bias is not only about honesty or accuracy, but also about taste or preference. |
| Approach: | They propose to use second-order information to detect media bias in articles . they propose to analyze the frequency, positions, and sequential order of biased statements . |
| Outcome: | The proposed model outperforms other models that use second-order information on biased statements on an existing media bias dataset. |
PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent studies have raised concerns about the potential threats large language models pose to academic integrity and copyright protection. |
| Approach: | They propose a dataset of 46.5K synthetic text pairs that represent three major types of plagiarism: verbatim copying, paraphrasing, and summarization. |
| Outcome: | The proposed dataset shows that GPT-3.5 Turbo can produce high-quality paraphrases and summaries without significantly increasing text complexity compared to GPT-4 Turbo. |
Disentangled Code Representation Learning for Multiple Programming Languages (2021.findings-acl)
Copied to clipboard
| Challenge: | Developing effective distributed representations of source code is challenging . current code embedding approaches that represent the semantic and syntax of code are less interpretable . |
| Approach: | They propose a disentangled code representation learning approach to separate the semantic from the syntax of source code under a multi-programming-language setting. |
| Outcome: | The proposed approach achieves better interpretability and generalizability over existing methods. |
DocFusion: A Unified Framework for Document Parsing Tasks (2025.findings-acl)
Copied to clipboard
Mingxu Chai, Ziyu Shen, Chong Zhang, Yue Zhang, Xiao Wang, Shihan Dou, Jihua Kang, Jiazheng Zhang, Qi Zhang
| Challenge: | Existing methods for document parsing often employ multiple models, limiting performance . Existing models often employ discrete tokens, whereas recognition relies on continuous coordinates . |
| Approach: | They propose a Gaussian-Kernel Cross-Entropy Loss (GK-CEL) that unifies detection and recognition by enabling generative frameworks to handle both tasks simultaneously. |
| Outcome: | The proposed model performs competitively across four core document parsing tasks. |
Joint Modelling of Emotion and Abusive Language Detection (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for abuse detection focus on linguistic properties of comments and online communities of users, disregarding the emotional state of the users and how this might affect their language. |
| Approach: | They propose to combine emotion and abusive language detection to create a multi-task learning framework that allows one task to inform the other. |
| Outcome: | The proposed model improves on the previous models, incorporating affective features into the learning framework. |
Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, but are vulnerable to backdoor attacks. |
| Approach: | They propose a chain-of-scrutiny approach which leverages LLMs’ unique reasoning abilities to mitigate backdoor attacks. |
| Outcome: | The proposed model is well-suited for the popular API-only LLM deployments, enabling detection at minimal cost and with little data. |
DEIE: Benchmarking Document-level Event Information Extraction with a Large-scale Chinese News Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing event-based datasets mainly target sentence-level tasks . current models struggle with "document" annotation, a key feature of the current model . |
| Approach: | They propose a large-scale document-level event information extraction dataset with over 56,000+ events and 242,000+ arguments. |
| Outcome: | The proposed dataset has over 56,000+ events and 242,000+ arguments. |
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics (2024.lrec-main)
Copied to clipboard
Tyler A. Chang, Katrin Tomanek, Jessica Hoffmann, Nithum Thain, Erin MacMurray van Liemt, Kathleen Meier-Hellstern, Lucas Dixon
| Challenge: | a growing audience of users is engaging with LLM-driven chatbots. |
| Approach: | They propose a strategy to handle controversial topics in LLM-based chatbots based on Wikipedia’s Neutral Point of View principle. |
| Outcome: | The proposed methods detect errors in the tuned LLM responses even when no training data is available. |
Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claims (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect false claims ignore the characteristics of FC-articles . claims are often quoted to describe checked events, providing lexical information . sentence templates to introduce or debunk claims are common across articles, providing pattern information. |
| Approach: | They propose a model to rerank FC-articles using key sentences and pattern information. |
| Outcome: | The proposed model outperforms existing methods on two real-world datasets showing that key sentences can be used to predict if an article fact-checks the given claim. |
GRhOOT: Ontology of Rhetorical Figures in German (2022.lrec-1)
Copied to clipboard
| Challenge: | GRhOOT is a domain ontology of rhetorical figures in the German language . the goal is to allow for easier detection of non-literal language based tasks . |
| Approach: | GRhOOT is a domain ontology of 110 rhetorical figures in the german language . the goal is to allow for easier detection and sentiment analysis . |
| Outcome: | The ontology of rhetorical figures in the German language is based on 110 rhetorical figure domains . the goal is to make the ontologies more accurate and to allow for easier detection . |
Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection (2022.naacl-main)
Copied to clipboard
| Challenge: | toxicity annotations are often ignored because of its subjective nature and lack of nuance. |
| Approach: | They examine the effect of annotator identities and beliefs on toxic language annotations by considering posts with three characteristics: anti-Black language, African American English (AAE) dialect, and vulgarity. |
| Outcome: | The findings show strong associations between annotator identity and beliefs and ratings of toxicity. |
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models that focus on identifying functional (dis)similarity of source code get confused when trying to identify functional (Dis)-similarities. |
| Approach: | They propose to pre-train a Transformer model with such automatically generated program contrasts to better identify similar code in the wild and differentiate vulnerable programs from benign ones. |
| Outcome: | The proposed model outperforms existing models in vulnerability and code clone detection tasks even with much less data. |
Safeguarding Privacy of Retrieval Data against Membership Inference Attacks: Is This Query Too Close to Home? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | delivering private retrieved documents directly to LLMs introduces vulnerability to membership inference attacks . |
| Approach: | They propose a similarity-based membership inference attack detection framework for RAG . they propose obfuscate attackers, maintain data utility, and remain system-agnostic . |
| Outcome: | The proposed framework can detect and hide membership inference attacks, while remaining system-agnostic against them. |
BUST: Benchmark for the evaluation of detectors of LLM-Generated Text (2024.naacl-long)
Copied to clipboard
| Challenge: | Using the benchmark, we evaluated 5 detectors and found substantial performance variance across tasks. |
| Approach: | They propose to evaluate detectors of texts generated by instruction-tuned large language models (LLMs) using a benchmark dataset, they evaluated 5 detectors and found substantial performance variance across tasks. |
| Outcome: | The proposed benchmarks evaluated 5 detectors and found substantial performance variance across tasks. |
Code Vulnerability Detection via Nearest Neighbor Mechanism (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to learn code semantics from source code are difficult to identify. |
| Approach: | They propose a method which retrieves multiple neighbor samples and utilizes label information to provide help for model predictions. |
| Outcome: | Extensive experiments show that the proposed method can achieve obvious performance improvements compared to baseline models. |
Toward Comprehensive Understanding of a Sentiment Based on Human Motives (P19-1)
Copied to clipboard
| Challenge: | a new study examines the motivations of sentiment holder and their relationship to food . aspects of a sentiment are limited to properties of entities such as the price of food and design of . |
| Approach: | They define six basic motives that cover a wide range of topics appearing in review texts . they annotate 1,600 texts in restaurant and laptop domains with the motives . |
| Outcome: | The proposed method improves on annotating 1,600 text with the motives and comparing them to other methods. |
INJONGO: A Multicultural Intent Detection and Slot-filling Dataset for 16 African Languages (2025.acl-long)
Copied to clipboard
Hao Yu, Jesujoba Oluwadara Alabi, Andiswa Bukula, Jian Yun Zhuang, En-Shiun Annie Lee, Tadesse Kebede Guge, Israel Abebe Azime, Happy Buzaaba, Blessing Kudzaishe Sibanda, Godson Koffi Kalipe, Jonathan Mukiibi, Salomon Kabongo Kabenamualu, Mmasibidi Setaka, Lolwethu Ndolela, Nkiruka Odu, Rooweither Mabuya, Shamsuddeen Hassan Muhammad, Salomey Osei, Sokhar Samb, Dietrich Klakow, David Ifeoluwa Adelani
| Challenge: | Slot-filling and intent detection tasks are well-established tasks in Conversational AI, but current benchmarks for these tasks rely on evaluations of low-resource languages and translations from English benchmarks. |
| Approach: | They propose to use a multilingual, open-source benchmark dataset for 16 African languages with utterances generated by native speakers across diverse domains. |
| Outcome: | The proposed dataset compares multilingual transformer models and prompting large language models (LLMs) with the English language. |
Modeling Conceptual Attribute Likeness and Domain Inconsistency for Metaphor Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Metaphor detection aims to distinguish between metaphorical and literal expressions in text. |
| Approach: | They propose an attribute likeness and domain inconsistency learning framework for wordpair metaphor detection based on conceptual metaphor theory . they model attribute likeity with an attribute siamese network and devise a domain contrastive learning strategy to learn semantic inconsistentness of concepts in source and target domains . |
| Outcome: | The proposed framework outperforms existing word-pair and token-level methods on four datasets. |
RECAL: Sample-Relation Guided Confidence Calibration over Tabular Data (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Various machine learning methods for tabular data lack accurate confidence estimation, which is needed for high-risk sensitive applications such as credit modeling and financial fraud detection. |
| Approach: | They propose a general post-training confidence calibration framework to calibrate the confidence of current machine learning models by employing graph neural networks to model the relationships between different samples. |
| Outcome: | The proposed framework improves the confidence estimation on tabular datasets by using graph neural networks to model the relationships between different samples. |
Word-level Prefix/Suffix Sense Detection: A Case Study on Negation Sense with Few-shot Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Morphological analysis is an important research issue in natural language processing . prefixes/suffixes are sometimes ambiguous, causing difficulty in detecting negation sense . |
| Approach: | They propose a context-free morphological analysis task that deals with negation sense . they propose morphology task that uses input-augmentation prompts to train a model . |
| Outcome: | The proposed approach is effective in detecting negation senses in a corpus of prefixes/suffixes . Empirical studies show that the proposed approach works in context-free mode . |
Machine-Generated Text Localization (2024.findings-acl)
Copied to clipboard
| Challenge: | Prior work focused on identifying only part of a document as machine or human written . a key challenge is that short spans of text provide little information indicating if it is machine generated due to its short length . |
| Approach: | They propose a method that localizes the portions of a document that were machine generated. |
| Outcome: | The proposed method can detect changes in style or content to boost performance. |
Structure-adaptive Adversarial Contrastive Learning for Multi-Domain Fake News Detection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models for fake news detection capture domain-shared semantic features but fail to generalize well due to poor adaptability. |
| Approach: | They propose a framework to enable structure knowledge transfer between multiple domains . they compare content-only and propagation-rich data to preserve structural patterns . |
| Outcome: | The proposed framework can learn semantic and structural features across domains. |
Red-Teaming NSFW Image Classifiers as Text-to-Image Safeguards (2026.findings-acl)
Copied to clipboard
Tinghao Xie, Yueqi Xie, Alireza Zareian, Shuming Hu, Felix Juefei-Xu, Xiaowen Lin, Ankit Jain, Prateek Mittal, Li Chen
| Challenge: | Not Safe for Work (NSFW) image classifiers play a critical role in safeguarding text-to-image systems. |
| Approach: | They propose an automated red-teaming framework that leverages a set of generative AI tools to uncover NSFW image failures. |
| Outcome: | The proposed framework uncovers and interprets failure modes and enables it to be applied to real-world T2I and T2V systems. |
Benchmarking the Detection of LLMs-Generated Modern Chinese Poetry (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Detecting AI-generated poetry is difficult due to distinctive characteristics of modern Chinese poetry. |
| Approach: | They propose a benchmark for detecting AI-generated modern Chinese poetry . they use a high-quality dataset and systematic performance assessments . |
| Outcome: | The proposed benchmark is based on a high-quality dataset of 800 poems written by six professional poets and 41,600 poems generated by four mainstream LLMs. |
Mitigating Confounding in Speech-Based Dementia Detection through Weight Masking (2025.acl-long)
Copied to clipboard
| Challenge: | Pre-trained neural language models fine-tuned on AD transcripts perform well, but little research has explored the effects of the gender of the speakers represented by these transcripts. |
| Approach: | They propose to use the Extended Confounding Filter and the Dual Filter to isolate and ablate weights associated with gender in dementia datasets. |
| Outcome: | The proposed methods overfit to training data distributions and disrupt gender-related weights, with the trade-off of slightly reduced dementia detection performance. |
One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them (2026.findings-acl)
Copied to clipboard
| Challenge: | Knowledge editing methods such as ROME and MEMIT update factual associations by modifying MLP weights. |
| Approach: | They propose to use a mask to reverse edits by eliminating overattention in later layers . they also show that injecting the mask during editing drops editing success from 98% to 38% . |
| Outcome: | The proposed method reverses edits by eliminating overattention in later layers and drops editing success from 98% to 38%. |
MAGRET: Machine-generated Text Detection with Rewritten Texts (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies focus on detecting machine-generated text in open-source models, but their performance on closed-source large models is limited. |
| Approach: | They propose a method to detect rewritten text from large language models using a BERT encoder and propose to refine it to achieve semantic alignment. |
| Outcome: | The proposed method outperforms baseline methods on three text-generated datasets. |
Detection of Multiple Mental Disorders from Social Media with Two-Stream Psychiatric Experts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing mental disease detection methods are not backed by domain knowledge and thus fail to produce interpretable results. |
| Approach: | They propose a framework that can learn the shared clues of all diseases while also capturing the specificity of each single disease. |
| Outcome: | Experiments on the detection of 7 diseases show that the proposed model can boost detection performance by more than 10%, especially in relatively rare classes. |
What to Fuse and How to Fuse: Exploring Emotion and Personality Fusion Strategies for Explainable Mental Disorder Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Mental health disorders (MHD) are one of the greatest challenges facing our healthcare systems and modern societies in general. |
| Approach: | They integrate and extend the research by conducting extensive experiments with three types of deep learning-based fusion strategies: feature-level fusion, model fusion and task fusion. |
| Outcome: | The proposed techniques show that they can be used to improve mental health detection from textual data. |
UMRSpell: Unifying the Detection and Correction Parts of Pre-trained Models towards Chinese Missing, Redundant, and Spelling Correction (2023.acl-long)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) is a task of detecting and correcting misspelled charac- ters in Chinese texts. |
| Approach: | They propose a model to learn detection and correction parts together from a multi-task learning perspective. |
| Outcome: | The proposed model can learn detection and correction parts together from a multi-task learning perspective. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
Extracting, Detecting, and Generating Research Questions for Scientific Articles (2025.coling-main)
Copied to clipboard
Sina Taslimi, Artemis Capari, Hosein Azarbonyad, Zi Long Zhu, Zubair Afzal, Evangelos Kanoulas, George Tsatsaronis
| Challenge: | Existing tools to generate and extract RQs from scientific articles lack a definition of RQ in articles. |
| Approach: | They propose to use a set of regular expressions to identify articles with well-defined RQs and a detection component to identify more complex RQ's in articles. |
| Outcome: | The proposed pipeline can detect and generate RQs from scientific articles and generate high-quality ones. |
Confront Insider Threat: Precise Anomaly Detection in Behavior Logs Based on LLM Fine-Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Current methods for insider threat detection suffer from low precision and information loss . a novel approach to detect insider threats is needed to improve accuracy . |
| Approach: | They propose a precise anomaly detection solution based on Large Language Model (LLM) fine-tuning . they represent user behavior in natural language and implement a threat tracing mechanism . |
| Outcome: | The proposed solution achieves an F1 score of 0.8941 on the CERT v6.2 dataset . |
BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency (2023.acl-long)
Copied to clipboard
Zhenyu Lei, Herun Wan, Wenqian Zhang, Shangbin Feng, Zilong Chen, Jundong Li, Qinghua Zheng, Minnan Luo
| Challenge: | Existing methods to identify bots rely on text or networks alone . text-graph interactions and semantic consistency are essential improvements to combat bot evolution. |
| Approach: | They propose to combine text-graph interaction and semantic Consistency to model Twitter bots' behavior based on attention weights and a text-graphic interaction module to enable information exchange across modalities in the learning process. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two widely adopted datasets and the results are consistent with previous work. |
Why Is It Hate Speech? Masked Rationale Prediction for Explainable Hate Speech Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Hate speech cannot be identified based solely on the presence of specific words; model should reason like humans and be explainable. |
| Approach: | They propose to use Masked Rationale Prediction to predict masked human rationales . the method performs hate speech detection robustly in terms of bias and explainability . |
| Outcome: | The proposed method performs state-of-the-art in terms of bias and explainability. |
Generating Fact Checking Briefs (2020.emnlp-main)
Copied to clipboard
Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel
| Challenge: | Existing work has framed fact checking as classification, often supported by a claim as input. |
| Approach: | They propose to use natural language briefs to increase the accuracy of fact checking . they show that QABriefer increases the accuracy by 10% while QABries reduce time . |
| Outcome: | The proposed model increases the accuracy of crowdworkers by 10% while reducing the time required by 20%. |
EnsyNet: A Dataset for Encouragement and Sympathy Detection (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies on emotional support detection focus on the presence or absence of emotional support, while the available datasets are limited or scarce in terms of size. |
| Approach: | They propose to use a dataset of 6,500 sentences annotated with encouragement and sympathy to train BERT-based classifiers on this dataset and apply their best BERT model to two large scale experiments. |
| Outcome: | The proposed model improves the emotional state of users while the lack of emotional support negatively impacts patients’ emotional state. |
Navigating the Shadows: Unveiling Effective Disturbances for Modern AI Content Detectors (2024.acl-long)
Copied to clipboard
| Challenge: | Recent research indicates that AI-text detection systems lack robustness and struggle to effectively differentiate perturbed texts. |
| Approach: | They propose to evaluate the robustness of current detection systems by using black-box text perturbation methods and adversarial learning experiments. |
| Outcome: | The proposed methods assess the robustness of current detection models across perturbation granularities and the impact of perturbation data augmentation on the robustity of AI-text detectors. |
Equal Truth: Rumor Detection with Invariant Group Fairness (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing rumor detection methods rarely consider fairness issues inherent in the model . this can lead to biased predictions across stakeholder groups, undermining their detection effectiveness . |
| Approach: | They propose a framework to address fairness issues inherent in rumor detection models . they perform unsupervised partitioning to dynamically identify potential unfair data patterns . then, they apply invariant learning to these partitions to extract fair and informative feature representations . |
| Outcome: | The proposed method outperforms strong baselines regarding detection and fairness performance . it also shows robust performance on out-of-distribution samples . |
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a main technique for alleviating hallucinations in large language models. |
| Approach: | They propose to integrate RAG into large language models to analyze word-level hallucinations using a corpus of 18,000 naturally generated responses from diverse LLMs. |
| Outcome: | The proposed model can fine tune a relatively small LLM and achieve a competitive hallucination detection performance when compared to the existing prompt-based approaches. |
Words Like Knives: Backstory-Personalized Modeling and Detection of Violent Communication (2025.emnlp-main)
Copied to clipboard
| Challenge: | a recent study examines the role of personalization in enabling LLMs to serve as effective mediators in human communication for authentic connection. |
| Approach: | They leverage nonviolent communication theory to evaluate LLMs in detecting conversational breakdowns . they annotate a subset of dialogues and obtain fine-grained labels of communication breakdown types . |
| Outcome: | The proposed dataset analyzes human interactions and relationships in a human context. |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
Polysemantic Dropout: Conformal OOD Detection for Specialized LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | specialized large language models (LLMs) are capable of generating coherent, contextually relevant and often human-level language, but they remain vulnerable to errors when confronted with data that falls outside the scope of their domain. |
| Approach: | They propose an inference-time out-of-domain (OOD) detection algorithm that leverages the Inductive Conformal Anomaly Detection framework and a new non-conformity measure based on the model’s dropout tolerance. |
| Outcome: | The proposed method improves detection while maintaining theoretical false alarm bounds from ICAD while maintaining false alarms bounds. |
Beyond Checkmate: Exploring the Creative Choke Points for AI Generated Texts (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on detecting LLM-generated text (AI text) has raised concerns about potential misuse . a new study examines the nuanced distinctions between human and AI texts . |
| Approach: | They analyze human-AI text differences across body, intro, conclusion segments . human texts exhibit greater stylistic variation across segments, they show . |
| Outcome: | The findings will inform their viability and boundaries as effective creative assistants to humans. |
Reliably Bounding False Positives: A Zero-Shot Machine-Generated Text Detection Framework via Multiscaled Conformal Prediction (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods focus excessively on detection accuracy, neglecting the societal risks posed by high false positive rates (FPRs). |
| Approach: | They propose a Conformal Prediction framework that constrains the upper bound of false positive rates and introduces a real-time detection framework. |
| Outcome: | The proposed framework reduces false positive rates and improves detection performance. |
A Zero-Shot Claim Detection Framework Using Question Answering (2022.coling-1)
Copied to clipboard
| Challenge: | Existing claims detection frameworks are portability to emerging events and low-resource training data settings. |
| Approach: | They propose a claim detection framework that leverages zero-shot Question Answering to solve sub-tasks such as topic filtering, claim object detection, and claimer detection. |
| Outcome: | The proposed framework outperforms baselines on the NewsClaims benchmark. |
LLM Factoscope: Uncovering LLMs’ Factual Discernment through Measuring Inner States (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) produce outputs that deviate from factual reality, especially in sensitive applications such as medical consultation and legal advice. |
| Approach: | They propose a Siamese network-based model that leverages LLMs’ inner states for factual detection. |
| Outcome: | The proposed model achieves over 96% accuracy on a custom-collected factual detection dataset. |
How Sampling Affects the Detectability of Machine-written texts: A Comprehensive Study (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent detectors report near-perfect accuracy, often boasting AUROC scores above 99%, but these claims typically assume fixed generation settings, leaving open the question of how robust such systems are to changes in decoding strategies. |
| Approach: | They examine how sampling-based decoding impacts detectability with a focus on how subtle variations in a model’s (sub)word-level distribution affect detection performance. |
| Outcome: | The proposed framework systematically examines how sampling-based decoding impacts detectability, with a focus on how subtle variations in a model’s (sub)word-level distribution affect detection performance. |
A Symbolic Adversarial Learning Framework for Evolving Fake News Generation and Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Rapid LLM advancements heighten fake news risks by enabling the automatic generation of increasingly sophisticated misinformation. |
| Approach: | They propose a framework that implements an adversarial training paradigm by an agent symbolic learning optimization process rather than numerical updates. |
| Outcome: | The proposed framework generates sophisticated fake news that degrades state-of-the-art detection performance by 53.4% in Chinese and 34.2% in English on average. |
OD-RTE: A One-Stage Object Detection Framework for Relational Triple Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing pipelines for relational triple extraction are underutilizing regional information of triple. |
| Approach: | They propose a one-stage Object Detection framework for Relational Triple Extraction . framework uses vertices-based bounding box detection and global relational triple region detection . |
| Outcome: | The proposed framework could extract all types of triples on two widely used datasets. |
Annotating for Hate Speech: The MaNeCo Corpus and Some Input from Critical Discourse Analysis (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for detecting hate speech are based on the problem of identification, but there is no clear definition of hate speech. |
| Approach: | They propose a multi-layer annotation scheme for the detection of hate speech in a web 2.0 corpus . they propose to use a binary hate speech classification to identify hate speech . |
| Outcome: | The proposed scheme is piloted against a binary hate speech classification and appears to yield higher inter-annotator agreement. |
An Entropy-based Text Watermarking Detection Method (2024.acl-long)
Copied to clipboard
| Challenge: | Existing text watermarking algorithms for large language models (LLMs) are effective in identifying machine-generated texts, but they are not effective in low-entropy scenarios. |
| Approach: | They propose an Entropy-based text watermarking detection method that takes into account the influence of token entropy to better reflect the degree of watermark detection. |
| Outcome: | The proposed method is training-free and fully automated. |
Do What? Teaching Vision-Language-Action Models to Reject the Impossible (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that VLAs can recognize, interpret, and respond to false-premise instructions. |
| Approach: | They propose a framework that detects when an instruction cannot be executed due to a false premise and engages in language-based clarification or correction. |
| Outcome: | The proposed framework detects when an instruction cannot be executed due to a false premise and engages in language-based clarification or correction. |
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)
Copied to clipboard
Yuxiang Zhang, Jing Chen, Junjie Wang, Yaxin Liu, Cheng Yang, Chufan Shi, Xinyu Zhu, Zihao Lin, Hanwen Wan, Yujiu Yang, Tetsuya Sakai, Tian Feng, Hayato Yamana
| Challenge: | Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100. |
| Approach: | They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth. |
| Outcome: | The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth. |
Honey or Poison? Solving the Trigger Curse in Few-shot Event Detection via Causal Intervention (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent supervised ED approaches have achieved promising performance but require large number of manually annotated event data. |
| Approach: | They propose to overfit the trigger confounder of the context and the result . they propose to intervene on the context via backdoor adjustment during training . |
| Outcome: | The proposed method significantly improves the FSED on ACE05 and MAVEN datasets. |
SCCD: A Session-based Dataset for Chinese Cyberbullying Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work on cyberbullying detection in Chinese is underdeveloped due to the lack of comprehensive and reliable datasets. |
| Approach: | They propose to use Chinese social media sessions to analyze Chinese cyberbullying content to improve the quality of annotations. |
| Outcome: | The proposed dataset shows that it performs better than existing methods on Weibo and a major social media platform. |
Powerful Training-Free Membership Inference Against Fine-Tuned Autoregressive Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for auditing fine-tuned language models have limited detection rates . membership inference attacks aim to determine if a specific record was in a model's training set . |
| Approach: | They propose a membership inference attack that exploits memorization at error positions . EZ-MIA achieves 3.8 higher detection than previous state-of-the-art . |
| Outcome: | The proposed attack achieves 3.8 higher detection than previous state-of-the-art models . EZ-MIA achieves 8 higher detectability than prior work, requiring no model training . |
Hidding the Ghostwriters: An Adversarial Evaluation of AI-Generated Student Essay Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have exhibited remarkable capabilities in text generation tasks, but their utilization carries inherent risks, including plagiarism and the dissemination of fake news. |
| Approach: | They propose to use a dataset to construct an AI-generated student essay that employs a range of text perturbation methods to evade detection. |
| Outcome: | The proposed methods evade detection and maintain quality of the generated essays while avoiding plagiarism and fake news. |
In Plain Sight: Media Bias Through the Lens of Factual Reporting (D19-1)
Copied to clipboard
| Challenge: | lexical bias stems from content realization, or how things are said, but other forms of bias stem from content selection and organization. |
| Approach: | They use a dataset to analyze news articles annotated with 1,727 bias spans to investigate informational bias. |
| Outcome: | The proposed model shows that informational bias appears more frequently than lexical bias. |
From Text to Source: Results in Detecting Large Language Model-Generated Content (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate human-like text, but have ethical and misuse concerns. |
| Approach: | They evaluate whether a classifier trained to distinguish between source and target LLMs can detect text from an LLM without further training. |
| Outcome: | The proposed method detects text from target LLMs without further training. |
Leveraging Human and Machine Preferences for Zero-shot Detection of AI-Generated Text (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models have enabled generated texts to closely mimic human writing, posing significant challenges to the detection of AI-generated content. |
| Approach: | They propose a human-machine prediction discrepancy adapter for AI-generated text detection . they use a joint fine-tuning strategy and a discrepany-aware reweighting mechanism . |
| Outcome: | The proposed framework improves the detection performance of five representative models under various evaluation scenarios. |
Duwak: Dual Watermarks in Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing watermark techniques are effective in embedding single human-imperceptible and machine-detectable patterns without significantly affecting generated text quality and semantics. |
| Approach: | They propose to embed dual secret patterns in token probability distribution and sampling schemes to enhance the efficiency of watermarking. |
| Outcome: | The proposed method achieves highest watermark quality at the lowest required token count for detection, up to 70% less than existing techniques, especially under post paraphrasing attacks. |
Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New Insights (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks lack long context and label noise for stress-testing detectors . a new RAG-based HDB that underwent a rigorous human annotation process is developed . |
| Approach: | They propose a desiderata of properties for hallucination detection benchmarks to exhibit . they build a RAG-based HDB that underwent a rigorous human annotation process . |
| Outcome: | The proposed benchmark exhibits all desirable properties of existing HDBs . existing benchmarks lack realistic label noise for stress-testing detectors despite human annotation . |
Text Anomaly Detection with Simplified Isolation Kernel (2025.findings-emnlp)
Copied to clipboard
| Challenge: | High-dimensional dense embeddings extracted by large language models pose memory requirements and high computation time. |
| Approach: | They propose a method that maps high-dimensional dense embeddings to lower-dimensional sparse representations while preserving crucial anomaly characteristics. |
| Outcome: | The proposed method achieves better detection performance than 11 SOTA anomaly detection algorithms while maintaining computational efficiency and low memory cost. |
A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical Questionnaires (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to detecting mental disorders lack domain-based interpretation . lack of quality data or complexity of models can cause problems . |
| Approach: | They propose a model that captures semantic meanings directly from social media and compares them to symptom-related descriptions. |
| Outcome: | The proposed model outperforms baselines on mental disorder detection tasks. |
Innovative Image Fraud Detection with Cross-Sample Anomaly Analysis: The Power of LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document image fraud detection lack visual clues on tampered regions. |
| Approach: | They propose a framework for detecting logical inconsistencies in document images by leveraging LLMs. |
| Outcome: | The proposed framework outperforms state-of-the-art fraud detection methods by 79.6% on CrossCred and industrial solutions by 21.7% on business data. |
Structure-aware Propagation Generation with Large Language Models for Fake News Detection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | propagation-based methods for fake news detection often lack structural data . authors propose a structure-aware synthetic propagation enhanced detection framework . |
| Approach: | They propose a structure-aware synthetic propagation enhanced detection framework to capture real-world propagation. |
| Outcome: | The proposed framework captures structural dynamics from real propagation, while ignoring structural patterns. |
Defending Against Social Engineering Attacks in the Age of LLMs (2024.emnlp-main)
Copied to clipboard
Lin Ai, Tharindu Kumarage, Amrita Bhattacharjee, Zizhou Liu, Zheng Hui, Michael Davinroy, James Cook, Laura Cassani, Kirill Trapeznikov, Matthias Kirchner, Arslan Basharat, Anthony Hoogs, Joshua Garland, Huan Liu, Julia Hirschberg
| Challenge: | Existing research has developed frameworks to understand human-to-human CSE attacks. |
| Approach: | They propose a modular defense pipeline that improves detection at both the message and conversation levels. |
| Outcome: | The proposed model can be exploited to facilitate chat-based social engineering attacks and generate high-quality CSE content, but their detection capabilities are suboptimal, leading to increased operational costs for defense. |
Bridging Word-Pair and Token-Level Metaphor Detection with Explainable Domain Mining (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for word-pair metaphor detection provide intermediate explainable clues for detection results. |
| Approach: | They propose a method to bridge word-pair and token-level metaphor detection by modeling word pairs as explainable intermediate information. |
| Outcome: | The proposed method bridges word-pair and token-level metaphor detection by using word pairs . it provides intermediate explainable clues for the detection results, but this is a challenge . |
How Good Are LLMs at Out-of-Distribution Detection? (2024.lrec-main)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is crucial for ensuring AI safety . large language models (LLMs) are becoming more prevalent due to their scale, pre-training objectives, and paradigms used for inference. |
| Approach: | They propose to use large language models to investigate out-of-distribution (OOD) detection in machine learning. |
| Outcome: | The proposed method outperforms other OOD detectors in zero-grad and fine-tuning scenarios. |
BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Safety backdoors in large language models can be triggered while evading detection during normal interactions. |
| Approach: | They propose a bi-level optimization method that uses a key insight: backdoor triggers induce a uniform drift in the model’s embedding space . inner level identifies universal perturbations to the decoder’s embedded spaces that steer the model towards defender-defined unwanted behaviors; outer level fine-tunes the model to reinforce safe behaviors against these perturbations. |
| Outcome: | The proposed mitigation method reduces the success rate of safety backdoor attacks from over 95% to 1% for general harmful behaviors and from 47% to 0% for Sleeper Agents, without compromising the model’s usefulness. |
RAP-ID: Mechanistic Prompt Injection Detection via Impostor Behavior Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing defenses rely on externally deployed guardrail models or response inspection . current defenses depend on external guardrails or response inspecting . |
| Approach: | They propose a mechanistic, train-free detection framework that operates exclusively on internal state dynamics during the initial forward pass. |
| Outcome: | The proposed framework achieves competitive performance with significant overall improvements compared to heuristic methods. |
Unraveling the Mystery of Artifacts in Machine Generated Text (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent studies show that human-written text is not distinguishable from synthetic text because of semantic errors or logical contradictions. |
| Approach: | They propose to analyze the forms of artifacts left by neural Text Generation Models by corrupting texts and replacing them with linguistic or statistical features. |
| Outcome: | The proposed method replaces text with linguistic or statistical features and improves the accuracy of the model. |
Paying Attention to Deflections: Mining Pragmatic Nuances for Whataboutism Detection in Online Discourse (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on whataboutism have focused on tracking "what about" phrases, but they neglect the unique challenges to its detection. |
| Approach: | They propose to use attention weights to distinguish the ‘what about’ lexical construct from whataboutism by using Twitter/X and YouTube datasets. |
| Outcome: | The proposed method improves by 4% and 10% over previous state-of-the-art methods in Twitter and YouTube datasets. |
IDEATE: Detecting AI-Generated Text Using Internal and External Factual Structures (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to detect AI-generated text rely on internal evidences, but external evidences are not considered. |
| Approach: | They propose a hierarchical graph network that utilizes internal and external factual structures to detect AI-generated text. |
| Outcome: | The proposed network outperforms current state-of-the-art methods on four datasets. |
A French Corpus for Event Detection on Twitter (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets may have different definitions of event or topic, which leads to inconsistent results. |
| Approach: | They present a corpus annotated for event detection tasks consisting of 38 million tweets in French and 130,000 manually annotating tweets as related or unrelated to a given event. |
| Outcome: | The proposed method performs best on 38 million tweets in French and another publicly available dataset of tweets. |
A Frustratingly Easy Plug-and-Play Detection-and-Reasoning Module for Chinese Spelling Check (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years, Chinese Spelling Check (CSC) has been greatly improved by designing task-specific pre-training methods or introducing auxiliary tasks. |
| Approach: | They propose to decompose Chinese Spelling Check into detection, reasoning, and searching subtasks and to train a module that is compatible with existing CSC models. |
| Outcome: | The proposed module can be trained for one model and benefit other models. |
Figuratively Speaking: Authorship Attribution via Multi-Task Figurative Language Modeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models that detect multiple FL features in text are not effective in authorship attribution tasks. |
| Approach: | They propose a multi-task Figurative Language Model that learns to detect multiple FL features in text at once. |
| Outcome: | The proposed model outperforms specialized binary models in AA tasks or outperformed binary models on three datasets. |
Proving membership in LLM pretraining data via data watermarks (2024.findings-acl)
Copied to clipboard
| Challenge: | Detecting whether copyright holders’ works were used in large language model (LLM) training is poised to be an important problem. |
| Approach: | They propose to use data watermarks to enable principled detection with only black-box model access, provided the rightholder contributed multiple training documents and watermarked them before public release. |
| Outcome: | The proposed method can be used to test hypothesis testing on a black-box model . it shows that the watermarks are strong under model and dataset scaling . |
BehanceCC: A ChitChat Detection Dataset For Livestreaming Video Transcripts (2022.lrec-1)
Copied to clipboard
| Challenge: | livestreaming videos contain a considerable amount of off-topic content, causing noises and data load to downstream applications. |
| Approach: | They propose a human-annotated benchmark dataset for off-topic detection in livestreaming video transcripts. |
| Outcome: | The proposed dataset reveals the complexity of chitchat detection in livestreaming videos . livestreams tend to be longer than pre-recorded videos and have fewer verbal pauses . |
Sheep’s Skin, Wolf’s Deeds: Are LLMs Ready for Metaphorical Implicit Hate Speech? (2025.acl-long)
Copied to clipboard
| Challenge: | specialized models fail to detect implicit hate speech due to its indirectly expressed hateful intent . advanced LLMs often misinterpret metaphorical implicit hate content, resulting in its propagation . |
| Approach: | They propose a Jailbreaking strategy and Energy-based Constrained Decoding techniques to detect implicit hate speech in large language models. |
| Outcome: | The proposed model can generate metaphorical implicit hate speech, but it fails to detect it effectively. |
The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate their utility in character simulations, but they pose a risk of generating unsafe content. |
| Approach: | They propose a method which dynamically adjusts safety-utility preferences based on the degree of risk coupling and guides the model to generate responses biased toward utility or safety. |
| Outcome: | The proposed method improves safety metrics while maintaining utility. |
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have presented LLM-generated-text detectors with promising performance, but they do not cover such diverse instruction patterns when creating datasets for LLM detection. |
| Approach: | They propose to use task-oriented constraints that would naturally be included in an instruction and are not related to detection-evasion to create detectors with large variances in detection performance. |
| Outcome: | The proposed detectors have a large variance in detection performance on student essay writing with task-oriented constraints, and the standard deviation is significantly larger than that on texts generated by the constraint with such a constraint. |
On the Universal Adversarial Perturbations for Efficient Data-free Adversarial Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing adversarial detection methods require access to training data, which brings noteworthy concerns regarding privacy leakage and generalizability. |
| Approach: | They propose a data-agnostic adversarial detection framework which induces different responses between normal and adversarials to UAPs. |
| Outcome: | The proposed framework achieves competitive detection performance on various text classification tasks, and maintains equivalent time consumption to normal inference. |
KPatch: Knowledge Patch to Pre-trained Language Model for Zero-Shot Stance Detection on Social Media (2024.lrec-main)
Copied to clipboard
Shuohao Lin, Wei Chen, Yunpeng Gao, Zhishu Jiang, Mengqi Liao, Zhiyu Zhang, Shuyuan Zhao, Huaiyu Wan
| Challenge: | Existing knowledge injection methods fail to understand the semantics of tweets . |
| Approach: | They propose a method to flexibly inject knowledge into a pre-trained language model and adaptively expand tweets context. |
| Outcome: | The proposed method is based on two training stages to flexibly inject knowledge into the pre-trained language model and adaptively expand tweets context. |
Hallucination Detection in Structured Query Generation via LLM Self-Debating (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Hallucination remains a key challenge in applying large language models to structured query generation . we propose the Self-Debating framework to enhance detection performance . |
| Approach: | They propose a framework that prompts an LLM to generate contrastive explanations from opposing perspectives . they also propose 'self-debating' framework to enhance detection performance . |
| Outcome: | The proposed framework outperforms LLM-as-a-Judge baselines in hallucination detection . the framework generates contrastive explanations from opposing perspectives . |
Text Fluoroscopy: Detecting LLM-Generated Text through Intrinsic Features (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing because of their excellent performance on various tasks. |
| Approach: | They propose a black-box method with better generalizability for detecting LLM-generated text by mining the intrinsic features of the text to be detected. |
| Outcome: | The proposed method achieves 7.36% and 2.84% improvement in detection performance compared to baselines in detecting texts from different domains generated by GPT-4 and Claude3 respectively. |
Can Indirect Prompt Injection Attacks Be Detected and Removed? (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have developed various detection mechanisms to protect against prompt injection attacks. |
| Approach: | They investigate the feasibility of detecting and removing indirect prompt injection attacks . they use two methods to evaluate their performance and train detection models . |
| Outcome: | The proposed method is based on a benchmark dataset and is available on github . it evaluates the performance of existing models and open-source detection models . |
FigEx: Aligned Extraction of Scientific Figures and Captions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | FigEx is a vision-language model to extract aligned pairs of subfigures and subcaptions from scientific papers. |
| Approach: | They propose a vision-language model to extract aligned pairs of subfigures and subcaptions from scientific papers. |
| Outcome: | The proposed model improves subfigure detection APb over Grounding DINO by 0.023 and boosts caption separation BLEU over Llama-2-13B by 0.465. |
FoodSafeSum: Enabling Natural Language Processing Applications for Food Safety Document Summarization and Analysis (2025.findings-emnlp)
Copied to clipboard
Juli Bakagianni, Korbinian Randl, Guido Rocchietti, Cosimo Rulli, Franco Maria Nardini, Salvatore Trani, Aron Henriksson, Anna Romanova, John Pavlopoulos
| Challenge: | a lack of structured datasets hinders natural language processing research . a new dataset of food safety documents and related metadata is presented . |
| Approach: | They present a dataset of human-written and Large Language Model (LLM)-generated food safety documents . they evaluate their utility on three NLP tasks directly reflecting food safety practices . |
| Outcome: | The proposed dataset performs comparably or better than human summaries on three NLP tasks . it also shows clustering of summary for event tracking and compliance monitoring . |
Annotating the Annotators: Analysis, Insights and Modelling from an Annotation Campaign on Persuasion Techniques Detection (2025.findings-acl)
Copied to clipboard
Davide Bassi, Dimitar Iliyanov Dimitrov, Bernardo D’Auria, Firoj Alam, Maram Hasanain, Christian Moro, Luisa Orrù, Gian Piero Turchi, Preslav Nakov, Giovanni Da San Martino
| Challenge: | Existing annotation campaigns based on heuristic guidelines have not been thoroughly discussed. |
| Approach: | They propose a probabilistic model for optimizing intervention scheduling to reduce the cost of an expert oversight in annotation tasks. |
| Outcome: | The proposed model advocates for an expert oversight in annotation tasks and periodic quality audits to reduce costs. |
Can LLMs be Literary Companions?: Analysing LLMs on Bengali Figures of Speech Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | despite Bengali being among the most spoken languages, the NLP efforts on it remain limited. |
| Approach: | They present a dataset that includes Bengali figures of speech on six poets . they deploy state-of-the-art Large Language Models to the dataset and fine-tune the best models . |
| Outcome: | The proposed dataset reveals that two open-source LLMs perform better than others in Bengali . the framework can be reproduced for English and other low-resource languages . |
BotPercent: Estimating Bot Populations in Twitter Communities (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to bot detection are agnostic to social environments the bots operate in . however, standard approaches are not a good fit for the social environments they operate in. |
| Approach: | They propose a method that estimates the percentage of Twitter bots given a community . they use Twitter bot detection datasets and feature-, text-, and graph-based models adjusted to a particular community based on Twitter . |
| Outcome: | The proposed method achieves state-of-the-art in community-level Twitter bot detection across balanced and imbalanced class distribution settings. |
Trick or Neat: Adversarial Ambiguity and Language Model Evaluation (2025.findings-acl)
Copied to clipboard
| Challenge: | Direct prompting fails to detect ambiguity while linear probes can decode ambiguities with high accuracy, sometimes exceeding 90%. |
| Approach: | They introduce an adversarial ambiguity dataset that includes syntactic, lexical, and phonological ambiguities along with adversarials. |
| Outcome: | The proposed dataset includes syntactic, lexical, and phonological ambiguities along with adversarial variations. |
ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for detecting harmful content lack diversity and quality of datasets. |
| Approach: | They propose a framework for synthesizing toxic information from social media datasets . their framework generates a wide variety of synthetic, yet remarkably realistic, examples of toxic information . |
| Outcome: | The proposed framework can generate a wide variety of synthetic, yet remarkably realistic, examples of toxic information. |
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)
Copied to clipboard
Bo Zhang, Tzu-Yen Ma, Zichen Tang, Junpeng Ding, Zirui Wang, Yizhuo Zhao, Peilin Gao, Zijie Xi, Zixin Ding, Haiyang Sun, Haocheng Gao, Yuan Liu, Liangjia Wang, Yiling Huang, Yujie Wang, Yuyue Zhang, Ronghui Xi, Yuanze Li, Jiacheng Liu, Zhongjun Yang, Haihong E
| Challenge: | AEGIS examines whether current models can effectively audit AI-generated images in academic papers. |
| Approach: | They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics. |
| Outcome: | AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis. |
Vulnerability of LLMs to Vertically Aligned Text Manipulations (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research shows that vertical text input significantly degrades the accuracy of large language models (LLMs) in text classification tasks. |
| Approach: | They investigate the impact of vertical text input on the performance of LLMs . they find that chain of thought reasoning does not help LLM recognize vertical input . |
| Outcome: | The proposed model can significantly mislead models, posing a risk of bypassing detection in real-world scenarios involving harmful or sensitive information. |
Rethinking LLM Watermark Detection in Black-Box Settings: A Non-Intrusive Third-Party Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing secret-key schemes tightly couple detection with injection . this dependency creates a fundamental barrier for real-world governance . |
| Approach: | et al. introduce a black-box framework for non-intrusive, third-party watermark verification . they propose a proxy model to amplify watermark-relevant signals and complementary relative measurements . |
| Outcome: | a new framework decouples detection from injection and assesses alignment of query text with watermark distributions. |
Can Large Language Models Identify Implicit Suicidal Ideation? An Empirical Evaluation (2025.findings-emnlp)
Copied to clipboard
Tong Li, Shu Yang, Junchao Wu, Jiyao Wei, Lijie Hu, Mengdi Li, Derek F. Wong, Joshua R. Oltmanns, Di Wang
| Challenge: | Existing data on suicidal ideation in private conversations are limited . a new dataset of 1,200 test cases is presented to address this gap . |
| Approach: | They propose a dataset of 1,200 test cases simulating implicit suicidal ideation in private contexts. |
| Outcome: | The proposed dataset includes 1,200 test cases simulating implicit suicidal ideation in dialogue scenarios. |
Aligning Predictive Uncertainty with Clarification Questions in Grounded Dialog (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Previous work bases the timing of questions on supervised models learned from interactions between humans. |
| Approach: | They propose to ground the need for questions in the acting agent's predictive uncertainty by using the T5 encoder-decoder architecture to solve a Minecraft Collaborative Building task. |
| Outcome: | The proposed model can detect ambiguous instructions and predict responses better than previous models. |
Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset (2026.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have expanded capabilities beyond text understanding . a novel Chinese financial multimodal evaluation benchmark is used to evaluate LVLM capabilities . |
| Approach: | They propose a Chinese financial multimodal evaluation benchmark to evaluate LVLMs' capabilities . the model has an overall accuracy of 66.11% and an average score of 77.18 . |
| Outcome: | The proposed model achieves an overall accuracy of 66.11% on the question answering task and an average score of 77.18 on detection, recognition, and information extraction tasks. |
CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Low Resource With Contrastive Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent proposed methods fail to consider the linguistic structure of texts and lack the ability to handle the low-resource problem. |
| Approach: | They propose a coherence-based contrastive learning model named CoCo to detect MGTs under low-resource scenario. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two datasets and two self-constructed datasets. |
GenEx: A Commonsense-aware Unified Generative Framework for Explainable Cyberbullying Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | a significant gap exists in understanding code-mixed languages and the need for explainability in this context. |
| Approach: | They propose to annotate posts with four labels to identify bullies in code-mixed languages . they propose to use a generative framework to reimagine the multitask problem as a text-to-text generation task. |
| Outcome: | The proposed model outperforms baseline models and state-of-the-art models on the BullyExplain dataset. |
Defending against Indirect Prompt Injection by Instruction Detection (2025.findings-emnlp)
Copied to clipboard
Tongyu Wen, Chenglong Wang, Xiyuan Yang, Haoyu Tang, Yueqi Xie, Lingjuan Lyu, Zhicheng Dou, Fangzhao Wu
| Challenge: | Indirect Prompt Injection attacks can be exploited by LLMs that are embedded with external data. |
| Approach: | They propose a detection-based approach that leverages the behavioral states of LLMs to identify potential IPI attacks. |
| Outcome: | The proposed approach reduces the success rate of attacks to 0.03% on the BIPIA benchmark. |
Knowledge-Infused Multi-Bit Watermarking for RAG Knowledge Bases (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG watermarking methods are limited in their encoding capacity and potential degradation of performance or knowledge quality. |
| Approach: | They propose knowledge-infused and multi-bit watermarking (KMW) for RAG knowledge bases by benign knowledge completion and a tailored generative watermark algorithm. |
| Outcome: | The proposed method extracts watermarks from adversarial RAGs while remaining stealthy and secure. |
ZoFia: Zero-Shot Fake News Detection with Entity-Guided Retrieval and Multi-LLM Interaction (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are limited by knowledge cutoff and can generate factual hallucinations when handling time-sensitive news. |
| Approach: | They propose a two-stage zero-shot fake news detection framework that uses a hierarchical salience and saliency-calibrated minimum margin of relevance algorithm to extract core entities accurately. |
| Outcome: | The proposed framework outperforms existing zero-shot baselines and even most few-shot methods on two public datasets. |
Detecting Sockpuppetry on Wikipedia Using Meta-Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to model author-specific sockpuppet detection on Wikipedia are limited in data-scarce settings. |
| Approach: | They propose to use meta-learning to improve model adaptation to a new sockpuppet-group by training models across multiple tasks. |
| Outcome: | The proposed technique improves performance in data-scarce settings by training models across multiple tasks. |
Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contexts (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for OOD intent detection are limited to single dialogue turns. |
| Approach: | They propose a context-aware OOD intent detection framework to model multi-turn contexts in OOD context detection tasks using unlabeled data. |
| Outcome: | The proposed framework improves the F1-OOD score by 29% on multi-turn OOD detection tasks compared to the previous best method. |
XDAC: XAI-Driven Detection and Attribution of LLM-Generated News Comments in Korean (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models generate human-like text, raising concerns about their misuse in creating deceptive content. |
| Approach: | They propose a framework for detecting LLM-generated comments in Korean news and introduce a XDAC framework that leverages explainable AI to uncover distinguishing linguistic patterns at token and character levels. |
| Outcome: | The proposed framework outperforms existing methods and achieves 98.5% F1 score in detection and 84.3% F1 in attribution. |
Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation (2025.findings-acl)
Copied to clipboard
| Challenge: | incorporating clinical symptom information into a model enhances domain expertise, improving its detection and interpretation performance. large language models are effective for generating explanatory rationales, but inconsistencies in relevance and domain alignment of LLM-generated rationale are challenging. |
| Approach: | They propose a framework that fine-tunes smaller language models with rationales exhibiting high domain relevance . they propose 'quality-focused' approach that selects rationale based on their alignment with clinical reasoning . |
| Outcome: | The proposed framework improves mental health detection and interpretation performance by ensuring high-quality rationales with domain relevance. |
gMBA: Expression Semantic Guided Mixed Boolean-Arithmetic Deobfuscation Using Transformer Architectures (2025.findings-acl)
Copied to clipboard
| Challenge: | Mixed Boolean-Arithmetic (MBA) obfuscation protects intellectual property by converting programs into complex forms that are difficult to analyze. |
| Approach: | They propose a mixed-boolean-arithmetic (MBA) obfuscation framework that transforms a Transformer-based neural encoder-decoder into a truth table that is an automatically constructed semantic representation of an expression's behavior. |
| Outcome: | The proposed framework improves performance and highlights the importance of internal semantic expressions in recovering obfuscated code to its original form. |
FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis (2025.findings-acl)
Copied to clipboard
Yilun Zheng, Sha Li, Fangkun Wu, Yang Ziyi, Lin Hongchao, Zhichao Hu, Cai Xinjun, Ziming Wang, Jinxuan Chen, Sitao Luan, Jiahao Xu, Lihui Chen
| Challenge: | Parody is an emerging phenomenon on social media, where individuals imitate a role or position opposite to their own . limited available data and deficient diversity in current datasets hinder study of parody . |
| Approach: | They build a dataset of parody users and annotated comments from both English and Chinese corpora to test parody detection and comment sentiment analysis. |
| Outcome: | The proposed datasets provide richer contextual information, which is lacking in existing datasets. |
SA-CLIP: Language Guided Image Spatial and Action Feature Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Contrastive language-image pretraining models struggle with real-world downstream tasks such as road traffic anomaly detection due to inability to effectively capture spatial and action relationships between objects within images. |
| Approach: | They compile and curate a dataset and train a Spatial and Action relationship aware CLIP model. |
| Outcome: | The proposed model performs well on the traffic anomaly detection task . |
Enhancing Chinese Offensive Language Detection with Homophonic Perturbation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Detecting offensive language in Chinese is challenging due to homophonic substitutions used to evade detection. |
| Approach: | They propose to use HED-COLD to build a large-scale homophonic dataset for Chinese offensive language detection and a homophone-aware pretraining strategy to learn phonetics and orthography. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the COLD test set and the toxicity benchmark ToxiCloakCN. |
Exploring and Detecting Self-disclosure in Multi-modal posts on Chinese Social Media (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Self-disclosure can provide psychological comfort but can also pose privacy concerns . a lack of high-quality corpora, analysis, and methods for detection is limiting research . |
| Approach: | They construct a high-quality text-image corpus on Chinese multimodal social media platforms . they analyze the distribution of self-disclosure types, modality preferences, user intent . |
| Outcome: | The proposed corpus analyzes self-disclosure behaviors on Chinese social media platforms . it fine-tunes five multimodal large language models to enhance self-discovery detection . |
ArMeme: Propagandistic Content in Arabic Memes (2024.emnlp-main)
Copied to clipboard
| Challenge: | a lack of media literacy is a major factor contributing to the spread of misleading information on social media. |
| Approach: | They analyze a dataset of 6K Arabic memes with manual annotations . they propose to develop computational tools for their detection . |
| Outcome: | The proposed dataset is a first resource for Arabic multimodal research. |
Generate First, Then Sample: Enhancing Fake News Detection with LLM-Augmented Reinforced Sampling (2025.acl-long)
Copied to clipboard
| Challenge: | Existing models have a performance gap of 20% between classifying fake news and real news, making them less suitable for practical deployment. |
| Approach: | They propose to adopt an LLM to generate fake news in three different styles, which are later incorporated into the training set to augment the representation of fake news. |
| Outcome: | The proposed model achieves state-of-the-art performance on two benchmark datasets and improves detection accuracy by 24.02% and 11.06% respectively. |
Investigating How Pre-training Data Leakage Affects Models’ Reproduction and Detection Capabilities (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies do not examine how leaked instances in training datasets influence LLMs’ output and detection capabilities. |
| Approach: | They conduct an experimental survey to examine the relationship between data leakage in training datasets and its effects on the generation and detection by Large Language Models (LLMs). |
| Outcome: | The results show that enhancing leakage detection through few-shot learning can help mitigate the impact of the leakage rate in the training data on detection performance. |
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Peidong Wang, Zhiming Ma, Xin Dai, YongKang Liu, Shi Feng, Xiaocui Yang, Wenxing Hu, Zhihao Wang, Mingjun Pan, Li Yuan, Daling Wang
| Challenge: | Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors . |
| Approach: | They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details. |
| Outcome: | The proposed method improves accuracy, inference efficiency, and real-time processing capabilities. |
Exons-Detect: Identifying and Amplifying Exonic Tokens via Hidden-State Discrepancy for Robust AI-Generated Text Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for AI-generated text detection assume uniform token contributions, making them less robust under short sequences or localized token modifications. |
| Approach: | They propose a training-free method for AI-generated text detection based on an exon-aware token reweighting perspective. |
| Outcome: | The proposed method achieves state-of-the-art detection performance and robustness to adversarial attacks and varying input lengths. |
Adversarial Text Generation using Large Language Models for Dementia Detection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models excel in text classification tasks, but they do not perform well with picture description. |
| Approach: | They propose an interpretable classification approach by Adversarial Text Generation (ATG) that could relate dementia detection with other tasks. |
| Outcome: | The proposed approach achieves 85% accuracy, >10% improvement over the previous methods. |
M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models (LLMs) neglect cultural diversity and key aspects like emotion and contextual knowledge hidden in the visual modalities. |
| Approach: | They propose a framework for misogynous meme identification using a multimodal multimodal prompting principle and a CLIP-based classifier. |
| Outcome: | The proposed framework performs well on the SemEval-2022 task 5 dataset, and is generalizable across different datasets. |
MOSAIC: Multiple Observers Spotting AI Content (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made it easier for all to produce harmful, toxic, faked or forged content. |
| Approach: | They propose to use large language models to automatically discriminate from human-written texts by comparing their probability distributions over a document to see if they can detect forged or harmful content. |
| Outcome: | The proposed approach harnesses each model’s capabilities, leading to strong detection performance on a variety of domains. |
Deciphering Cognitive Distortions in Patient-Doctor Mental Health Conversations: A Multimodal LLM-Based Detection and Reasoning Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | Cognitive distortion research sheds light on pervasive errors in thinking patterns . authors present method for detecting and reasoning about cognitive distortions . |
| Approach: | They propose a method for detecting and reasoning about cognitive distortions using Large Language Models. |
| Outcome: | The proposed method improves accuracy and depth of detection and reasoning tasks in a zero-shot manner. |
Context-aware Watermark with Semantic Balanced Green-red Lists for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research suggests that watermarking methods cause degradation of text quality due to semantic disparities between the watermarked text and the unwatermarked text. |
| Approach: | They propose a semantic-aware watermark method that generates a watermark key considering contexts to split a green/red list for watermark injection. |
| Outcome: | The proposed method reduces performance drop due to adding bias on green lists . it also allows green lists to cover almost all semantics . |
Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) achieve strong performance on metaphor detection and interpretation tasks, yet it remains unclear what such success actually reveals about metaphor processing. |
| Approach: | They propose to probing semantic attribute alignment, lexical invariance, and syntactic sensitivity to examine the limits of behavioral evidence for metaphor processing. |
| Outcome: | The proposed model can exhibit semantic drift relative to reference attributes, stable lexical anchors persist across contextual conditions, potentially supporting conventional metaphors while biasing novel metaphors requiring contextual integration. |
Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require accurate text detection, but authors' characteristics are neglected. |
| Approach: | They investigate how author characteristics impact AI-generated text detection . they use corpus of human-authored texts and parallel AI-generated texts . |
| Outcome: | The results show that gender, CEFR proficiency, academic field and language environment influence detector accuracy. |
PropXplain: Can LLMs Enable Explainable Propaganda Detection? (2025.findings-emnlp)
Copied to clipboard
Maram Hasanain, Md Arid Hasan, Mohamed Bayan Kmainasi, Elisa Sartori, Ali Ezzat Shahroor, Giovanni Da San Martino, Firoj Alam
| Challenge: | Currently, propagandistic content detection studies focus on detection, with little attention given to explanations justifying the predicted label. |
| Approach: | They propose a multilingual explanation-enhanced dataset and an explanation-based LLM to address this issue. |
| Outcome: | The proposed model performs comparably while also generating explanations. |
Revealing the impact of synthetic native samples and multi-tasking strategies in Hindi-English code-mixed humour and sarcasm detection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Specifically, we tried native sample mixing, multi-task learning, and prompting and instruction finetuning very large multilingual language models (VMLMs). |
| Approach: | They used native sample mixing, multi-task learning and prompting and instruction finetuning to improve code-mixed humour and sarcasm detection. |
| Outcome: | The proposed methods improve humour and sarcasm detection by adding native samples to training sets and multitask learning and prompting and instruction finetuning VMLMs. |
Just a Scratch: Enhancing LLM Capabilities for Self-harm Detection through Intent Differentiation and Emoji Interpretation (2025.acl-long)
Copied to clipboard
| Challenge: | Self-harm detection on social media is critical for early intervention and mental health support, yet remains challenging due to the subtle, context-dependent nature of such expressions. |
| Approach: | They propose a framework to distinguish intent through nuanced language–emoji interplay. |
| Outcome: | The proposed framework improves self-harm detection and explanation tasks on three state-of-the-art LLMs. |
Exploring and Distilling Multi-Dimensional Clues for Interpretable Social Bot Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing research on social bot detection results directly without corresponding supportive explanations, making it difficult to assess the extent to which such predictions are trustworthy. |
| Approach: | They propose a four-dimensional clue framework that uses outcome-reward reinforcement learning to train inspectors to generate faithful, grounded clues from user information, semantic features, interactive situation, and behavioral pattern. |
| Outcome: | The proposed framework outperforms baselines in detection performance and significantly improves the performance of large language models. |
Take Its Essence, Discard Its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to mitigate lexical bias in toxic language detection (TLD) do not exploit the “useful” and “misleading” impact of the bias. |
| Approach: | They propose a counterfactual Causal Debiasing Framework to mitigate lexical bias in toxic language detection (TLD) it preserves the “useful impact” of lexical bias and eliminates the "misleading impact" they propose to use the same framework to analyze the causal effect of a sentence and bias tokens . |
| Outcome: | The proposed framework preserves the “useful impact” of lexical bias and eliminates the ‘misleading impact’ Empirical evaluations show that the proposed model outperforms current debiased models for out-of-distribution data. |
Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detection (2026.acl-long)
Copied to clipboard
Junjun Pan, Yixin Liu, Rui Miao, Kaize Ding, Yu Zheng, Quoc Viet Hung Nguyen, Alan Wee-Chung Liew, Shirui Pan
| Challenge: | Existing graph anomaly detection methods rely on coarse sentence-level information and overlook fine-grained lexical cues, limiting their reliability and real-world applicability. |
| Approach: | They propose an explainable and fine-grained safeguarding framework for detecting malicious agents in multi-agent systems (MAS) to incorporate both coarse and fine lexical information for anomalous agent identification. |
| Outcome: | Extensive experiments across diverse MAS topologies and attack scenarios demonstrate robust detection performance and strong interpretability of XG-Guard. |
TopicDiff: A Topic-enriched Diffusion Approach for Multimodal Conversational Emotion Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on learning contextual information in conversations, neglecting acoustic and vision topic information. |
| Approach: | They propose a model-agnostic Topic-enriched Diffusion approach for capturing multimodal topic information in MCE tasks. |
| Outcome: | The proposed approach improves over the state-of-the-art MCE models and the existing models. |
POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization (2026.findings-acl)
Copied to clipboard
Usman Naseem, Robert Geislinger, Juan Ren, Sarah Kohail, Rudy Alexandro Garrido Veliz, P Sam Sahil, Yiran Zhang, Idris Abdulmumin, Marco Antonio Stranisci, Özge Alacam, Cengiz Acarturk, Aisha Jabr, Saba Anwar, Abinew Ali Ayele, Simona Frenda, Alessandra Teresa Cignarella, Elena Tutubalina, Oleg Rogov, Aung Kyaw Htet, Xintong Wang, Surendrabikram Thapa, Kritesh Rauniyar, Tanmoy Chakraborty, MD Arfeen Zeeshan, Dheeraj Kodati, Satya Keerthi, Sahar Moradizeyveh, Firoj Alam, Md Arid Hasan, Syed Ishtiaque Ahmed, Ye Kyaw Thu, Shantipriya Parida, Ihsan Ayyub Qazi, Lilian Diana Awuor Wanzare, Nelson Odhiambo Onyango, Clemencia Siro, Jane Wanjiru Kimani, Ibrahim Said Ahmad, Adem Chanie Ali, Martin Semmann, Chris Biemann, Shamsuddeen Hassan Muhammad, Seid Muhie Yimam
| Challenge: | polarization is a pervasive threat to democratic institutions, civil discourse, and social cohesion worldwide . most existing datasets focus on English or high-resource languages, reflecting a widespread trend across NLP tasks . |
| Approach: | They propose a multilingual, multicultural, and multi-event dataset with over 110K instances in 22 languages drawn from diverse online platforms and real-world events. |
| Outcome: | The proposed dataset analyzes polarization detection, type, and manifestation using a variety of annotation platforms adapted to each cultural context. |
Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can generate highly persuasive text, raising concerns about misuse for propaganda, manipulation, and other harmful purposes. |
| Approach: | They propose a multilingual benchmark to compare LLM-generated persuasive texts with human-written ones. |
| Outcome: | The proposed benchmark compares human-authored and LLM-generated persuasive texts . it finds that overtly persuasive LLMs are easier to detect than human-written ones . |
Synergizing Unsupervised Episode Detection with LLMs for Large-Scale News Events (2025.acl-long)
Copied to clipboard
| Challenge: | State-of-the-art automatic event detection struggles with interpretability and adaptability to evolving large-scale key events. |
| Approach: | They propose a task which identifies episodes within a news corpus of key event articles. |
| Outcome: | The proposed framework achieves 59.2% gain across all metrics compared to baselines. |
TransCoder: Towards Unified Transferable Code Representation Learning Inspired by Human Skills (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to fine-tune code intelligence models to individual tasks are costly and require large data sets. |
| Approach: | They propose a Transferable fine-tuning strategy for Code representation learning that uses a tunable prefix encoder to capture cross-task and cross-language transferable knowledge and apply it to downstream adaptation. |
| Outcome: | The proposed method can lead to superior performance on code-related tasks and encourage mutual reinforcement. |
Frankentext: Stitching random text fragments into long-form narratives (2026.acl-long)
Copied to clipboard
| Challenge: | a new approach to generate narratives that can evade detection is needed . authors say that the livelihood of writers is threatened by the quality of AI writing . |
| Approach: | They propose a long-form narrative generation paradigm that treats an LLM as a composer of existing texts rather than as an author. |
| Outcome: | a new model improves over vanilla LLM generation in key writing quality metrics . human annotators praise the model for inventive premises, vivid descriptions, and dry humor . the model raises concerns about the publishing economy and the livelihood of writers . |
Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting hate speech data are expensive and time-consuming . labeled data is expensive and difficult to collect, especially for low-resource languages . |
| Approach: | They propose a method that leverages nearest-neighbor retrieval to augment minimal labeled data in target language. |
| Outcome: | The proposed method outperforms existing models on eight languages and is highly data-efficient. |
VI-OOD: A Unified Framework of Representation Learning for Textual Out-of-distribution Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is a crucial part of deep neural networks. |
| Approach: | They propose a variational inference framework which maximizes the likelihood of the joint distribution p(x, y) instead of p[y|x). |
| Outcome: | The proposed framework maximizes the likelihood of the joint distribution p(x, y) instead of p[y|x). |
Train in Vain: Functionality-Preserving Poisoning to Prevent Unauthorized Use of Code Datasets (2026.findings-acl)
Copied to clipboard
Yuan Xiao, Jiaming Wang, Yuchen Chen, Wei Song, Jun Sun, Shiqing Ma, Yanzhou Mu, Juan Zhai, Chunrong Fang, Jin Song Dong, Zhenyu Chen
| Challenge: | Existing methods for dataset poisoning require full-dataset poison, which breaks code compilability. |
| Approach: | They propose a functionality-preserving poisoning approach that injects short, compilable weak-use fragments into executed code paths. |
| Outcome: | The proposed method contaminates 10% of the dataset while maintaining 100% compilability and functional correctness. |
LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Target (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work on social media platforms is limited in its ability to detect hate speech . a lack of reliable and scalable automated hate speech detection systems is a challenge for low-resource languages like Bangla. |
| Approach: | They propose to use a single-task, single-targeted, single language dataset to identify hate speech in Bangla. |
| Outcome: | The proposed dataset is the largest manually annotated Bangla hate-speech dataset to date. |
TRUST: Towards Robust Social Bot Detection via Uncertainty-Guided Pseudo-Labeling and Graph Structure Purification (2026.findings-acl)
Copied to clipboard
Ruixuan Xu, Mengting Hu, Zhunheng Wang, Ming Jiang, Rui Ying, Zhen Zhang, Hang Gao, Shuaipeng Liu, Renhong Cheng
| Challenge: | Existing graph-based detection models are vulnerable to deceptive message propagation, where bots deliberately interact with legitimate users. |
| Approach: | They propose a framework to mitigate deceptive message propagation by node-level uncertainty estimation and graph structure purification. |
| Outcome: | The proposed framework improves on three benchmark datasets and six GNN backbones on real-world social bots. |
Droid: A Resource Suite for AI-Generated Code Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing detectors fail to generalise to diverse coding domains and programming languages outside of their narrow training data. |
| Approach: | They propose to use DroidCollection to train machine-generated code detectors that can be trained on a multi-task objective. |
| Outcome: | The proposed detectors fail to generalise to diverse coding domains and programming languages outside of their narrow training data. |
TempParaphraser: “Heating Up” Text to Evade AI-Text Detection through Paraphrasing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing detectors that perform well on benchmark datasets have weaknesses that can be exploited to manipulate AI-text. |
| Approach: | They propose a framework that simulates high-temperature sampling effects through multiple normal-temperaturing generations, effectively evading detection. |
| Outcome: | The proposed framework reduces detector accuracy by an average of 82.5% while preserving high text quality. |
SWAN: Semantic Watermarking with Abstract Meaning Representation (2026.acl-long)
Copied to clipboard
Ziping Ye, Gourab Dey, Christos Christodoulopoulos, Charith Peris, Anil Ramakrishna, Weitong Ruan, Aram Galstyan, Kai-Wei Chang, Rahul Gupta, Ninareh Mehrabi
| Challenge: | Existing methods to embed signatures by adjusting token selection preferences during text generation are highly sensitive to paraphrasing and synonyms. |
| Approach: | They propose a framework that embeds watermark signatures into the semantic structure of a sentence using Abstract Meaning Representation (AMR). |
| Outcome: | Empirical evaluation shows SWAN matches state-of-the-art detection performance on unaltered watermarked text while improving robustness against paraphrasing. |
RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation (2026.findings-acl)
Copied to clipboard
| Challenge: | Scientific rigour tends to be sidelined in favour of bold statements, leading authors to overstate claims beyond what their results support. |
| Approach: | They propose a multimodal framework that retrieves supporting evidence from a paper and assigns each claim an overstatement score. |
| Outcome: | The proposed framework retrieves supporting evidence from ICLR and NeurIPS papers and assigns each claim an overstatement score. |
Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing static benchmarks for harmful content detection face limitations in scalability and diversity. |
| Approach: | They propose a framework for synthesizing harmful content using persona-guided large language model agents. |
| Outcome: | The proposed framework achieves a high success rate in harmful generation tests across multiple detection systems. |
Zero-Shot Detection of LLM-Generated Text using Temperature Sensitivity (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for detecting LLM-generated text rely on statistical features that are insufficient for reliable detection. |
| Approach: | They propose a temperature-sensitive detector that modulates decoding temperature and monitors how probability distributions respond to temperature. |
| Outcome: | The proposed method is based on a temperature sensitivity feature and a simple zero-shot detector built upon normalized temperature sensitivity. |
AI Argues Differently: Distinct Argumentative and Linguistic Patterns of LLMs in Persuasive Contexts (2025.emnlp-main)
Copied to clipboard
| Challenge: | Distinguishing LLM-generated text from human-written is a key challenge for safe and ethical NLP, especially in high-stake settings such as persuasive online discourse. |
| Approach: | They propose to use general-purpose linguistic features and domain-specific features related to argument quality to compare human- and LLM-authored arguments. |
| Outcome: | The proposed framework compares arguments by humans and three LLMs using two easily-interpretable feature sets. |
AdaDPI: Document-level Translation Adaptive Agent via Dynamic Parametric Internalization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing solutions, such as memory-based agents, rely on explicit context concatenation, which leads to context dilution, high inference latency, and superficial knowledge integration. |
| Approach: | They propose an adaptive agentic framework that shifts the DocMT paradigm from static retrieval to dynamic parametric internalization. |
| Outcome: | Extensive experiments on the discourse-rich GuoFeng and IWSLT2017 datasets show that AdaDPI outperforms the SoTA baselines by more than 5 points on the consistency metric. |
DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection (2026.acl-long)
Copied to clipboard
Junchao Wu, Yefeng Liu, Chenyu Zhu, Hao Zhang, Zeyu Wu, Tianqi Shi, Yichao Du, Longyue Wang, Weihua Luo, Jinsong Su, Derek F. Wong
| Challenge: | Existing detectors are limited in their ability to detect large language models generated content in multilingual environments. |
| Approach: | They propose a multilingual benchmark to evaluate advanced detectors across 8 dimensions to better align with real-world applications. |
| Outcome: | The proposed benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse. |
Cause-CSD: A Challenge Multimodal Conversational Stance Cause Detection Dataset and Effective Method (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing stance detection methods treat opinions as surface-level labels, overlooking conversational evidence behind stance expressions. |
| Approach: | They propose a task that jointly identifies stance polarity and contextual evidence . they propose stance-cause Detection language model that leverages explicit context reasoning . |
| Outcome: | The proposed task outperforms baseline methods on text-only and multimodal subtasks. |
PROBE: PROcess-Based BEnchmark for Hallucination Detection (2026.findings-acl)
Copied to clipboard
Yu Zhang, Peter Belcak, Shizhe Diao, Yonggan Fu, Shaona Ghosh, Morteza Mardani, Eileen Margaret Peters Long, Bei Yu, Pavlo Molchanov
| Challenge: | Existing agentic applications rely on LLMs to self-assess the factuality of outputs . but current LLM systems fail to detect hallucinations . |
| Approach: | They propose a benchmark that breaks down hallucination detection into four critical steps . they show that when halluciation detection is treated as a multi-step process, all models achieve considerably better performance. |
| Outcome: | The proposed benchmark breaks down hallucination detection into four critical steps . it shows that when halluciation detection is treated as a multi-step process, all models achieve considerably better performance. |
RV-HATE: Reinforced Multi-Module Voting for Implicit Hate Speech Detection (2026.acl-long)
Copied to clipboard
| Challenge: | a new framework for hate speech detection addresses implicit hate speech by tailoring the detection process to dataset-specific attributes. |
| Approach: | They propose a framework to account for the dataset-specific characteristics of hate speech datasets. |
| Outcome: | The proposed framework improves detection accuracy and provides interpretable insights into the distinctive features of each dataset. |
A Linguistics-Aware LLM Watermarking via Syntactic Predictability (2026.acl-long)
Copied to clipboard
| Challenge: | a central challenge remains balancing text quality against detection robustness. |
| Approach: | They propose a framework that aligns watermark strength with linguistic degrees of freedom . they use part-of-speech models to weaken the signal in grammatically constrained contexts . |
| Outcome: | The proposed framework outperforms existing methods in linguistic indeterminacy tests on languages . it weakens the watermark strength in grammatically constrained contexts and strengthens it in contexts with greater linguistic flexibility. |