Synthetic Textual Features for the Large-Scale Detection of Basic-level Categories in English and Mandarin (2021.emnlp-main)
Copied to clipboard
| Challenge: | Basic-level categories are an important psycholinguistic concept introduced by Rosch et al. . an at-scale algorithm for the automatic determination of BLC exists, but it operates without Rosch-style semantic features. |
| Approach: | They propose a method for the detection of BLC at scale that makes use of Rosch-style semantic features. |
| Outcome: | The proposed method outperforms the current SoA in detecting basic-level categories with an accuracy of 75.0% in English and 80.7% in Mandarin. |
Similar Papers
Multi-level Diagnosis and Evaluation for Robust Tabular Feature Engineering with Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown promise in feature engineering for tabular data, but reliability concerns persist due to variability in generated outputs. |
| Approach: | They propose a multi-level diagnosis and evaluation framework to assess the robustness of large language models in feature engineering across diverse domains. |
| Outcome: | The proposed framework assesses the robustness of large language models across domains. |
Linguistically Motivated Features for Classifying Shorter Text into Fiction and Non-Fiction Genre (2022.coling-1)
Copied to clipboard
| Challenge: | linguistically motivated features are used to classify paragraph-level text into fiction and non-fiction genres. |
| Approach: | They deploy linguistically motivated features to classify paragraph-level text into fiction and non-fiction genres using a logistic regression model. |
| Outcome: | The proposed model gives 15.56% accuracy jump over baseline model . the proposed model also transfers over to another dataset, Baby BNC corpus . |
Blackbird language matrices (BLM), a new task for rule-like generalization in neural networks: Can Large Language Models pass the test? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to evaluate large language models for generalization lack generalization ability . current methods for evaluating LLMs are based on tests of human intelligence . |
| Approach: | They propose to use a language task to evaluate large language models' generalisation ability . they propose to ask LLMs to solve simple variants of the RAVEN IQ test . |
| Outcome: | The proposed task can be used to evaluate the generalisation ability of large language models . it shows that current generative models can handle the task in the sense that they understand instructions . |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
Non-Existent Relationship: Fact-Aware Multi-Level Machine-Generated Text Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting LLMs lack the authenticity of the entity graph . lmgenerated text is misused, including fake news and spam . |
| Approach: | They propose a fact-aware model that assesses discrepancies between textual and factual entity graphs through graph comparison. |
| Outcome: | The proposed model outperforms state-of-the-art methods on three public datasets showing that it can capture differences in entity graphs between machine-generated and human-written texts. |
Probing LLMs for Joint Encoding of Linguistic Categories (2023.findings-emnlp)
Copied to clipboard
Giulio Starace, Konstantinos Papakostas, Rochelle Choenni, Apostolos Panagiotopoulos, Matteo Rosati, Alina Leidinger, Ekaterina Shutova
| Challenge: | Existing research suggests that a linguistic hierarchy emerges in large language models . little is known about how encodings of different linguistic phenomena interact within the models - and to what extent processing of linguistically-related categories relies on the same, shared model representations. |
| Approach: | They propose a framework for testing the joint encoding of linguistic categories in large language models. |
| Outcome: | The proposed framework shows that the same patterns hold across languages in multilingual LLMs. |
Tag&Tab: Pretraining Data Detection in Large Language Models Using Keyword-Based Membership Inference Attack (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies on detecting pretraining data in large language models have focused on sentence-level membership inference attacks (MIAs) but these methods often exhibit poor accuracy, failing to account for the semantic importance of textual content and word significance. |
| Approach: | They propose a method that leverages established natural language processing techniques to tag keywords in input text and then uses them to obtain probabilities and calculate their average log-likelihood to determine input text membership. |
| Outcome: | The proposed method exploits established natural language processing techniques to tag keywords in input text and calculate their average log-likelihood to determine input text membership. |
Utterance-level Detection Framework for LLM-Involved Content Detection in Conversational Setting (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods focus on static, document-level content, overlooking the dynamic nature of dialogues. |
| Approach: | They propose an utterance-level detection framework which integrates features from individual and combined analysis of dialogue participants’ responses to detect LLM-generated text under conversational setting. |
| Outcome: | The proposed framework achieves 98.14% accuracy with high inference speed and extensive results on different models and settings. |
Sparse Feature Coactivation Reveals Causal Semantic Modules in Large Language Models (2026.acl-long)
Copied to clipboard
Ruixuan Deng, Xiaoyang Hu, Miles Gilberti, Shane Storks, Aman Taxali, Mike Angstadt, Chandra Sripada, Joyce Chai
| Challenge: | Recent work has focused on layerwise interpretations, lacking fine-grained interpretation of specific features and their interaction. |
| Approach: | They identify semantically coherent, context-consistent network components in large language models . they use sparse autoencoders to coactivate sparsity features from a handful of prompts . |
| Outcome: | The proposed model can capture concepts and relations more comprehensively than individual features while maintaining specificity. |
LAMCL: A Length-aware Momentum Contrastive Learning Framework for Multiscale Machine-Revised Text Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Recent detection methods struggle to capture fine-grained semantic differences, especially for short texts. |
| Approach: | They propose a framework for machine-revised text detection that integrates two modules to enhance discriminative semantic features. |
| Outcome: | The proposed method outperforms existing detectors in identifying machine-revised text across diverse practical scenarios, tasks, and LLMs. |