Nianzu Ma, Alexander Politowicz, Sahisnu Mazumder, Jiahua Chen, Bing Liu, Eric Robertson, Scott Grigsby
| Challenge: | Existing novelty detection algorithms are coarse-grained, working at the document or topic level. |
| Approach: | They propose to use a fine-grained semantic novelty detection problem to solve a novel novel scene problem. |
| Outcome: | The proposed model outperforms baseline models on the proposed task by large margins. |
Similar Papers
Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic-based novelty detection methods do not perform semantic reasoning involving relations between named entities in text and their background knowledge. |
| Approach: | They propose a model to detect whether a text is novel or not . they propose to use a factual text to characterize novelty. |
| Outcome: | The proposed model outperforms 10 baselines by large margins on the novelty detection task. |
TAP-DLND 1.0 : A Corpus for Document Level Novelty Detection (L18-1)
Copied to clipboard
| Challenge: | Detecting novelty of an entire document is an AI frontier problem . present state-of-the-art text matching techniques are unable to process such redundancy. |
| Approach: | They propose a document-level novelty detection resource that can be used to benchmark techniques . they crawl news documents across several domains and use it to find out whether they contain new information . |
| Outcome: | The proposed dataset is compared with a standard system for document novelty detection . the proposed system can detect elements that have not appeared before, or new or original . |
Oddballness: universal anomaly detection with language models (2025.coling-main)
Copied to clipboard
| Challenge: | a new method to detect anomalies in texts uses a metric called oddballness . the method considers probabilities generated by a language model but not low-likelihood tokens . |
| Approach: | They propose a method to detect anomalies in texts using unsupervised language models . they define oddballness as a function that measures how strange a given token is . |
| Outcome: | The proposed method is better than state-of-the-art models for grammatical error detection tasks. |
A Corpus of Metaphor Novelty Scores for Syntactically-Related Word Pairs (L18-1)
Copied to clipboard
| Challenge: | Existing data on metaphor novelty are limited, making it difficult to perform research on this topic. |
| Approach: | They propose to release a corpus of metaphor novelty scores for syntactically related word pairs . they establish a performance benchmark to which future researchers can compare . |
| Outcome: | The proposed corpus of metaphor novelty scores is compared to other datasets . it performs better than chance or nave strategies, the authors show . |
Weeding out Conventionalized Metaphors: A Corpus of Novel Metaphor Annotations (D18-1)
Copied to clipboard
| Challenge: | a lack of datasets distinguish between conventionalized and novel metaphors is limiting research . a novel metaphor is often overlooked or intentionally disregarded, authors say . |
| Approach: | They propose a crowdsourced annotation layer for an existing metaphor corpus to investigate novelty . they investigate correlations between concreteness ratings and more semantic features . |
| Outcome: | The proposed method combines novel metaphor annotations with concreteness ratings and semantic features. |
Commonsense Reasoning for Natural Language Processing (2020.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will outline the various types of commonsense knowledge and discuss techniques to gather and represent commonsence knowledge. |
| Approach: | This tutorial will provide researchers with the critical foundations and recent advances in commonsense representation and reasoning. |
| Outcome: | This tutorial will outline the various types of commonsense and discuss techniques to gather and represent commonsence knowledge while highlighting the challenges specific to this type of knowledge (e.g., reporting bias). |
Defining a New NLP Playground (2023.findings-emnlp)
Copied to clipboard
Sha Li, Chi Han, Pengfei Yu, Carl Edwards, Manling Li, Xingyao Wang, Yi Fung, Charles Yu, Joel Tetreault, Eduard Hovy, Heng Ji
| Challenge: | Recent explosion of performance of large language models (LLMs) has changed the field more abruptly and seismically than any other shift in the field’s 80 year history. |
| Approach: | They propose 20+ PhD-dissertation-worthy research directions to define a new NLP playground by combining theoretical analysis, new and challenging problems, learning paradigms and interdisciplinary applications. |
| Outcome: | The proposed research will cover theoretical analysis, new and challenging problems, learning paradigms and interdisciplinary applications. |
A Generic Method for Fine-grained Category Discovery in Natural Language Texts (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-grained category discovery neglect semantic similarities of fine-grain categories. |
| Approach: | They propose a method that detects fine-grained clusters of semantically similar texts guided by a novel objective function. |
| Outcome: | The proposed method surpasses state-of-the-art methods on three benchmark tasks. |
Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Despite their wide adoption, the biases and unintended behaviors of language models remain poorly understood. |
| Approach: | They propose an evaluation setting to detect semantic leakage by humans and automatically . they also curate a diverse test suite for diagnosing this behavior in 13 flagship models . |
| Outcome: | The proposed evaluation setting detects semantic leakage by humans and automatically, and measures it in 13 flagship models. |
Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated their effectiveness in natural language processing but also in broader applications due to their advanced comprehension and generative capabilities. |
| Approach: | They propose a taxonomy to categorize existing approaches into two classes based on the role played by LLMs. |
| Outcome: | The proposed taxonomy categorizes existing approaches into two classes based on the role played by LLMs. |