Challenge: Off-topic spoken response detection is crucial for an automated speaking assessment system.
Approach: They propose a novel approach for off-topic spoken response detection with high off-top recall on both seen and unseen prompts.
Outcome: The proposed model achieves significant improvements in detecting off-topic responses with extremely high on-topic recall on both seen and unseen prompts.

Similar Papers

DialogConv: A Lightweight Fully Convolutional Network for Multi-view Response Selection (2022.emnlp-main)

Copied to clipboard

Challenge: Existing retrieval-based dialogue systems suffer from slow inference or huge number of parameters.
Approach: They propose a lightweight fully convolutional architecture for response selection using convolution.
Outcome: The proposed architecture extracts matching features of context and response from 3D views.
Over-Searching in Search-Augmented Large Language Models (2026.eacl-long)

Copied to clipboard

Challenge: Search-augmented large language models (LLMs) excel at knowledge-intensive tasks by integrating external retrieval.
Approach: They conduct a systematic evaluation of over-searching across multiple dimensions including query types, model categories, retrieval conditions, and multi-turn conversations.
Outcome: The proposed model improves answer accuracy on answerable queries but harms abstention on unanswerable ones .
TAN-NTM: Topic Attention Networks for Neural Topic Modeling (2021.acl-long)

Copied to clipboard

Challenge: Topic models have been widely used to learn text representations and gain insight into document corpora.
Approach: They propose a framework which processes document as a sequence of tokens through a LSTM whose contextual outputs are attended in a topic-aware manner.
Outcome: The proposed model improves on two downstream tasks: document classification and topic guided keyphrase generation.
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)

Copied to clipboard

Challenge: Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models.
Approach: They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization.
Outcome: The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively.
Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Open Domain Multi-Hop Question Answering (ODMHQA) is one of the most challenging tasks in Natural Language Processing (NLP)
Approach: They propose a mechanism that leverages the intrinsic capabilities of Large Language Models to judge whether the generated answers are off-topic.
Outcome: The proposed method reduces the occurrence of off-topic answers by nearly 13%, improving the performance in Exact Match (EM) by nearly 3% compared to the baseline method without the Dr3 mechanism.
Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods, such as a n-terminal coding, do not provide accurate data for large language models.
Approach: They propose a lightweight framework that leverages attention distributions and uncertainty signals in a single-pass decoding.
Outcome: Experiments on open-book QA datasets show that DAGCD improves faithfulness and robustness while preserving computational efficiency.
GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentation (2021.emnlp-main)

Copied to clipboard

Challenge: Prior methods for detecting out-of-scope (OOS) utterances in text are limited and require a limited amount of data to obtain.
Approach: They propose an orthogonal technique that augments existing data to train better OOS detectors operating in low-data regimes.
Outcome: The proposed method outperforms existing methods on key metrics across three benchmarks and achieves relative gains of 52.4%, 48.9% and 50.3%.
Focus-Constrained Attention Mechanism for CVAE-based Response Generation (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing models generate high-frequency but trivial responses such as "I don't know" or "I'm ok" due to the discrepancy in discourse-level information, standard models generate one-to-many relationships.
Approach: They propose to transform coarse-grained discourse-level information into fine-grounded word-level knowledge by introducing a fine-grain focus signal and a focus-constrained attention mechanism to take full advantage of focus.
Outcome: The proposed model can generate more diverse and informative responses compared with state-of-the-art models.
Adversarial Self-Supervised Learning for Out-of-Domain Detection (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods for detecting out-of-domain (OOD) intents are unsupervised and require extensive labeled data.
Approach: They propose a self-supervised contrastive learning framework to model discriminative semantic features from unlabeled data.
Outcome: The proposed framework outperforms baseline methods on two public benchmark datasets with a statistically significant margin.
Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Prior work has attempted to mitigate this issue by using adaptive reasoning strategies, but these methods overlook a fundamental bottleneck: visual perception failures.
Approach: They propose a meta-reasoning controller that dynamically routes computation among three decision paths at each generation step.
Outcome: The proposed method outperforms slow-thinking methods while producing shorter responses.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations