Challenge: Large Language Models excel at understanding conversational semantics, but lack of data makes them impractical for production deployment.
Approach: They propose a pipeline for generating multilingual conversational NER datasets with minimal human validation and a framework that leverages LLMs as semantic filters combined with catalog-based entity grounding to label live traffic data.
Outcome: The proposed framework outperforms existing models on public and private conversations by 97.12% on CoNLL-2003 and 83.09% on OntoNotes 5.0.

Similar Papers

Evaluating the Effectiveness of Large Language Models in Establishing Conversational Grounding (2024.emnlp-main)

Copied to clipboard

Challenge: despite its importance, there has been limited research on conversational grounding in recent years . pre-trained language models have been costly and time-consuming to evaluate .
Approach: They evaluate the performance of large language models in various aspects of conversational grounding . they propose ways to enhance the capabilities of the models that lag in this aspect .
Outcome: The proposed model performance is based on pre-trained language models and a large pre-training dataset.
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER).
Approach: They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data.
Outcome: The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities.
Lightweight Transformers for Conversational AI (2022.naacl-industry)

Copied to clipboard

Challenge: Commercial dialogue systems typically require a small footprint and fast execution time, but recent trends are in the other direction, resulting in difficulties in model deployment.
Approach: They build Transformer-based Language Models from scratch on large corpora of conversational data and compare their performance against BERT and other strong baselines on dialogue probing tasks.
Outcome: The proposed model outperforms existing models on dialogue probing tasks and can be fine-tuned on a single consumer GPU card.
Spoken Conversational Agents with Large Language Models (2025.emnlp-tutorials)

Copied to clipboard

Challenge: This tutorial focuses on the evolution of voice-native LLMs . it reviews the adaptation of text LLM to audio, cross-modal alignment, and joint speech–text training .
Approach: This tutorial examines the evolution of voice-native LLMs in conversational agents . it compares cascaded and voice-based LLM systems to end-to-end retrieval-and vision-grounded systems .
Outcome: This tutorial examines the evolution of voice-native LLMs . it compares the performance of voice assistants to current open-domain agents .
FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition (2026.findings-eacl)

Copied to clipboard

Challenge: Named entity recognition (NER) is the task of identifying tokens that belong to a predefined set of classes such as "person" or "location"
Approach: They propose a dataset-creation pipeline that scales the teacher-student paradigm to 91 languages and 25 scripts.
Outcome: The proposed model achieves comparable or improved performance in English, Thai, and Swahili despite being trained on 19x less data than strong baselines.
What Matters for Neural Cross-Lingual Named Entity Recognition: An Empirical Analysis (D19-1)

Copied to clipboard

Challenge: Named entity recognition models are challenging for languages with little training data.
Approach: They propose a simple and efficient neural architecture for cross-lingual named entity recognition models.
Outcome: The proposed model achieves competitive performance with the state-of-the-art on two transferable factors: sequential order and multilingual embedding.
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them .
Approach: They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition .
Outcome: The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs .
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs.
Approach: They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods.
Outcome: The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains.
GPT-NER: Named Entity Recognition via Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Large-scale language models (LLMs) have shown impressive ability for in-context learning with limited training data.
Approach: They propose a novel sequence labeling task that transforms a sequence labeled as a text-generation task into a self-verification task that LLMs can adapt to.
Outcome: The proposed model performs better on NER than supervised models on a variety of tasks . the proposed model can be easily adapted by LLMs to generate a text sequence .
Entity Resolution in Open-domain Conversations (2021.naacl-industry)

Copied to clipboard

Challenge: Recent work on incorporating external knowledge into the response generation models has attracted great interest.
Approach: They propose a neural entity linking approach to incorporate external knowledge into the response generation models to improve the relevancy of retrieved knowledge.
Outcome: The proposed approach outperforms the baseline model by 62.8% relative to the baseline.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations