Challenge: Recent advances in large language models have spurred interest in expanding their application beyond text-based tasks.
Approach: They propose to categorize the integration of speech with LLMs into three main approaches . they demonstrate how these methods are applied across various speech-related applications .
Outcome: The proposed methods are applied across speech-related applications and highlight the challenges in this field to offer inspiration for future research.

Similar Papers

Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)

Copied to clipboard

Challenge: Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research .
Approach: This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc.
Outcome: This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages .
Recent Advances in Speech Language Models: A Survey (2025.acl-long)

Copied to clipboard

Challenge: Text-based Large Language Models (LLMs) are a promising solution for end-to-end speech interaction.
Approach: They propose to build a framework that allows users to input text and translate it into speech . they propose to use a text-only LLM and a "textto-speech" framework to generate a response based on this transcription .
Outcome: The survey offers an overview of recent approaches to building SpeechLMs . it outlines core architectural components, training methodologies, evaluation strategies and challenges .
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains.
Approach: They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks .
Outcome: The proposed evaluations are reproducible, reliable, and robust.
Assessing the Capabilities of Large Language Models in Coreference: An Evaluation (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a new approach to coreference resolution, but their performance is not yet fully understood.
Approach: They propose that future efforts should improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs.
Outcome: The proposed methods improve scope, data, and evaluation methods of traditional coreference research to adapt to the development of LLMs.
Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large audio-language models (LALMs) have expanded their impact beyond natural language processing (NLP) to multimodal domains.
Approach: They propose a systematic taxonomy for LALM evaluations, categorizing them into four dimensions based on their objectives: (1) General Auditory Awareness and Processing, (2) Knowledge and Reasoning, (3) Dialogue-oriented Ability, and (4) Fairness, Safety, and Trustworthiness.
Outcome: The proposed taxonomy categorizes LALM evaluations into four dimensions based on their objectives and highlights challenges in this field.
The Impact of Large Language Models in Academia: from Writing to Speaking (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are impacting human society, especially in textual information.
Approach: They propose to build an automated monitoring platform to track the impact of large language models on human expression.
Outcome: The results show that LLM-style words such as significant are used more frequently in abstracts and oral presentations.
Adaptation of Large Language Models (2025.naacl-tutorial)

Copied to clipboard

Challenge: a tutorial on adaptation of large language models addresses the growing demand for models that go beyond static capabilities.
Approach: This tutorial will provide an overview of dynamic, domain-specific, and task-adaptive LLM adaptation techniques.
Outcome: This tutorial will outline dynamic, domain-specific, and task-adaptive LLM adaptation techniques.
Language Adaptation of Large Language Models: An Empirical Study on LLaMA2 (2025.coling-main)

Copied to clipboard

Challenge: Popularity of Large Language Models (LLMs) has seen a skyrocketing increase in recent years.
Approach: They present a systematic review of the language adaptation process for Large Language Models including vocabulary expansion, continued pre-training, and instruction fine-tuning.
Outcome: The proposed model is based on empirical studies conducted on LLaMA2 and discussions on various settings affecting the model's capabilities.
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (2024.emnlp-main)

Copied to clipboard

Challenge: Existing surveys on scientific LLMs focus on one or two fields or a single modality.
Approach: They survey 260 scientific LLMs and examine their architectures and pre-training techniques . they also discuss commonalities and differences between LLM architectures .
Outcome: The proposed model architectures and evaluation techniques are used to improve scientific discovery.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations