Challenge: Speech signals convey abundant speaker-related metadata, yet current privacy research focuses on identity-centric voiceprint protection, leaving sensitive Speaker Attribute Privacy (SAP) underexplored.
Approach: They propose a large-scale Chinese dataset to evaluate speaker-related privacy leakage . the dataset includes 227.3 hours of audio from 1,000 speakers .
Outcome: The proposed model systematically evaluates speaker-related privacy leakage in everyday scenarios.

Similar Papers

HearSay Benchmark: Do Audio LLMs Leak What They Hear? (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio large language models have led to their potential privacy implications unexplored.
Approach: They propose a benchmark to examine whether ALLMs leak user privacy through acoustic voiceprints.
Outcome: The proposed benchmark is constructed from over 22,000 real-world audio clips.
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Challenge: generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach: They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome: The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.
MoE Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Free (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on Large Language Models (LLMs) limited to textual input modality . acoustic information is intrinsically heterogeneous, entangling attributes such as speech, music, and environmental context.
Approach: They propose a sparse Mixture-of-Experts architecture to decouple acoustic information by routing audio tokens to specialized experts.
Outcome: The proposed architecture outperforms existing models on audio semantic and paralinguistic tasks while retaining shared experts for global context.
WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem (2026.findings-acl)

Copied to clipboard

Challenge: despite its linguistic significance, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models.
Approach: They propose to use WenetSpeech-Wu as a large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect of Chinese.
Outcome: The proposed dataset includes 8,000 hours of speech data and strong open-source models . the proposed dataset is competitive and empirically validated .
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluations rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics that characterize authentic physical environments.
Approach: They propose a robustness benchmark to stress-test Audio Large Models (ALLMs) using high-fidelity auditory scene simulations.
Outcome: The proposed model performs well on a wide range of tasks, including automatic speech recognition, speech translation, and audio-based reasoning.
VoiceBench: Benchmarking LLM-Based Voice Assistants (2026.tacl-1)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have enabled real-time speech interactions through LLMs.
Approach: They propose a benchmark specifically designed to assess LLM-based voice assistants.
Outcome: The proposed benchmark measures the performance of LLM-based voice assistants across eight tasks.
Audio-Based Linguistic Feature Extraction for Enhancing Multi-lingual and Low-Resource Text-to-Speech (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to synthesize speech for low-resource languages require a substantial amount of source language corpora to generate the linguistic knowledge that can be reused for speech synthesis.
Approach: They propose a method that extracts linguistic features from audio input while effectively filtering out miscellaneous acoustic information including speaker-specific attributes like timbre.
Outcome: The proposed method extracts linguistic features from audio input while effectively filtering out miscellaneous acoustic information including speaker-specific attributes like timbre.
Adaptive Backtracking for Privacy Protection in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing privacy protection methods are prone to privacy leakage, but they are not effective in ensuring the privacy of users.
Approach: They propose to capture latent leakage tendency of large language models during generation process and to construct a new benchmark for personal information.
Outcome: The proposed method improves privacy by up to 14% over strong baselines against adversarial attacks, avoiding the degradation of response utility.
AudioBench: A Universal Benchmark for Audio Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation regimes for audio large language models do not cover the breadth of their possible use cases.
Approach: They propose to use AudioBench to evaluate audio large language models . they found that no single model excels consistently across all tasks .
Outcome: The proposed evaluation targets speech understanding, audio scene understanding, and voice understanding (paralinguistic) . no single model excels consistently across all tasks, the paper found .
SCENEBench: An Audio Understanding Benchmark Grounded in Assistive and Industrial Use Cases (2026.eacl-long)

Copied to clipboard

Challenge: Existing models that measure audio comprehension beyond automatic speech recognition lack performance and latency.
Approach: They propose a benchmark suite that measures audio comprehension beyond automatic speech recognition . the benchmark suite includes a small human-recorded evaluation split per category .
Outcome: The proposed suite measures audio comprehension beyond speech recognition . it includes a small human-recorded evaluation split per category .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations