Papers by Vittorio Mazzia
MASSIVE-Agents: A Benchmark for Multilingual Function-Calling in 52 Languages (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using the original dataset, we cleaned up the MASSIVE dataset and reformatted it for evaluation within the Berkeley Function-Calling Leaderboard framework. |
| Approach: | They present a new benchmark for assessing multilingual function calling across 52 languages . they clean the original MASSIVE dataset and reformat it for evaluation . |
| Outcome: | The new benchmark covers 55 functions and 286 arguments in 52 languages. |
Detecting and Mitigating Challenges in Zero-Shot Video Summarization with Video LLMs (2025.findings-acl)
Copied to clipboard
Luca Cagliero, Lorenzo Vaiani, Eliana Pastor, Alkis Koudounas, Elena Baralis, Vittorio Mazzia, Sandro Pollastrini, Thomas Gueudre, Manuel Giollo, Daniele Amberti, Yue Wu
| Challenge: | Video Large Language Models (VLLMs) exhibit impressive zero-shot capabilities in video analysis, but their performance varies significantly depending on the LLM prompt, the characteristics of the video, and the properties of the training data and LLM architecture. |
| Approach: | They propose to use Chain-of-Thought prompting to inject knowledge extracted by external, lightweight models into video summarization benchmarks to evaluate their performance. |
| Outcome: | The proposed solutions improve summarization performance by injecting knowledge extracted by external, lightweight models. |
Privacy Preserving Data Selection for Bias Mitigation in Speech Models (2025.acl-industry)
Copied to clipboard
Alkis Koudounas, Eliana Pastor, Vittorio Mazzia, Manuel Giollo, Thomas Gueudre, Elisa Reale, Luca Cagliero, Sandro Cumani, Luca De Alfaro, Elena Baralis, Daniele Amberti
| Challenge: | Existing methods for identifying subgroups raise privacy concerns and gather sensitive information at runtime might be impractical. |
| Approach: | They propose a method to identify and train underperforming subgroups and train a model to predict if an utterance belongs to these subgroup. |
| Outcome: | The proposed method reduces biases and improves performance on intent classification and automatic speech recognition tasks. |