Papers by Paweł Skórzewski
A Benchmark for Audio Reasoning Capabilities of Multimodal Large Language Models (2026.eacl-long)
Copied to clipboard
Iwona Christop, Mateusz Czyżnikiewicz, Paweł Skórzewski, Łukasz Bondaruk, Jakub Kubiak, Marcin Lewandowski, Marek Kubis
| Challenge: | Existing benchmarks for testing audio modality of multimodal large language models focus on testing audio tasks in isolation. |
| Approach: | They propose a new benchmark to assess multimodal large language models' ability to combine audio tasks. |
| Outcome: | The proposed benchmarks show that multimodal models can solve problems that require reasoning over audio signals with satisfactory results. |
Named Entity Recognition to Detect Criminal Texts on the Web (2022.lrec-1)
Copied to clipboard
| Challenge: | Using named-entity extraction techniques, a toolkit that extracts information related to criminal activity from Polish Internet is evaluated on 6240 manually annotated text fragments. |
| Approach: | They propose a toolkit that uses named-entity extraction techniques to identify information related to criminal activity in texts from the Polish Internet. |
| Outcome: | The proposed method is feasible and has potential value for real-life applications in the daily work of border guards. |
Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errors (2023.emnlp-main)
Copied to clipboard
| Challenge: | proposed method combines back transcription with fine-grained technique for categorizing speech recognition errors . proposed method relies on the use of synthesized speech in place of audio recording . |
| Approach: | They propose a method for investigating the impact of speech recognition errors on NLU models . they use a back transcription procedure and a fine-grained technique for categorizing errors . |
| Outcome: | The proposed method relies on synthesized speech in place of audio recording to evaluate the model. |