Papers by Syrielle Montariol
“Flex Tape Can’t Fix That”: Bias and Misinformation in Edited Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Weight-based model editing methods can unintentionally alter unrelated parametric knowledge representations, potentially increasing the risk of harm. |
| Approach: | They propose a benchmark dataset for measuring bias amplification of model editing methods for demographic traits such as race, geographic origin, and gender. |
| Outcome: | The proposed methods can unintentionally alter unrelated parametric knowledge representations, potentially increasing the risk of harm. |
CRAB: Assessing the Strength of Causal Relationships Between Real-world Events (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for reasoning about events in narratives do not understand the complexity of the causal relationships of events in the narrative. |
| Approach: | They propose a Causal Reasoning Assessment Benchmark to evaluate causal understanding of events in narratives. |
| Outcome: | The proposed model performs worse when models are derived from complex causal structures than simple linear causal chains. |
PICLe: Pseudo-annotations for In-Context Learning in Low-Resource Named Entity Detection (2025.naacl-long)
Copied to clipboard
| Challenge: | In-context learning is sensitive to the choice of demonstrations and can be used for tasks with few examples. |
| Approach: | They propose a framework for in-context learning with noisy, pseudo-annotated demonstrations . they annotate large quantities of demonstrations in a zero-shot first pass . |
| Outcome: | The proposed framework outperforms ICL on biomedical NED datasets with zero human-annotation. |
DRIVINGVQA: A Dataset for Interleaved Visual Chain-of-Thought in Real-World Driving Scenarios (2026.findings-eacl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting is a prompting strategy that improves reasoning in large language models, but its effectiveness in vision-language models remains limited due to over-reliance on textual cues and memorized knowledge. |
| Approach: | They propose a visual question-answering dataset derived from driving theory exams that incorporates textual explanations with visual tokens extracted from entities relevant to the reasoning process. |
| Outcome: | The proposed approach outperforms chain-of-thought prompting in large language models and vision-language models in real-world scenarios. |
Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Models (2022.findings-aacl)
Copied to clipboard
| Challenge: | Zero-shot cross-lingual transfer learning has been shown to be challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as hate speech detection. |
| Approach: | They propose to train on multilingual auxiliary tasks to improve zero-shot transfer of hate speech detection models across languages by bringing a cross-lingual knowledge proxy to the task. |
| Outcome: | The proposed methods improve zero-shot transfer of hate speech detection models across languages and domains using multilingual auxiliary tasks fine-tuned. |
CRoW: Benchmarking Commonsense Reasoning in Real-World Tasks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts in natural language processing (NLP) commonsense reasoning research have produced a number of new datasets and benchmarks. |
| Approach: | They propose a manually-curated, multi-task benchmark that evaluates models' ability to apply commonsense reasoning in the context of six real-world NLP tasks. |
| Outcome: | The proposed benchmark evaluates the ability of models to apply commonsense reasoning in the context of six real-world NLP tasks. |
Measure and Evaluation of Semantic Divergence across Two Languages (2021.acl-long)
Copied to clipboard
| Challenge: | Languages are dynamic systems: word usage may change over time, reflecting various societal factors. |
| Approach: | They propose to build time-varying and bilingual word embeddings using contextualised and non-contextualised embeddables. |
| Outcome: | The proposed methods perform best on newspaper corpora, but are competitive on large corpus. |
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)
Copied to clipboard
Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
| Challenge: | Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation. |
| Approach: | They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem. |
| Outcome: | The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance. |
Scalable and Interpretable Semantic Change Detection (2021.naacl-main)
Copied to clipboard
| Challenge: | Several cluster-based methods for word usage change detection are unscalable in terms of memory consumption and computation time. |
| Approach: | They propose a scalable method for word usage-change detection that uses contextual embeddings to aggregate word usages into clusters. |
| Outcome: | The proposed method offers high performance and interpretability while being unscalable. |
Effectiveness of Data Augmentation and Pretraining for Improving Neural Headline Generation in Low-Resource Settings (2022.lrec-1)
Copied to clipboard
| Challenge: | Neural approaches for natural language generation (NLG) have mushroomed due to large textual resources. |
| Approach: | They propose to use a pretrained multilingual encoder-decoder model and a combination of two pretrained language models to train a model in a low-resource setting. |
| Outcome: | The proposed model outperforms the previous model on English and on a small subset of the same data. |
CAVE : Detecting and Explaining Commonsense Anomalies in Visual Environments (2025.emnlp-main)
Copied to clipboard
Rishika Bhagwatkar, Syrielle Montariol, Angelika Romanou, Beatriz Borges, Irina Rish, Antoine Bosselut
| Challenge: | a new benchmark for computer vision fails to capture richness and unpredictability of real-world anomalies . state-of-the-art VLMs struggle with visual anomaly perception and commonsense reasoning . elucidating the nature of anomalies is a fundamental human trait . |
| Approach: | They propose a benchmark for visual anomalies that includes annotations for visual grounding and categorizing anomalies based on their visual manifestations, their complexity, severity, and commonness. |
| Outcome: | The proposed benchmark improves on existing vision models by incorporating visual annotations. |