Papers by Loïc Fosse
DivMerge: A divergence-based model merging method for multi-tasking (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods for multitask learning struggle with interference between tasks, especially as the number of tasks grows. |
| Approach: | They propose a reference-free method that minimizes the divergence between models' outputs and those of the merged model, automatically balancing task importance. |
| Outcome: | The proposed method outperforms existing methods on classification and generative tasks and remains robust when scaling to more tasks. |
Statistical Deficiency for Task Inclusion Estimation (2025.acl-long)
Copied to clipboard
Loïc Fosse, Frederic Bechet, Benoit Favre, Géraldine Damnati, Gwénolé Lecorvé, Maxime Darrin, Philippe Formont, Pablo Piantanida
| Challenge: | Tasks are central in machine learning, as they are the most natural objects to assess the capabilities of current models. |
| Approach: | They propose a theoretically grounded setup to define the notion of task and compute the inclusion between two tasks from a statistical deficiency point of view. |
| Outcome: | The proposed model estimates the degree of inclusion between tasks on synthetic data and reconstructs the classic NLP pipeline. |