Papers by Elie Antoine
Question Generation and Answering for exploring Digital Humanities collections (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent advances in representation learning of text have achieved impressive results on benchmark Natural Language Understanding (NLU) tasks. |
| Approach: | They propose a question answering paradigm that uses a BART Transformer based generative model to generate question data. |
| Outcome: | The proposed approach is validated on a new corpus of digitized archive collections of a French Social Science journal. |
Part-Of-Speech Sensitivity of Routers in Mixture of Experts Models (2025.coling-main)
Copied to clipboard
| Challenge: | a study examines the behavior of routers in Mixture of Experts (MoE) models . experts with similar linguistic traits are often routed to the same expert regardless of context . |
| Approach: | They investigate how tokens are routed based on their linguistic features . they aim to explore whether experts specialize in processing tokens with similar linguistic traits . |
| Outcome: | The proposed model-integrated routers are based on Mixture of Experts (MoE) models . the results show that expert specialization is high for POS categories . |
A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail for linguistic characteristics of input examples, despite the impressive quantity of scientific studies dedicated to them, the capabilities, limitations, and risks of these models remain largely unknown. |
| Approach: | They propose to use semantic frame annotation to characterize examples by a small number of complexity factors to account for model’s difficulty. |
| Outcome: | The proposed evaluation methodology is based on the intuition that certain examples consistently yield lower scores regardless of model size or architecture. |