Papers by Fantine Huot
Help Me Write a Story: Evaluating LLMs’ Ability to Generate Writing Feedback (2025.acl-long)
Copied to clipboard
| Challenge: | Current models provide specific and mostly accurate writing feedback, but they fail to identify the biggest writing issue in the story and to correctly decide when to offer critical vs. positive feedback. |
| Approach: | They propose a task that corrupts 1,300 stories to intentionally introduce writing issues to study model performance. |
| Outcome: | The proposed model performs well in a controlled task with human and automatic evaluation metrics. |
Dolomites: Domain-Specific Long-Form Methodical Tasks (2025.tacl-1)
Copied to clipboard
Chaitanya Malaviya, Priyanka Agrawal, Kuzman Ganchev, Pranesh Srinivasan, Fantine Huot, Jonathan Berant, Mark Yatskar, Dipanjan Das, Mirella Lapata, Chris Alberti
| Challenge: | Experts in various fields perform methodical writing tasks to plan, organize, and report their work. |
| Approach: | They propose a benchmark with specifications for 519 methodical writing tasks . they use expert revisions of up to 10 model-generated examples to evaluate contemporary language models. |
| Outcome: | The proposed benchmark includes specifications for 519 methodical writing tasks . it includes examples with input and output examples, and is available at https://dolomites-benchmark.github.io/ . |
Learning to Plan and Generate Text with Citations (2024.acl-long)
Copied to clipboard
Constanza Fierro, Reinald Kim Amplayo, Fantine Huot, Nicola De Cao, Joshua Maynez, Shashi Narayan, Mirella Lapata
| Challenge: | Large language models (LLMs) are increasingly useful in information-seeking scenarios, ranging from answering simple questions to generating responses to search-like queries. |
| Approach: | They propose to use plan-based models to improve faithfulness, grounding, and controllability of generated content and its organization. |
| Outcome: | The proposed models improve faithfulness, grounding, and controllability of generated content and its organization. |
𝜇PLAN: Summarizing using a Content Plan as Cross-Lingual Bridge (2024.eacl-long)
Copied to clipboard
Fantine Huot, Joshua Maynez, Chris Alberti, Reinald Kim Amplayo, Priyanka Agrawal, Constanza Fierro, Shashi Narayan, Mirella Lapata
| Challenge: | Recent advances in abstractive summarization have focused on English, but more recently, with the advent of large pre-trained models, the task is becoming more complex. |
| Approach: | They propose an approach to cross-lingual summarization that uses an intermediate planning step as a cross-linguistic bridge. |
| Outcome: | The proposed approach achieves state-of-the-art in terms of informativeness and faithfulness on the XWikis dataset. |
Conditional Generation with a Question-Answering Blueprint (2023.tacl-1)
Copied to clipboard
Shashi Narayan, Joshua Maynez, Reinald Kim Amplayo, Kuzman Ganchev, Annie Louis, Fantine Huot, Anders Sandholm, Dipanjan Das, Mirella Lapata
| Challenge: | Neural generation models often struggle to identify which content units are salient. |
| Approach: | They propose a new conceptualization of text plans as a sequence of question-answer pairs . they propose QA blueprints as QA proxy for content selection and planning . |
| Outcome: | The proposed model improves existing datasets with QA blueprints as proxy for content selection and planning. |
Evaluating LLMs for Targeted Concept Simplification for Domain-Specific Texts (2024.emnlp-main)
Copied to clipboard
| Challenge: | Simplifying the entire text makes it understandable but sometimes removes important details. |
| Approach: | They propose a simplification task for rewriting text to help readers comprehend text containing unfamiliar concepts and introduce a dataset of 22k definitions from 13 academic domains paired with a difficult concept within each definition. |
| Outcome: | The proposed model outperforms open-source and commercial models on the task and human judges prefer explanations over simplifications of the difficult concept. |
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study (2024.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained Large Language Models have significantly advanced NLP, but their ever-increasing size poses significant challenges for conventional fine-tuning. |
| Approach: | They investigate the potential of Low-Rank Adaptation (LoRA) in multilingual summarization, a task that is challenging and relatively unexplored. |
| Outcome: | The proposed method outperforms full fine-tuning and cross-lingual transfer strategies in multilingual summarization tasks. |
Text-Blueprint: An Interactive Platform for Plan-based Conditional Generation (2023.eacl-demo)
Copied to clipboard
Fantine Huot, Joshua Maynez, Shashi Narayan, Reinald Kim Amplayo, Kuzman Ganchev, Annie Priyadarshini Louis, Anders Sandholm, Dipanjan Das, Mirella Lapata
| Challenge: | Recent work shows that conditional generation models can be useful to control the text generation process, leading to irrelevant, repetitive, and hallucinated content. |
| Approach: | They propose a web browser-based demonstration for query-focused summarization that uses a sequence of question-answer pairs as a blueprint plan for guiding text generation. |
| Outcome: | The proposed model can be used to generate query-focused summarization text using question-answer pairs as a blueprint plan. |