Papers by Marc Marone
Pretrained Models for Multilingual Federated Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Federated Learning (FL) is a machine learning technique that trains a model across multiple distributed clients holding local data samples, without ever storing client data in a central location. |
| Approach: | They propose to use pretrained models to study three multilingual language tasks . they also examine impact of non-IID text on FL in naturally occurring data . |
| Outcome: | The proposed methods perform better than centralized learning even when using non-IID partitioning. |
“According to . . . ”: Prompting Language Models Improves Quoting from Pre-Training Data (2024.eacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) may hallucinate and generate false information despite pre-training on factual data. |
| Approach: | They propose a new evaluation metric that measures the extent to which model-produced answers are directly found in underlying text corpora. |
| Outcome: | The proposed evaluation metric measures the extent to which model-produced answers are directly found in underlying text corpora. |
Selecting, Planning, and Rewriting: A Modular Approach for Data-to-Document Generation and Translation (D19-56)
Copied to clipboard
| Challenge: | Existing systems for document-level generation and translation are too complex to capture the complexity of the problem. |
| Approach: | They propose to adapt a large scale system trained on WMT data to a document in a different language. |
| Outcome: | The proposed system generates a textual document from structured data or a document in a different language. |
Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent efforts to verify text accuracy provide no guarantees on their correctness . a new method to improve LLMs' verifiability is to use quotes to ground models . |
| Approach: | They propose a method that allows models to quote verbatim statements from trusted sources . they leverage a fast membership inference function to verify text against trusted corpora . |
| Outcome: | The proposed method significantly increases verbatim quotes from high-quality documents by up to 130% relative to base models while maintaining response quality. |
Certified Mitigation of Worst-Case LLM Copyright Infringement (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models are trained on vast datasets that include copyrighted material or content with usage restrictions. |
| Approach: | They propose a "copyright takedown" method that provides certified copyright take down . they use a combination of inference-time and rewriting techniques to transform potentially infringing segments . |
| Outcome: | The proposed method reduces infringement risk, preserves utility, and accommodates different levels of enforcement stringency with adaptive abstention. |
Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction (2021.emnlp-main)
Copied to clipboard
Mahsa Yarmohammadi, Shijie Wu, Marc Marone, Haoran Xu, Seth Ebner, Guanghui Qin, Yunmo Chen, Jialiang Guo, Craig Harman, Kenton Murray, Aaron Steven White, Mark Dredze, Benjamin Van Durme
| Challenge: | Zero-shot cross-lingual information extraction (IE) is a technique for training data in a source language but not in . |
| Approach: | They explore techniques including data projection and self-training to improve zero-shot cross-lingual information extraction (IE) IE is a construction of an IE model for some target language given existing annotations exclusively in English. |
| Outcome: | The proposed techniques show that they perform better than any single strategy. |