Papers by Ludwig Schmidt
Measuring and Narrowing the Compositionality Gap in Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a language model can correctly answer all sub-problems but not generate the overall solution. |
| Approach: | They propose a method that asks itself and then answers follow-up questions to narrow the compositionality gap by reasoning explicitly instead of implicitly. |
| Outcome: | The proposed method improves on chain of thought by asking itself and answering follow-up questions. |
Exploring The Landscape of Distributional Robustness for Question Answering Models (2022.findings-emnlp)
Copied to clipboard
Anas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt
| Challenge: | Existing methods for predicting distributional robustness fail to generalize reliably in a variety of test conditions. |
| Approach: | They conduct a large empirical evaluation to investigate the landscape of distributional robustness in question answering. |
| Outcome: | The proposed methods are more robust to distribution shifts than fully fine-tuned models, and few-shot prompt models exhibit better robustness than few- shot prompt models. |
Better Alignment with Instruction Back-and-Forth Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | et al., 2023) proposes a method to improve instruction-tuning data . e.g., we generate synthetic instructions using the backtranslation approach . |
| Approach: | They propose a method to improve instruction-tuning data using web-based inputs . they generate synthetic instructions using the backtranslation approach and filter the generated data . |
| Outcome: | The proposed method improves the quality of instruction-tuning data based on preprocessed texts . it yields better AlpacaEval win rates than direct distillation . |
Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pre-training (2026.findings-eacl)
Copied to clipboard
Jeffrey Li, Joshua P Gardner, Doug Kang, Fangping Shi, Karanjeet Singh, Chun-Liang Li, Herumb Shandilya, David Leo Wright Hall, Oncel Tuzel, Percy Liang, Ludwig Schmidt, Hadi Pouransari, Fartash Faghri
| Challenge: | Existing open-source datasets predominantly apply a single fixed extractor to all webpages. |
| Approach: | They propose to take a Union over different extractors to improve model performance . they show that extractor choice can significantly impact downstream task performance based on content type . |
| Outcome: | The proposed approach can increase the token yield of DCLM-Baseline by 71% while maintaining benchmark performance. |
Data or Language Supervision: What Makes CLIP Better than DINO? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | CLIP outperforms self-supervised models like DINO as vision encoders for vision-language models (VLMs) but it remains unclear whether this advantage stems from CLIP’s language supervision or its much larger training data. |
| Approach: | Embedding analysis shows CLIP captures high-level semantics while DINO is more responsive to low-level features like colors and styles. |
| Outcome: | Embedding analysis shows that CLIP captures high-level semantics, while DINO is more responsive to low-level features like colors and styles. |