Papers by Karanjeet Singh
Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pre-training (2026.findings-eacl)
Copied to clipboard
Jeffrey Li, Joshua P Gardner, Doug Kang, Fangping Shi, Karanjeet Singh, Chun-Liang Li, Herumb Shandilya, David Leo Wright Hall, Oncel Tuzel, Percy Liang, Ludwig Schmidt, Hadi Pouransari, Fartash Faghri
| Challenge: | Existing open-source datasets predominantly apply a single fixed extractor to all webpages. |
| Approach: | They propose to take a Union over different extractors to improve model performance . they show that extractor choice can significantly impact downstream task performance based on content type . |
| Outcome: | The proposed approach can increase the token yield of DCLM-Baseline by 71% while maintaining benchmark performance. |