Papers by Pranesh Srinivasan
Dolomites: Domain-Specific Long-Form Methodical Tasks (2025.tacl-1)
Copied to clipboard
Chaitanya Malaviya, Priyanka Agrawal, Kuzman Ganchev, Pranesh Srinivasan, Fantine Huot, Jonathan Berant, Mark Yatskar, Dipanjan Das, Mirella Lapata, Chris Alberti
| Challenge: | Experts in various fields perform methodical writing tasks to plan, organize, and report their work. |
| Approach: | They propose a benchmark with specifications for 519 methodical writing tasks . they use expert revisions of up to 10 model-generated examples to evaluate contemporary language models. |
| Outcome: | The proposed benchmark includes specifications for 519 methodical writing tasks . it includes examples with input and output examples, and is available at https://dolomites-benchmark.github.io/ . |