Papers by Rasika Chakravarthy
InstructExcel: A Benchmark for Natural Language Instruction in Excel (2023.findings-emnlp)
Copied to clipboard
Justin Payan, Swaroop Mishra, Mukul Singh, Carina Negreanu, Christian Poelitz, Chitta Baral, Subhro Roy, Rasika Chakravarthy, Benjamin Van Durme, Elnaz Nouri
| Challenge: | Large Language Models (LLMs) can solve increasingly complex NLP tasks such as Excel specific tasks. |
| Approach: | They propose a large-scale benchmark to test whether Large Language Models can generate code that solves Excel specific tasks provided via natural language user instructions. |
| Outcome: | The proposed model outperforms existing models and provides a hard benchmark for state of the art models like GPT-4. |