Papers by Justin Payan
InstructExcel: A Benchmark for Natural Language Instruction in Excel (2023.findings-emnlp)
Copied to clipboard
Justin Payan, Swaroop Mishra, Mukul Singh, Carina Negreanu, Christian Poelitz, Chitta Baral, Subhro Roy, Rasika Chakravarthy, Benjamin Van Durme, Elnaz Nouri
| Challenge: | Large Language Models (LLMs) can solve increasingly complex NLP tasks such as Excel specific tasks. |
| Approach: | They propose a large-scale benchmark to test whether Large Language Models can generate code that solves Excel specific tasks provided via natural language user instructions. |
| Outcome: | The proposed model outperforms existing models and provides a hard benchmark for state of the art models like GPT-4. |
Towards Realistic Single-Task Continuous Learning Research for NER (2021.findings-emnlp)
Copied to clipboard
Justin Payan, Yuval Merhav, He Xie, Satyapriya Krishna, Anil Ramakrishna, Mukund Sridhar, Rahul Gupta
| Challenge: | Academic datasets are often static and contain data that is annotated all at once based on fixed annotation guidelines. |
| Approach: | They propose to build a single-task continuous learning dataset from an existing dataset and release it along with the code to the research community. |
| Outcome: | The proposed model is based on an existing dataset and released to the research community. |