Papers by Keshav Ramji
Inductive Linguistic Reasoning with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Evaluating large language models (LLMs) on their linguistic reasoning capabilities is an important task to understand the gaps in their skills that may surface during large-scale adoption. |
| Approach: | They propose to generate analogical exemplars with a language model and apply them in-context with target language exemplar. |
| Outcome: | The proposed method can be applied to other tasks present in Linguistics Olympiad competitions and achieves state-of-the-art results across nearly all problem types and difficulty levels in the LINGOLY dataset. |