Papers by Kartik Mehta
FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipeline (2025.findings-emnlp)
Copied to clipboard
Parker Seegmiller, Kartik Mehta, Soumya Saha, Chenyang Tao, Shereen Oraby, Arpit Gupta, Tagyoung Chung, Mohit Bansal, Nanyun Peng
| Challenge: | Recent work improving LLM math reasoning with synthetic data uses unique setups, making comparison of data synthesis strategies impractical. |
| Approach: | They propose a framework for LLM assessment of math reasoning with synthetic data . they use 10 existing data synthesis strategies and multiple other factors to study performance . |
| Outcome: | The proposed data synthesis strategies outperform public datasets on OlympiadBench, CollegeMath, GSMPlus and MATH. |
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints (2024.findings-emnlp)
Copied to clipboard
Thomas Palmeira Ferraz, Kartik Mehta, Yu-Hsiang Lin, Haw-Shiuan Chang, Shereen Oraby, Sijia Liu, Vivek Subramanian, Tagyoung Chung, Mohit Bansal, Nanyun Peng
| Challenge: | Recent studies have shown that LLMs struggle with instructions containing multiple constraints. |
| Approach: | They propose a self-correction pipeline that decomposes the original instruction into a list of constraints and uses a Critic model to decide when and where the LLM’s response needs refinement. |
| Outcome: | The proposed model outperforms GPT-4 on RealInstruct and IFEval even with weak feedback. |
DiCoRe: Enhancing Zero-shot Event Detection via Divergent-Convergent LLM Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Understanding the complex event ontology, extracting domain-specific triggers from the passage, and structuring them appropriately overloads and limits the utility of Large Language Models (LLMs). |
| Approach: | They propose a divergent-convergent reasoning framework that decouples the task of ED using Dreamer and Grounder. |
| Outcome: | The proposed framework outperforms baselines on six datasets across five domains and nine LLMs, achieving 4–7% average gains over the best baseline. |
NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension (2022.naacl-industry)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of locating and classifying entities mentioned in unstructured text into predefined categories. |
| Approach: | They propose to use a BERT-based multi-question MRC task where multiple questions (one question per entity) are considered at the same time for a single text. |
| Outcome: | The proposed architecture leads to 2.5 times faster training and 2.3 times faster inference on three NER datasets. |
Improving Answer Selection and Answer Triggering using Hard Negatives (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to answer selection and answer triggering have been proposed. |
| Approach: | They propose to use hard negatives with a siamese network and a suitable loss function for answer selection and answer triggering. |
| Outcome: | The proposed model improves on InsuranceQA, SelQA, and an internal QA dataset by 2.3 points over previous baselines. |
LATEX-Numeric: Language Agnostic Text Attribute Extraction for Numeric Attributes (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing methods for training numeric attributes are based on manual labeling and distant supervision leads to incomplete training annotations. |
| Approach: | They propose a multi-task learning architecture to deal with missing attribute values in training data, removing dependency on manual annotations. |
| Outcome: | The proposed framework improves on 20 numeric attributes extracted from 5 product categories and 3 english marketplaces with language-agnostic performance. |