Papers by Aparna Garimella
Knowing What’s Missing: Assessing Information Sufficiency in Question Answering (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to assess whether a given context contains sufficient information fail on factual questions. |
| Approach: | They propose a framework that asks a model to reason about what information is missing . this framework generates more accurate sufficiency judgments while articulating any information gaps . |
| Outcome: | The proposed framework produces more accurate sufficiency judgments while clearly articulating any information gaps. |
MARCH: Evaluating the Intersection of Ambiguity Interpretation and Multi-hop Inference (2026.findings-acl)
Copied to clipboard
Jeonghyun Park, Ingeol Baek, Seunghyun Yoon, Haeun Jang, Aparna Garimella, Akriti Jain, Nedim Lipka, Hwanhee Lee
| Challenge: | Existing benchmarks on multi-hop QA focus on single-hop and layered ambiguity, but they focus on ambiguous questions . ambiguities can arise at any stage, complicating the reasoning process . |
| Approach: | They propose a benchmark to evaluate ambiguity in multi-hop question answering . they propose MARCH, which uses 2,209 carefully annotated questions . |
| Outcome: | The proposed framework outperforms existing approaches and significantly outperfies existing frameworks. |
Presentations by the Humans and For the Humans: Harnessing LLMs for Generating Persona-Aware Slides from Documents (2024.eacl-long)
Copied to clipboard
Ishani Mondal, Shwetha S, Anandhavelu Natarajan, Aparna Garimella, Sambaran Bandyopadhyay, Jordan Boyd-Graber
| Challenge: | Existing efforts to automate document-to-slide generation have failed to adapt to the persona of target audience or duration of presentation. |
| Approach: | They propose a concept of end-user specification-aware document to slides conversion that incorporates end- user specifications into the conversion process. |
| Outcome: | The proposed model can create persona-aware presentations tailored to the persona of target audience and cognitive abilities of target audiences. |
AUTOSUMM: Automatic Model Creation for Text Summarization (2021.emnlp-main)
Copied to clipboard
Sharmila Reddy Nangi, Atharv Tyagi, Jay Mundra, Sagnik Mukherjee, Raj Snehal, Niyati Chhaya, Aparna Garimella
| Challenge: | Recent efforts to develop deep learning models for text generation tasks are challenging for non-experts. |
| Approach: | They propose methods to automatically create deep learning models for extractive and abstractive summarization tasks using large language models. |
| Outcome: | The proposed methods achieve near state-of-the-art performance on a range of datasets. |
Infogen: Generating Complex Statistical Infographics from Documents (2025.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to generate simple charts have focused on generating simple infographics from text-heavy documents. |
| Approach: | They propose to generate statistical infographics composed of multiple sub-charts that are contextually accurate, insightful, and visually aligned. |
| Outcome: | The proposed framework outperforms both open-source and closed LLMs in text-to-statistical infographic generation. |
Women’s Syntactic Resilience and Men’s Grammatical Luck: Gender-Bias in Part-of-Speech Tagging and Dependency Parsing (P19-1)
Copied to clipboard
| Challenge: | linguistic studies have shown the prevalence of various lexical and grammatical patterns in texts authored by a person of a particular gender, but models for part-of-speech tagging and dependency parsing have not adapted to account for these differences. |
| Approach: | They annotate the Wall Street Journal part of the Penn Treebank with the gender information of the articles’ authors and build taggers and parsers trained on this data. |
| Outcome: | The proposed model can account for gendered differences in syntactic tasks and highlight future venues for developing more accurate taggers and parsers. |
Entity Extraction in Low Resource Domains with Selective Pre-training of Large Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to perform named entity recognition (NER) on unlabeled data are difficult to obtain in low-resource domains. |
| Approach: | They propose ways to use unlabeled data for pretraining to improve performance in downstream tasks. |
| Outcome: | The proposed methods outperform models trained on unlabeled data on seven domains. |
DocScript: Document-level Script Event Prediction (2024.lrec-main)
Copied to clipboard
Puneet Mathur, Vlad I. Morariu, Aparna Garimella, Franck Dernoncourt, Jiuxiang Gu, Ramit Sawhney, Preslav Nakov, Dinesh Manocha, Rajiv Jain
| Challenge: | Existing script event prediction frameworks such as ChatGPT and FlanT5 lack the ability to learn long-range dependencies between events. |
| Approach: | They propose a novel script event prediction task which aims to predict the next event from a candidate list of narrative events in long-form documents. |
| Outcome: | The proposed architecture can learn sequential ordering between events at the document scale. |
Doc2Chart: Intent-Driven Zero-Shot Chart Generation from Documents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations . however, it is not straightforward to apply these methods directly for a more real-world use case of visualizing data from long documents . |
| Approach: | They propose an unsupervised method for generating intent-based charts from documents . they propose an attribution-based metric that uses a structured textual representation of charts . |
| Outcome: | The proposed method outperforms baselines in terms of chart data accuracy and chart type over baselines. |
“Judge me by my size (noun), do you?” YodaLib: A Demographic-Aware Humor Generation Framework (2020.coling-main)
Copied to clipboard
| Challenge: | Humor is subjective and can be interpreted in different ways by different people. |
| Approach: | They propose an automatic method for filling the blanks in Mad Libs stories . they build upon the BERT platform to predict location-biased word fillings in incomplete sentences . |
| Outcome: | The proposed framework outperforms a semi-automated approach for filling the blanks in Mad Libs stories while accounting for the demographic backgrounds of the desired audience. |
TabReX: Tabular Referenceless eXplainable Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing metrics for evaluating the quality of tables generated by large language models flatten tables into text, ignoring structure or relying on fixed references that limit generalization. |
| Approach: | They propose a reference-less framework for evaluating tabular generation via graph-based reasoning . tabReX converts source text and generated tables into canonical knowledge graphs . |
| Outcome: | The proposed framework provides a high correlation with expert rankings and stable under harder perturbations. |
“Kelly is a Warm Person, Joseph is a Role Model”: Gender Biases in LLM-Generated Reference Letters (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are an effective tool to assist individuals in writing documents. |
| Approach: | They examine gender biases in large language models (LLMs)-generated reference letters . they find that models are biased because they are hallucinated . |
| Outcome: | The proposed model-generated reference letters are evaluated on 2 popular LLMs- ChatGPT and Alpaca. |
SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current text-to-image models struggle with generating accurate diagrams from long-context inputs. |
| Approach: | They propose a task that extracts relevant information from scientific papers and generates diagrams based on user intentions using intermediate code generation. |
| Outcome: | The proposed task outperforms existing models on factual correctness and visual appeal and outperfies existing ones on automatic and human judgement. |
Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for analyzing information from multiple sources are often too complex or fail to capture nuanced preferences accurately. |
| Approach: | They propose an interactive decision-making framework that combines document-grounded reasoning with Bayesian preference inference. |
| Outcome: | The proposed approach outperforms general-purpose LLMs and existing decision-support systems in achieving up to 20% improvement in decision accuracy over strong baselines across domains. |
Presentations are not always linear! GNN meets LLM for Text Document-to-Presentation Transformation with Attribution (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generate presentations from document to slide are difficult to implement and cause hallucination. |
| Approach: | They propose a graph-based solution that uses a combination of graph neural network and LLM to generate a presentation with attribution of content for each slide. |
| Outcome: | The proposed approach is more efficient than using LLMs for generating a presentation from the text of a document. |
Is This a Bad Table? A Closer Look at the Evaluation of Table Generation from Text (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing measures for table quality evaluation fail to capture the overall semantics of tables . failure to accurately assess table quality can result in including subpar content or overlooking valuable tables in documents. |
| Approach: | They propose a method that captures table semantics by breaking down a table into atomic statements and comparing them with ground truth statements. |
| Outcome: | The proposed method shows stronger correlation with human judgments of table quality across four datasets. |
Domain-Aware Dependency Parsing for Questions (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained parsers perform poorly on domain-specific questions, a paper argues . retraining parser with domain- specific questions is expensive, as these require linguistic expertise. |
| Approach: | They propose an automatic labeled domain question generation framework leveraging domain knowledge and seed domain questions. |
| Outcome: | The proposed framework improves state-of-the-art parsers on domain questions. |
EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Prediction (2021.eacl-main)
Copied to clipboard
| Challenge: | EmpathBERT is a demographic-aware framework for empathy prediction based on BERT. |
| Approach: | They propose a demographic-aware framework for empathy prediction based on BERT and utilize user demographics to analyze user responses to stimulative news articles. |
| Outcome: | The proposed framework surpasses machine learning and deep learning models and highlights the importance of demographic information in the responses. |
AnalystBench: Benchmarking professional long-form report generation with web-mined multimodal tasks (2026.findings-acl)
Copied to clipboard
Chau Minh Pham, Zichao Wang, Puneet Mathur, Alexa Siu, Akriti Jain, Aparna Garimella, Ananya B. Sai, Nedim Lipka, Mohit Iyyer, Varun Manjunatha
| Challenge: | Existing benchmarks decompose the end-to-end professional report generation into individual components. |
| Approach: | They propose a benchmarking tool that evaluates 20 real-world professional report generation tasks grounded in multimodal document collections. |
| Outcome: | The proposed model outperforms closed-source models on executive summarization tasks but drops significantly on long-horizon synthesis tasks. |
LegalCore: A Dataset for Event Coreference Resolution in Legal Documents (2025.findings-acl)
Copied to clipboard
Kangda Wei, Xi Shi, Jonathan Tong, null Sai Ramana Reddy, Anandhavelu Natarajan, Rajiv Jain, Aparna Garimella, Ruihong Huang
| Challenge: | Existing research on event coreference resolution is limited to news articles . existing datasets for news articles are limited to events and coreferences . |
| Approach: | They present a dataset for the legal domain LegalCore which has been annotated with event and event coreference information. |
| Outcome: | The legal contract documents annotated in this dataset are several times longer than news articles, with an average length of around 25k tokens per document. |
He is very intelligent, she is very beautiful? On Mitigating Social Biases in Language Modelling and Generation (2021.findings-acl)
Copied to clipboard
Aparna Garimella, Akhash Amarnath, Kiran Kumar, Akash Pramod Yalla, Anandhavelu N, Niyati Chhaya, Balaji Vasan Srinivasan
| Challenge: | Existing studies have focused on mitigating social biases in context-free representations, with recent shift to contextual ones. |
| Approach: | They propose an approach to mitigate social biases in a large pre-trained contextual language model . they propose lexical co-occurrence-based bias penalization in the decoder units . |
| Outcome: | The proposed approach reduces biases in fill-in-the-blank sentences and summarizes . it also reduces the biased representations in the frameworks, the authors show . |
SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integrity (2026.findings-eacl)
Copied to clipboard
| Challenge: | SMART-EDITOR is a framework for compositional layout and content editing for structured visual domains. |
| Approach: | They introduce a framework for compositional editing for structured images like posters or websites . SMART-EDITOR maintains global coherence through two complementary strategies . |
| Outcome: | The proposed framework maintains global coherence through two complementary strategies. |
kNN-LM Does Not Improve Open-ended Text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Interpolation-based retrieval-augmented language models (LMs) are a subtype of retrieval augmented language model that computes the probability of the next token by interpolating between the softmax distribution of the original LM and a token distribution formed by retrieving over an external datastore. |
| Approach: | They propose to interpolate the predicted distribution of the next word with a distribution formed from the most relevant retrievals for a given prefix. |
| Outcome: | The proposed methods do not exhibit improvements in open-ended generation quality, as measured by automatic evaluation metrics and human evaluations. |
Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Chart question answering (CQA) is a crucial area of Visual Language Understanding. |
| Approach: | They evaluate the robustness and consistency of current Visual Language Models on a dataset encompassing diverse question categories and chart formats. |
| Outcome: | The proposed models handle varying levels of chart and question complexity and are robust across different visual representations of the same underlying data. |
ADAPTIVE IE: Investigating the Complementarity of Human-AI Collaboration to Adaptively Extract Information on-the-fly (2025.coling-main)
Copied to clipboard
Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan Boyd-Graber
| Challenge: | Existing IE systems are either fully supervised, requiring expensive human annotations, or fully unsupervised, extracting information that often do not cater to user’s needs. |
| Approach: | They propose a framework that uses human-in-the-loop refinement to adapt to changing user questions. |
| Outcome: | The proposed framework is domain-agnostic, responsive, efficient for helping users access useful information while quickly reorganizing information in response to evolving information needs. |
A Neural CRF-based Hierarchical Approach for Linear Text Segmentation (2023.findings-eacl)
Copied to clipboard
Inderjeet Nair, Aparna Garimella, Balaji Vasan Srinivasan, Natwar Modani, Niyati Chhaya, Srikrishna Karanam, Sumit Shekhar
| Challenge: | Existing methods to segment unformatted text and transcripts explicitly train to predict segment boundaries, but they fail to provide a large annotated dataset. |
| Approach: | They propose a method to generate hierarchical segmentation structures based on Wikipedia annotations by using a neural conditional random field. |
| Outcome: | The proposed method outperforms or achieves competitive performance when compared to previous state-of-the-art algorithms. |
IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context (2024.naacl-long)
Copied to clipboard
Nihar Sahoo, Pranamya Kulkarni, Arif Ahmad, Tanu Goyal, Narjis Asad, Aparna Garimella, Pushpak Bhattacharyya
| Challenge: | Existing benchmark datasets focus on English language and the Western context, leaving a void for a reliable dataset that encapsulates India’s unique socio-cultural nuances. |
| Approach: | They propose to use CrowS-Pairs to create a benchmark dataset that captures and evaluates social biases in Large Language Models (LLMs). |
| Outcome: | The proposed dataset is available in English and Hindi and leverages LLMs ChatGPT and InstructGPT to augment the existing dataset with diverse societal biases and stereotypes prevalent in India. |
DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent work in this area has focused on author stylized rewriting but is limited by the lack of explicit control of target attributes and being data-driven. |
| Approach: | They propose a Director-Generator framework to rewrite input text in the target author’s style, specifically focusing on certain target attributes. |
| Outcome: | The proposed framework has better meaning retention and results in more fluent generations on a small corpus of text authored by three distinct authors. |
Demographic-Aware Language Model Fine-tuning as a Bias Mitigation Technique (2022.aacl-short)
Copied to clipboard
| Challenge: | In this paper, we analyze the variations in gender and racial biases in BERT-like language models when exposed to different demographic groups. |
| Approach: | They analyze gender and racial biases in BERT-like language models when exposed to different demographic groups. |
| Outcome: | The proposed model can mitigate biases in text authored by disadvantaged demographic groups compared to advantaged groups . the proposed model is agnostic to the language of the speakers behind the language . |
ClauseRec: A Clause Recommendation Framework for AI-aided Contract Authoring (2021.emnlp-main)
Copied to clipboard
| Challenge: | Contracts are a common type of legal document that frequent in business workflows, but there has been limited NLP research in understanding and generating them. |
| Approach: | They propose a task of clause recommendation to help automate contract authoring . they first predict if a specific clause type is relevant to be added in a contract . then they propose two-staged pipeline to recommend top clauses based on the contract context . |
| Outcome: | The proposed pipeline predicts if a clause type is relevant to be added in a contract and recommends the top clauses for the given type based on the contract context. |
Moneyball with LLMs: Analyzing Tabular Summarization in Sports Narratives (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language model (LLM) approaches to tabular summarization rely on prompt engineering, decomposition pipelines, or entity-level intermediate representations to achieve strong performance. |
| Approach: | They propose a diagnostic benchmark for long-context tabular summarization using decomposition pipelines and entity-level intermediate representations. |
| Outcome: | The proposed benchmark improves accuracy and numerical fidelity, but lacks local arithmetic. |
What to Read in a Contract? Party-Specific Summarization of Legal Obligations, Entitlements, and Prohibitions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that generate section-wise summaries of contracts can be tedious due to length and complexity of legalese. |
| Approach: | They propose a task of party-specific extractive summarization for legal contracts . they train a pairwise importance ranker and propose incorporating domain-specific notions of importance . |
| Outcome: | The proposed system generates a party-specific contract summary using a dataset of lease agreements and lease agreements. |
Agent-Specific Deontic Modality Detection in Legal Language (2022.emnlp-main)
Copied to clipboard
| Challenge: | a contract is a legal document executed by two or more parties. |
| Approach: | They propose a corpus of English contracts annotated with deontic modalities . they benchmark this corpus on agent-specific deontics and trigger span detection . |
| Outcome: | The proposed dataset can detect red flags with high recall. |
RADAR: A Reasoning-Guided Attribution Framework for Explainable Visual Data Analysis (2026.findings-eacl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) provide no visibility into which parts of visual data informed their conclusions. |
| Approach: | They propose a semi-automatic approach to attribute reasoning process by highlighting regions in charts and graphs that justify model answers. |
| Outcome: | The proposed method improves attribution accuracy by up to 15 percentage points compared to baseline methods and achieves high semantic similarity with ground truth responses. |
An Answer is just the Start: Related Insight Generation for Open-Ended Document-Grounded QA (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing QA benchmarks do not explicitly support document-grounded related insight generation . Existing document-based QA efforts focus on answering fact-based questions . |
| Approach: | They propose a task to generate additional insights from a document collection that improves, extends or rethinks an initial answer to an open-ended question. |
| Outcome: | The proposed task improves, extends, or rethinks an answer to an open-ended question. |