Papers by Aakanksha Naik
Intent-aware Schema Generation and Refinement for Literature Review Tables (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ambiguity in reference-based evaluations and lack of editing/refinement methods have slow progress on schema generation. |
| Approach: | They propose a method for augmenting unannotated table corpora with synthesized intents . they propose prompted workflows and fine-tuned models to improve schema generation . |
| Outcome: | The proposed approach significantly improves baseline performance in reconstructing reference schemas. |
CHIME: LLM-Assisted Hierarchical Organization of Scientific Studies for Literature Review Support (2024.findings-acl)
Copied to clipboard
Chao-Chun Hsu, Erin Bransom, Jenna Sparks, Bailey Kuehl, Chenhao Tan, David Wadden, Lucy Wang, Aakanksha Naik
| Challenge: | Literature review requires researchers to synthesize a large amount of information. |
| Approach: | They propose to use LLMs to generate hierarchical organizations from a set of studies . they use a human-in-the-loop process to correct errors in LLM-generated hierarchies . |
| Outcome: | The proposed model improves assignment of studies to categories by 12.6 F1 points. |
CARE: Extracting Experimental Findings From Clinical Literature (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing annotation schemas and datasets fail to capture real-world complexity and nuance of experimental findings. |
| Approach: | They propose a new annotation schema capturing fine-grained findings as n-ary relations between entities and attributes. |
| Outcome: | The proposed schema captures fine-grained findings as n-ary relations between entities and attributes. |
Ai2 Scholar QA: Organized Literature Synthesis with Attribution (2025.acl-demo)
Copied to clipboard
Amanpreet Singh, Joseph Chee Chang, Dany Haddad, Aakanksha Naik, Jena D. Hwang, Rodney Kinney, Daniel S Weld, Doug Downey, Sergey Feldman
| Challenge: | Ai2 Scholar QA is a free online scientific question answering application . it uses retrieval-augmented generation to answer complex scientific questions . many of these systems are expensive to use and closed-source . |
| Approach: | They propose a retrieval-augmented generation-based scientific question answering application . it uses a Python package and an interactive web app to make the entire pipeline public . they compare it with other similar question-answering applications . |
| Outcome: | The proposed system outperforms other systems on a recent scientific QA benchmark. |
On-the-fly Definition Augmentation of LLMs for Biomedical NER (2024.naacl-long)
Copied to clipboard
| Challenge: | Despite their general capabilities, LLMs struggle on biomedicalNER tasks due to specialized terminology and lack of training data. |
| Approach: | They propose a new knowledge augmentation approach which incorporates definitions of relevant concepts on-the-fly. |
| Outcome: | The proposed approach improves performance on biomedicalNER tasks by 15% (on average) The proposed method outperforms fine-tuned language models in few-shot settings. |
Literature-Augmented Clinical Outcome Prediction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to clinical outcome prediction use only clinical notes and general biomedical literature. |
| Approach: | They propose to retrieve patient-specific medical literature and incorporate it into predictive models by combining clinical notes with language models. |
| Outcome: | The proposed approach boosts predictive performance on three important clinical tasks in comparison to strong LM baselines, increasing F1 by up to 5 points and precision@Top-K by a large margin of over 25%. |
Exploring Numeracy in Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing word embeddings are inadequate at capturing numerical properties of numbers. |
| Approach: | They propose to use word embeddings to capture numerical properties of numbers . they hope to develop methods which better capture numeric properties . |
| Outcome: | The proposed models lack the ability to capture numeric properties of numbers, the authors show . their findings provide a starting point for the development of better models . |
S2abEL: A Dataset for Entity Linking from Scientific Tables (2023.emnlp-main)
Copied to clipboard
| Challenge: | Entity linking (EL) is a longstanding problem in natural language processing and information extraction. |
| Approach: | They propose a neural baseline method for EL on scientific tables containing many out-of-knowledge-base mentions and a method that significantly outperforms a generic table EL method. |
| Outcome: | The proposed method significantly outperforms state-of-the-art generic table EL method on scientific tables with many out-of knowledge-base mentions. |
Language Models Don’t Know What You Want: Evaluating Personalization in Deep Research Needs Real Users (2026.acl-long)
Copied to clipboard
Nishant Balepur, Malachi Hamada, Varsha Kishore, Sergey Feldman, Amanpreet Singh, Pao Siangliulue, Joseph Chee Chang, Eunsol Choi, Jordan Lee Boyd-Graber, Aakanksha Naik
| Challenge: | Earlier research used real users to push personalization, but easy-to-use judges have been criticized for not adopting online studies. |
| Approach: | They propose a personalized action-following tool that infers a user's research interests and proposes personalized actions for a query. |
| Outcome: | The proposed tool beats baselines in citation metrics and personalized action-following with an online version of MySQA. |
Towards Open Domain Event Trigger Identification using Adversarial Domain Adaptation (2020.acl-main)
Copied to clipboard
| Challenge: | supervised event trigger identification models can generalize better across domains . prior work focused on annotating specific categories of events or narratives from specific domains. |
| Approach: | They propose to use adversarial domain adaptation framework to build supervised event trigger identification models which can generalize better across domains. |
| Outcome: | The proposed model improves on literature and news domains with no labeled data. |
Stress Test Evaluation for Natural Language Inference (C18-1)
Copied to clipboard
| Challenge: | Existing models perform well at standard datasets for NLI, achieving impressive results across different genres of text. |
| Approach: | They propose to use automatic stress tests to evaluate models' ability to make inferential decisions. |
| Outcome: | The proposed model performs well across genres of text, but lacks the ability to make inferential decisions. |
ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language Models (2024.emnlp-main)
Copied to clipboard
Benjamin Newman, Yoonjoo Lee, Aakanksha Naik, Pao Siangliulue, Raymond Fok, Juho Kim, Daniel Weld, Joseph Chee Chang, Kyle Lo
| Challenge: | Using language models (LMs) can generate literature review tables by decomposing it into separate schema and value generation steps. |
| Approach: | They propose a framework that leverages language models to perform literature review table generation by decomposing it into separate schema and value generation steps. |
| Outcome: | The proposed framework decomposes the task into two sub-tasks: schema generation and value generation. |
Adapting Event Extractors to Medical Data: Bridging the Covariate Shift (2021.eacl-main)
Copied to clipboard
| Challenge: | a new study examines the performance of event extractors to new domains without labeled data . event extraction is a key sub-task of interest for text understanding pipelines in multiple domains . |
| Approach: | They propose to align marginal distributions of source and target domains to adapt event extractors to new domains . they use clinical notes and doctor-patient conversations as a testbed . |
| Outcome: | The proposed models reach F1 scores of 70.0 and 72.9 on notes and conversations respectively. |
SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature (2025.emnlp-main)
Copied to clipboard
David Wadden, Kejian Shi, Jacob Morrison, Alan Li, Aakanksha Naik, Shruti Singh, Nitzan Barzilay, Kyle Lo, Tom Hope, Luca Soldaini, Shannon Zejiang Shen, Doug Downey, Hannaneh Hajishirzi, Arman Cohan
| Challenge: | ScIRIFF is the only entirely expert-written instruction-following dataset for scientific literature understanding . it features complex instructions with long input contexts, detailed task descriptions, and structured outputs. |
| Approach: | They present a dataset of 137K instruction-following instances for training and evaluation . they finetuned large language models using a mix of general domain and ScIRIFF instructions . |
| Outcome: | The proposed dataset shows that on nine out-of-distribution held-out tasks, the model performs better than baselines trained on general domain instructions. |
Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks (2022.tacl-1)
Copied to clipboard
| Challenge: | Natural language understanding (NLU) has made massive progress driven by large benchmarks, but a long tail of infrequent phenomena is underrepresented. |
| Approach: | They conceptualize the long tail using macro-level dimensions and perform a meta-analysis of 100 representative papers on transfer learning for NLU. |
| Outcome: | The results highlight avenues for future research in transfer learning for the long tail . authors suggest that the results may be useful for future studies . |