MIR: Methodology Inspiration Retrieval for Scientific Research Problems (2025.acl-long)
Copied to clipboard
Aniketh Garikaparthi, Manasi Patwardhan, Aditya Sanjiv Kanade, Aman Hassan, Lovekesh Vig, Arman Cohan
| Challenge: | Existing methods for generating ideas rely on grounding the discovery process within the literature, but their effectiveness varies significantly with the quality and nature of the retrieved literature. |
| Approach: | They construct a methodological inspiration retrieval task using a citation-based methodology adjacency graph and embed an "intuitive prior'' into dense retrievers. |
| Outcome: | The proposed method achieves significant gains in Recall@3 and mAP over strong baselines. |
Similar Papers
ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition (2026.findings-acl)
Copied to clipboard
Yujie Liu, Zonglin Yang, Tong Xie, Jinjie Ni, Ben Gao, Yuqiang Li, Shixiang Tang, Wanli Ouyang, Erik Cambria, Dongzhan Zhou
| Challenge: | Large language models have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. |
| Approach: | They propose a benchmark for evaluating large language models on a sufficient set of scientific discovery sub-tasks. |
| Outcome: | The proposed framework extracts critical components from papers across 12 disciplines with expert validation confirming its accuracy. |
MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Metadata extraction relies heavily on manual annotation of documents. |
| Approach: | They propose a framework that leverages Large Language Models to automatically extract metadata attributes from scientific papers covering datasets of languages other than Arabic. |
| Outcome: | The proposed framework automates the extraction of metadata attributes from Arabic scientific papers using large language models. |
Literary Evidence Retrieval via Long-Context Language Models (2025.acl-short)
Copied to clipboard
| Challenge: | a recent study shows that long-context language models can exceed human expert performance in literary analysis . despite their speed and apparent accuracy, even the strongest models struggle with nuanced literary signals and overgeneration. |
| Approach: | They propose a task where a model is given an entire text of a book and a literary criticism with a missing quotation from that work and asked to generate the missing quote. |
| Outcome: | The proposed model outperforms open-weight models in literary evidence retrieval tasks. |
RELiC: Retrieving Evidence for Literary Claims (2022.acl-long)
Copied to clipboard
| Challenge: | Literature scholars often provide evidence for claims they make in the form of quotations from a work . a novel evidence retrieval task requires a deep understanding of complex literary phenomena . |
| Approach: | They use a large-scale dataset to formulate a task of literary evidence retrieval . they implement a RoBERTa-based dense passage retriever that outperforms existing methods . |
| Outcome: | The proposed model outperforms pretrained information retrieval baselines, but there is room for improvement. |
An Efficient Retrieval-Based Method for Tabular Prediction with LLM (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for tabular prediction rely on extensive pre-training or fine-tuning of LLMs . a retrieval-based approach eliminates the need for training any modules or performing data augmentation . |
| Approach: | They propose a retrieval-based approach that utilizes the powerful capabilities of large language models in representation, comprehension, and inference. |
| Outcome: | The proposed method exhibits strong predictive performance on tabular prediction task, affirming its practicality and effectiveness. |
MoRI: Learning Motivation-Grounded Reasoning for Scientific Ideation in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs emulate human research workflows but lack scientific grounding . empirical results show that MoRI outperforms strong commercial LLM models . |
| Approach: | They propose a framework that explicitly learns scientific reasoning from research motivations to methodologies. |
| Outcome: | The proposed framework outperforms commercial LLMs and agentic baselines in novelty, technical rigor, and feasibility. |
SciMON: Scientific Inspiration Machines Optimized for Novelty (2024.acl-long)
Copied to clipboard
| Challenge: | Existing literature-based hypothesis generation models focus on binary link prediction, limiting expressivity of hypotheses. |
| Approach: | They propose a framework that uses literature-based hypothesis generation as input . they use literature-derived literature as background and output natural language ideas . |
| Outcome: | The proposed model improves the ability of language models to generate new scientific directions grounded in literature. |
A Survey of Reasoning-Intensive Retrieval: Progress and Challenges (2026.acl-long)
Copied to clipboard
| Challenge: | Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. |
| Approach: | They propose a taxonomy that categorizes methods based on where and how reasoning is integrated into the retrieval pipeline. |
| Outcome: | The proposed method framework provides a detailed analysis of the current landscape and its trade-offs and practical applications. |
LitSearch: A Retrieval Benchmark for Scientific Literature Search (2024.emnlp-main)
Copied to clipboard
| Challenge: | Literature search questions pose significant challenges for modern retrieval systems . a lack of domain expertise and reasoning through lengthy papers is a challenge . |
| Approach: | They propose a retrieval benchmark for literature search queries using inline citations from papers and questions about recently published papers. |
| Outcome: | The proposed retrieval benchmarks outperform state-of-the-art retrieval models and reranking pipelines. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |