| Challenge: | Primary experimental articles provide the crucial raw material for all subsequent scientific research, but the growing number of scientific literature makes it difficult for domain experts to efficiently utilize them. |
| Approach: | They propose to automatically extract text fragments from primary research papers that describe the evidence presented in that paper's figures and to use them to build models of scientific argument. |
| Outcome: | The proposed method is able to extract text fragments from primary research papers that describe the evidence presented in that paper's figures, and it is transferable to new datasets. |
Similar Papers
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology (2024.findings-eacl)
Copied to clipboard
| Challenge: | Scholarly communication in the digital age is facing significant challenges due to the overwhelming volume of publications. |
| Approach: | They propose to use Wikipedia infoboxes and structured Amazon product descriptions to create structured scholarly contribution summaries using text generation capabilities of LLMs. |
| Outcome: | The proposed model can be applied to complex IE tasks within terse domains like Science with 1000x fewer parameters than the state-of-the-art GPT-davinci. |
Query-driven Document-level Scientific Evidence Extraction from Biomedical Studies (2025.acl-long)
Copied to clipboard
Massimiliano Pronesti, Joao H Bettencourt-Silva, Paul Flanagan, Alessandra Pascale, Oisín Redmond, Anya Belz, Yufang Hou
| Challenge: | Systematic reviews are widely regarded as the gold standard in evidence-based medicine, heavily influencing medical decisions made by doctors, health authorities, and patients. |
| Approach: | They propose a retrieval-augmented generation framework to tackle the unique challenges of evidence extraction by leveraging forest plots from Cochrane systematic reviews. |
| Outcome: | The proposed framework outperforms existing methods by up to 10.3% in the F1 score on this task. |
A Dataset of Argumentative Dialogues on Scientific Papers (2023.acl-long)
Copied to clipboard
| Challenge: | Recent advances in question-answering models have made them a great asset in accessing the content of scientific papers. |
| Approach: | They propose to use a dataset of 41 argumentative dialogues between scientists on 20 NLP papers to improve and evaluate their question-answering models. |
| Outcome: | The proposed dataset includes both exploratory and argumentative questions and answers in a dialogue discourse on a scientific paper. |
CitationIE: Leveraging the Citation Graph for Scientific Information Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work on scientific information extraction (SciIE) considers extraction solely based on the content of an individual paper, without considering the paper’s place in the broader literature. |
| Approach: | They propose to automate the extraction of key information from scientific documents by leveraging a complementary source: the citation graph of referential links between citing and cited papers. |
| Outcome: | The proposed model improves on a set of English-language scientific documents. |
TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent efforts to extract tasks, datasets and evaluation metrics from scientific literature focus on abstracts only. |
| Approach: | They propose a corpus that contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
| Outcome: | The proposed corpus contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
Text-to-Text Extraction and Verbalization of Biomedical Event Graphs (2022.coling-1)
Copied to clipboard
| Challenge: | Biomedical events represent complex, graphical, and semantically rich interactions expressed in the scientific literature. |
| Approach: | They propose a framework to solve event extraction and event verbalization with a unified text-to-text approach. |
| Outcome: | The proposed framework achieves greater state-of-the-art performance than single-task competitors and can generate coherent natural language utterances from structured data. |
Fine-grained Information Extraction from Biomedical Literature based on Knowledge-enriched Abstract Meaning Representation (2021.acl-long)
Copied to clipboard
| Challenge: | Compared with general natural language texts, sentences from scientific papers usually possess wider contexts between knowledge elements. |
| Approach: | They propose a novel biomedical Information Extraction model to extract scientific entities and events from English research papers using Abstract Meaning Representation (AMR) they construct a sentence-level knowledge graph from an external knowledge base and encode it to improve the model's understanding of complex scientific concepts. |
| Outcome: | The proposed model can extract scientific entities and events from scientific literature and improve its understanding of complex scientific concepts. |
SciDTB: Discourse Dependency TreeBank for Scientific Abstracts (P18-2)
Copied to clipboard
| Challenge: | Discourse relations are annotated on scientific articles. |
| Approach: | They propose a domain-specific discourse treebank annotated on scientific articles . they use dependency trees to represent discourse structure, which is flexible and simplified . |
| Outcome: | The proposed treebank is a benchmark for evaluating discourse dependency parsers. |
Enhancing Scientific Document Summarization with Research Community Perspective and Background Knowledge (2024.lrec-main)
Copied to clipboard
| Challenge: | Scientific paper summarization is the focus of recent research . prevailing summarizing methods involve selective extraction of content from abstract, introduction, and conclusion segments within the target articles. |
| Approach: | They propose a model that incorporates references and citations to capture the impact of the document on the research community. |
| Outcome: | The proposed model generates extractive and abstractive summaries in parallel and improves their performance when considering the standard metrics. |
Evaluating Unsupervised Argument Aligners via Generation of Conclusions of Structured Scientific Abstracts (2024.eacl-short)
Copied to clipboard
| Challenge: | Scientific abstracts provide a concise summary of research findings. |
| Approach: | They evaluate unsupervised approaches for extracting scientific arguments as aligned premise-conclusion pairs . they find mutual information outperforms other measures on this task . |
| Outcome: | The proposed methods outperform language models on the task of extracting scientific arguments from abstracts. |