| Challenge: | a dataset of 1.2 million documents converted from the original submissions is available for supervised learning. |
| Approach: | They propose a new classification task for scientific statements and a large-scale dataset for supervised learning. |
| Outcome: | The proposed task achieves a 0.91 F1 score and a lexeme serialization for mathematical formulas. |
Similar Papers
Datasets for Scientific Literature Understanding: A Survey (2026.findings-acl)
Copied to clipboard
| Challenge: | Empowering machines to understand scientific literature is crucial for accelerating scientific discovery and advancing the AI for Science paradigm. |
| Approach: | They propose a systematic taxonomy that organizes resources spanning structural understanding, text understanding, multimodal understanding and pre-training/instruction fine-tuning. |
| Outcome: | The proposed taxonomy organizes resources spanning structural understanding, text understanding, multimodal understanding and pre-training/instruction fine-tuning. |
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology (2024.findings-eacl)
Copied to clipboard
| Challenge: | Scholarly communication in the digital age is facing significant challenges due to the overwhelming volume of publications. |
| Approach: | They propose to use Wikipedia infoboxes and structured Amazon product descriptions to create structured scholarly contribution summaries using text generation capabilities of LLMs. |
| Outcome: | The proposed model can be applied to complex IE tasks within terse domains like Science with 1000x fewer parameters than the state-of-the-art GPT-davinci. |
A High-Quality Gold Standard for Citation-based Tasks (L18-1)
Copied to clipboard
| Challenge: | Citation recommendation tasks involve recommending citations within their specific contexts. |
| Approach: | They propose to use arXiv.org's citation-dependent evaluation data set to evaluate citations . their data set is characterized by the fact that it exhibits almost zero noise in its extracted content . |
| Outcome: | The proposed data set exhibits almost zero noise in extracted content and all citations are linked to their correct publications. |
TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent efforts to extract tasks, datasets and evaluation metrics from scientific literature focus on abstracts only. |
| Approach: | They propose a corpus that contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
| Outcome: | The proposed corpus contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing paraphrase datasets are mainly from news, novels, or social media platforms. |
| Approach: | They propose to build a large-scale paraphrase dataset using intra-paper and inter-paper methods . they use PDBERT as a general paraphrase discovering method to take advantage of paraphrased sentences . |
| Outcome: | The proposed dataset includes 33,981 paraphrase pairs from ACL and 316,063 pairs from arXiv . the major advantages of paraphrases lie in the prominent length and textual diversity . |
SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Scientific information extraction (SciIE) is critical for converting unstructured knowledge from scholarly articles into structured data. |
| Approach: | They propose to use a scientific entity and relation extraction dataset to capture interactions between entities in full texts. |
| Outcome: | The proposed dataset captures the intricate use and interactions among entities in full texts and provides an out-of-distribution test set to offer a more realistic evaluation. |
SciBERT: A Pretrained Language Model for Scientific Text (D19-1)
Copied to clipboard
| Challenge: | SciBERT is a pretrained language model based on BERT to improve performance on scientific NLP tasks. |
| Approach: | They propose a pretrained language model based on BERT to improve NLP performance . they evaluate on sequence tagging, sentence classification and dependency parsing . |
| Outcome: | The proposed model improves on sequence tagging, sentence classification and dependency parsing tasks with datasets from a variety of scientific domains. |
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing surveys on scientific LLMs focus on one or two fields or a single modality. |
| Approach: | They survey 260 scientific LLMs and examine their architectures and pre-training techniques . they also discuss commonalities and differences between LLM architectures . |
| Outcome: | The proposed model architectures and evaluation techniques are used to improve scientific discovery. |
Investigating the Role of Argumentation in the Rhetorical Analysis of Scientific Publications with Neural Multi-Task Learning Models (D18-1)
Copied to clipboard
| Challenge: | Scientific publications are argumentative and often adhere to well-trodden rhetorical patterns and argumentation schemes. |
| Approach: | They investigate the link between scientific publications and rhetorical aspects such as discourse categories or citation contexts by coupling rhetorical classifiers with extraction of argumentative components. |
| Outcome: | The proposed models show significant performance gains for different rhetorical analysis tasks. |
CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervision (2022.emnlp-main)
Copied to clipboard
| Challenge: | Scientific extreme summarization (TLDR) aims to form ultra-short summaries of scientific papers . previous attempts failed to scale up due to heavy human annotation and domain expertise . |
| Approach: | They propose a method to automatically extract TLDR summaries from scientific papers . they propose 'citeSum' with no human annotation, which is 30 times larger than SciTLDR . |
| Outcome: | The proposed approach outperforms most fully-supervised methods on SciTLDR without fine-tuning and achieves state-of-the-art results with only 128 examples. |