| Challenge: | Existing corpora for dataset mention detection are limited in size and naming diversity. |
| Approach: | They propose a dataset for dataset mention detection that is the largest publicly available corpus for this task. |
| Outcome: | The proposed dataset is the largest publicly available corpus for dataset mention detection . it identifies open problems in dataset mention recognition and linking . |
Similar Papers
SciDMT: A Large-Scale Corpus for Detecting Scientific Mentions (2024.lrec-main)
Copied to clipboard
| Challenge: | SciDMT is an enhanced and expanded corpus for scientific mention detection . existing corpora are limited by their small volume and entity linking capabilities . |
| Approach: | They propose to enhance SciDMT, an annotated scientific corpus for scientific mention detection. |
| Outcome: | The proposed corpus is the largest for scientific entity mention detection . it is based on deep learning architectures like SciBERT and GPT-3.5 . |
A Distant Supervision Corpus for Extracting Biomedical Relationships Between Chemicals, Diseases and Genes (2022.lrec-1)
Copied to clipboard
| Challenge: | Biomedical researchers have used manual curation to extract biomedical interactions from research texts to improve coverage. |
| Approach: | They propose a new dataset for training and evaluating multi-class multi-label biomedical relation extraction models using human annotations and the CTD database. |
| Outcome: | The proposed dataset is substantially larger and cleaner than existing datasets and includes annotations linking mentions to their entities. |
D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Research (2022.lrec-1)
Copied to clipboard
| Challenge: | DBLP is the largest open-access repository of scientific articles on computer science and provides metadata associated with publications, authors, and venues. |
| Approach: | They extracted metadata from more than 6 million DBLP publications to create the DB3 Discovery Dataset (D3) . they found that computer science is a growing research field (15% annually), with an active and collaborative researcher community. |
| Outcome: | The DBLP Discovery Dataset (D3) can be used to identify trends in research activity, productivity, focus, bias, accessibility, and impact of computer science research. |
Recognizing Complex Entity Mentions: A Review and Future Directions (P18-3)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task of identifying and classifying named entities (NE) within text. |
| Approach: | They review existing methods for identifying and classifying named entities within text . they identify the research gap and propose a new approach to tackle these problems . |
| Outcome: | The proposed methods address the identified identified gaps in the literature and provide recommendations for future work. |
Beyond Metadata: What Paper Authors Say About Corpora They Use (2021.findings-acl)
Copied to clipboard
| Challenge: | Currently, dataset retrieval relies almost exclusively on metadata provided by the publishers. |
| Approach: | They propose to use metadata to extract review statements from scientific publications . they argue that a crucial piece of information is missing to inform the examination of search results . |
| Outcome: | The proposed analysis is the first of its kind in the field of Natural Language Processing. |
SumPubMed: Summarization Dataset of PubMed Scientific Articles (2021.acl-srw)
Copied to clipboard
| Challenge: | Existing summarization models that can extract the top few lines of news articles fail to summarize long documents. |
| Approach: | They constructed a scientific summarization dataset from MEDLINE articles from the PubMed archive to address this problem. |
| Outcome: | The proposed model outperforms existing models on news article summarization datasets and shows that it is more efficient to extract the top few lines. |
Towards a Gold Standard Corpus for Variable Detection and Linking in Social Science Publications (L18-1)
Copied to clipboard
| Challenge: | a new corpus for detecting and linking survey variables is being developed . the corpus is multilingual and includes manually curated word and phrase alignments . |
| Approach: | They propose to create a corpus for the evaluation of detecting and linking survey variables in social science publications. |
| Outcome: | The proposed corpus is the first gold standard for the variable detection and linking task. |
DocRED: A Large-Scale Document-Level Relation Extraction Dataset (P19-1)
Copied to clipboard
Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun
| Challenge: | Existing relation extraction methods focus on extracting intra-sentence relations for single entities. |
| Approach: | They propose a relation extraction dataset from Wikipedia and Wikidata with three features . document-level relation extraction is a task to identify relational facts between entities . |
| Outcome: | The proposed dataset is the largest human-annotated dataset for document-level RE from plain text. |
MS-Mentions: Consistently Annotating Entity Mentions in Materials Science Procedural Text (2021.emnlp-main)
Copied to clipboard
Tim O’Gorman, Zach Jensen, Sheshera Mysore, Kevin Huang, Rubayyat Mahbub, Elsa Olivetti, Andrew McCallum
| Challenge: | Material science synthesis procedures require high-quality annotations, which are limited by the size and quality of the annotations. |
| Approach: | They propose a corpus of entity mention annotations over 595 Material Science synthesis procedures. |
| Outcome: | The proposed approach greatly expands the training data available for the Named Entity Recognition task. |
NovelCR: A Large-Scale Bilingual Dataset Tailored for Long-Span Coreference Resolution (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing coreference resolution datasets are either small in scale or restrict coreference to a limited text span. |
| Approach: | They present a large-scale bilingual benchmark for long-span coreference resolution . they find that NovelCR is notably rich in long-spanning coreference pairs . |
| Outcome: | The proposed benchmark is rich in long-span coreference pairs and notably low baselines. |