MyFixit: An Annotated Dataset, Annotation Tool, and Baseline Methods for Information Extraction from Repair Manuals (2020.lrec-1)
Copied to clipboard
| Challenge: | Textual instructions are among the most widely used media for learning and teaching . however, to create autonomous systems, it is difficult to extract task knowledge from text . |
| Approach: | They propose methods that can extract information from repair manuals from a semi-structured dataset . they propose a bag-of-n-grams similarity method and deep-learning-based sequence labeling model . |
| Outcome: | The proposed methods can extract the needed tools and disassembled parts from repair manuals. |
Similar Papers
Instruct and Extract: Instruction Tuning for On-Demand Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models with instruction-following capabilities are not suitable for long-tail ad hoc extraction use cases for non-expert users. |
| Approach: | They propose a task that follows instructions to extract the desired content from the associated text and present it in a structured tabular format. |
| Outcome: | The proposed paradigm outperforms existing open-source models of similar size in terms of information extraction. |
New Frontiers of Information Extraction (2022.naacl-tutorials)
Copied to clipboard
| Challenge: | Information extraction (IE) is the process of automatically extracting structural information from unstructured or semi-structured data. |
| Approach: | This tutorial will provide an introduction to recent advances in IE by answering several important research questions. |
| Outcome: | The tutorial will address several important research questions and outline directions for further investigation. |
LLM-driven Instruction Following: Progresses and Concerns (2023.emnlp-tutorial)
Copied to clipboard
| Challenge: | a tutorial on task instruction is aimed at researchers and practitioners interested in NLP generalization . labeled examples are unlikely to be available in large numbers or do not exist . |
| Approach: | This tutorial will examine the progress of natural language processing (NLP) using labeled examples. authors propose that task instructions act as a novel resource for supervision. |
| Outcome: | This tutorial aims to answer questions about instruction-driven NLP . it focuses on the use of task instructions in a low-shot scenario . |
MaintIE: A Fine-Grained Annotation Schema and Benchmark for Information Extraction from Maintenance Short Texts (2024.lrec-main)
Copied to clipboard
| Challenge: | Maintenance short texts (MSTs) provide crucial insights into the state and maintenance activities of machines, infrastructure, and other engineered assets. |
| Approach: | They propose a multi-level fine-grained annotation scheme for entity recognition and relation extraction that includes 5 top-level classes and 6 relations tailored to MSTs. |
| Outcome: | The proposed scheme provides high-quality, fine-grained annotations and a coarse-grain corpus of 7,000 texts. |
Towards Machine Reading for Interventions from Humanitarian-Assistance Program Literature (D19-1)
Copied to clipboard
| Challenge: | a complex socio-political system is causing problems such as food insecurity . a first step is to extract past interventions and when and where they have been applied . |
| Approach: | They develop an automatic extraction system to extract past interventions from texts . they analyze a corpus annotated with interventions to foster research . |
| Outcome: | The proposed system extracts past interventions and when and where they have been applied from text . it shows early, encouraging results on extracting interventions . |
SkillSpan: Hard and Soft Skill Extraction from English Job Postings (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies on Skill Extraction (SE) use crowd-sourced labels or annotations from a predefined skill inventory. |
| Approach: | They propose a dataset that contains 14.5K sentences and over 12.5K annotated spans. |
| Outcome: | The proposed model outperforms non-adapted models and single-task outperformed multi-task learning. |
A guide to the dataset explosion in QA, NLI, and commonsense reasoning (2020.coling-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide an up-to-date guide to the recent datasets . the target audience is the NLP practitioners who are lost in dozens of the recent data sets. |
| Approach: | This tutorial provides an up-to-date guide to the recent datasets . it surveys old and new methodological issues with dataset construction . |
| Outcome: | This tutorial aims to provide an up-to-date guide to the recent datasets . it surveys the old and new methodological issues with dataset construction . |
SciREX: A Challenge Dataset for Document-Level Information Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Conventional datasets and methods for information extraction focus on within-sentence relations from general Newswire text. |
| Approach: | They propose a document-level IE dataset that integrates automatic and human annotations to annotate entities and document- level N-ary relation identification from scientific articles. |
| Outcome: | The proposed dataset extends state-of-the-art IE models to document-level IE. |
tasksource: A Large Collection of NLP tasks with a Structured Dataset Preprocessing Framework (2024.lrec-main)
Copied to clipboard
| Challenge: | Several initiatives release harmonized datasets or provide harmonization codes to preprocess datasets into a consistent format. |
| Approach: | They propose an annotation framework that enables concise, readable, and reusable annotations. |
| Outcome: | The proposed framework outperforms all publicly available text encoders on all tasks. |
PAGED: A Benchmark for Procedural Graphs Extraction from Documents (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for extraction of procedural graphs from documents are not solving the task well. |
| Approach: | They propose a benchmark to test automatic extraction of procedural graphs from documents . they involve three advanced large language models and enhance them with a novel self-refine strategy . |
| Outcome: | The proposed benchmark systematically examines the progress of current methods and explores the potential of emerging large language models (LLMs) on this task. |