Metric-Type Identification for Multi-Level Header Numerical Tables in Scientific Papers (2021.eacl-main)
Copied to clipboard
| Challenge: | Numerical tables are used to present experimental results in scientific papers. |
| Approach: | They propose a task to extract metric-types from multi-level header numerical tables . they propose two joint-learning neural classification and generation schemes . |
| Outcome: | The proposed models handle in-header and out-of-headers metric-type identification problems. |
Similar Papers
Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Construction (P19-1)
Copied to clipboard
| Challenge: | Recent years have witnessed a significant increase in laboratory-based evaluation benchmarks in many scientific disciplines. |
| Approach: | They propose to use NLP datasets to extract task, dataset, metric and score from NLP papers to build automatic leaderboards. |
| Outcome: | The proposed model outperforms baselines in the NLP domain by a large margin. |
Towards Table-to-Text Generation with Numerical Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown improvement in generating descriptive text from structured data. |
| Approach: | They propose a framework for numerical table-to-text generation based on numerical reasoning . they use a pre-trained model and a copy mechanism to fine-tune the models to produce fluent text . |
| Outcome: | The proposed framework lacks fidelity to the table contents and is based on a pre-trained model and a copy mechanism. |
GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models are crucial for academic writing . existing ground truth datasets do not treat fine-grained types like ML model and model architecture as separate entity types . |
| Approach: | They propose to annotate 100 full-text scientific publications and a first baseline model for 10 entity types centered around ML models and datasets. |
| Outcome: | The proposed model can be used to identify 10 entity types in scientific articles . existing models cannot recognize fine-grained models like ML models and model architecture . |
Measurement Extraction with Natural Language Processing: A Review (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Information extraction (IE) is a task in natural language processing that extracts information from documents. |
| Approach: | They describe different approaches to measurement extraction and outline challenges posed by this task. |
| Outcome: | The proposed methods are compared with the literature on the extraction of quantitative data from documents. |
A Novel Table-to-Graph Generation Approach for Document-Level Joint Entity and Relation Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods assume entities and their mentions are given beforehand, which is inadequate for real-world applications. |
| Approach: | They propose a table-to-graph generation model for joint extraction of entities and relations at document-level. |
| Outcome: | The proposed model surpasses existing methods by a large margin and achieves state-of-the-art results on a document-level relation extraction dataset. |
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data (2022.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for numerical reasoning over hybrid data only include a single flat table in each document . |
| Approach: | They propose a new benchmark with QA pairs over multi hierarchical tabular and textual data. |
| Outcome: | The proposed model is more complex and challenging than existing benchmarks and is available on github . it uses facts retrieving to extract relevant facts from both tables and text and symbolic reasoning over retrieved facts. |
A Survey of AMR Applications (2024.emnlp-main)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation that takes the form of a rooted, directed graph. |
| Approach: | They analyze more than 100 papers which use Abstract Meaning Representation (AMR) they highlight the range of applications for which AMR has been harnessed and techniques for incorporating it . they also highlight broader AMR engineering patterns and outline areas of future work that seem ripe for AMR incorporation. |
| Outcome: | The results highlight the range of applications for which AMR has been harnessed and the techniques for incorporating it into those applications. |
Advances in Pre-Training Distributed Word Representations (L18-1)
Copied to clipboard
| Challenge: | Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications. |
| Approach: | They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations. |
| Outcome: | The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data. |
Hierarchical Label Generation for Text Classification (2023.findings-eacl)
Copied to clipboard
| Challenge: | None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document. |
| Approach: | They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy. |
| Outcome: | The proposed method can generate unseen labels in subword level. |
STable: Table Generation Framework for Encoder-Decoder Models (2024.eacl-long)
Copied to clipboard
Michał Pietruszka, Michał Turski, Łukasz Borchmann, Tomasz Dwojak, Gabriela Nowakowska, Karolina Szyndler, Dawid Jurkiewicz, Łukasz Garncarek
| Challenge: | Existing approaches to infer text-to-table neural models are limited to raw text, but the proposed framework is capable of unifying a variety of problems involving natural language. |
| Approach: | They propose a framework for text-to-table neural models that utilizes a generalized sequential method that comprehends information from all cells in the table. |
| Outcome: | The proposed framework outperforms previous approaches on several challenging datasets and outperformed existing models by up to 15%. |