Learning to Map Natural Language Statements into Knowledge Base Representations for Knowledge Base Construction (L18-1)
Copied to clipboard
| Challenge: | Currently, the construction and updating of knowledge bases rely on human labor. |
| Approach: | They propose to map relational phrases in triples from natural language to knowledge base predicate format. |
| Outcome: | The proposed mapping results show high quality and promising coverage on relational phrases compared to previous research. |
Similar Papers
Learning Reasoning Patterns for Relational Triple Extraction with Mutual Generation of Text and Graph (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focused on learning text patterns from explicit mentions but failed to extract the implicitly implied triples. |
| Approach: | They propose to construct a relational graph from a sentence and apply multi-layer graph convolutions to capture the type inference logic of the paths. |
| Outcome: | The proposed framework can find multi-hop reasoning paths and capture type inference logic with the sentence's supplementary relational expressions. |
Knowledge Base Construction for Knowledge-Augmented Text-to-SQL (2025.findings-acl)
Copied to clipboard
Jinheon Baek, Horst Samulowitz, Oktie Hassanzadeh, Dharmashankar Subramanian, Sola Shirai, Alfio Gliozzo, Debarun Bhattacharjya
| Challenge: | Existing approaches to translate natural language queries into SQL statements are limited in their parametric knowledge of the database schemas. |
| Approach: | They propose to construct a knowledge base for text-to-SQL, a foundational source of knowledge, from which we retrieve and generate the necessary knowledge for given queries. |
| Outcome: | The proposed approach outperforms baselines on multiple text-to-SQL datasets and shows that it is practical and reliable. |
Relational World Knowledge Representation in Contextual Language Models: A Review (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge bases are organized according to manual schemas that limit their expressiveness and require significant human engineering and maintenance. |
| Approach: | They propose to organize knowledge representation strategies in LMs by the level of KB supervision provided . they propose to highlight notable models, evaluation tasks, and findings . |
| Outcome: | The proposed model can internalize and express relational knowledge in more flexible forms. |
Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMs (D18-1)
Copied to clipboard
| Challenge: | a paper addresses the problem of mapping natural language text to knowledge base entities. |
| Approach: | They propose a model for mapping natural language text to knowledge base entities using a multi-dimensional entity space obtained from a knowledge graph. |
| Outcome: | The proposed model is applied to large-scale text-to-entity mapping and entity classification tasks with state-of-the-art results. |
Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Knowledge Bases (KBs) require constant updating to reflect changes to the world they represent. |
| Approach: | They propose a framework that unifies learning of RE and KBE models . the framework is based on a relation extraction task that uses a KB relation to a phrase . |
| Outcome: | The proposed framework unifies learning of RE and KBE models, leading to significant improvements over the state-of-the-art RE framework. |
Knowledge-Enriched Natural Language Generation (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Knowledge-enriched text generation poses unique challenges in modeling and learning . a roadmap will outline the state-of-the-art methods to tackle these challenges . |
| Approach: | They propose a roadmap to tackle the challenges of knowledge-enriched text generation . they will dive deep into various technical components to illustrate how to represent knowledge . |
| Outcome: | This tutorial outlines the state-of-the-art methods to tackle the problem . it aims to show how to represent knowledge, feed knowledge into a generation model, evaluate results . |
ENT-DESC: Entity Description Generation by Exploring Knowledge Graph (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for knowledge-to-text generation use RDF triples or key-value pairs to generate a natural language description. |
| Approach: | They propose a large-scale dataset to facilitate the study of KG-to-text . they propose MGCN model architecture that incorporates aggregation methods to extract the rich graph information. |
| Outcome: | The proposed model can represent the original graph information more comprehensively and integrates multiple aggregation methods to extract the rich graph information. |
Language Models as Knowledge Bases? (D19-1)
Copied to clipboard
Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander Miller
| Challenge: | Recent advances in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. |
| Approach: | They present a method for pretraining language models on large textual corpora . they find that they can store relational knowledge and answer queries structured as "fill-in-the-blank" queries. |
| Outcome: | The proposed language models can recall factual knowledge without fine-tuning without fine tuning . the proposed models can answer queries structured as "fill-in-the-blank" cloze statements . |
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for language model pretraining use limited knowledge graph data for knowledge-intensive tasks. |
| Approach: | They propose to make better use of multilingual annotations and language agnostic properties of KG triples for pretraining LMs. |
| Outcome: | The proposed models show significant performance improvements on a wide range of knowledge-intensive cross-lingual tasks. |
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing work on data-to-text generation focused on domain-specific benchmark datasets. |
| Approach: | They use a KG-Wikipedia text aligned corpus to verbalize the entire English Wikidata KG . they show that this approach can be used to integrate structured KGs and natural language corpora . |
| Outcome: | The proposed method improves on open domain QA and the LAMA knowledge probe. |