Ensuring Readability and Data-fidelity using Head-modifier Templates in Deep Type Description Generation (P19-1)
Copied to clipboard
| Challenge: | Existing generative methods overlook grammatical structure or make factual mistakes in generated texts. |
| Approach: | They propose a template-based method to ensure the readability of generated type descriptions . they also propose measurable metrics to measure the readibility of the generated type description . |
| Outcome: | The proposed method improves substantially compared with baselines and achieves state-of-the-art performance on both datasets. |
Similar Papers
ENT-DESC: Entity Description Generation by Exploring Knowledge Graph (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for knowledge-to-text generation use RDF triples or key-value pairs to generate a natural language description. |
| Approach: | They propose a large-scale dataset to facilitate the study of KG-to-text . they propose MGCN model architecture that incorporates aggregation methods to extract the rich graph information. |
| Outcome: | The proposed model can represent the original graph information more comprehensively and integrates multiple aggregation methods to extract the rich graph information. |
Interpretable Entity Representations through Large-Scale Typing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | In traditional methods for natural language processing, entities are embedded in dense vector spaces with pre-trained models. |
| Approach: | They propose an approach to creating entity representations that are human readable and achieve high performance on entity-related tasks out of the box. |
| Outcome: | The proposed representations are vectors whose values correspond to posterior probabilities over fine-grained entity types, indicating the confidence of a typing model’s decision that the entity belongs to the corresponding type. |
Synthetic Data in the Era of Large Language Models (2025.acl-tutorials)
Copied to clipboard
| Challenge: | 'synthetic data' is a data generated with the assistance of large language models to make dataset construction faster and cheaper. |
| Approach: | This tutorial seeks to build a shared understanding of recent progress in synthetic data generation from NLP and related fields by grouping and describing major methods, applications, and open problems. |
| Outcome: | This tutorial will describe methods, applications, and open problems that have been developed and are being used to improve the quality and efficiency of synthetic data generation. |
Knowledge-Enriched Natural Language Generation (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Knowledge-enriched text generation poses unique challenges in modeling and learning . a roadmap will outline the state-of-the-art methods to tackle these challenges . |
| Approach: | They propose a roadmap to tackle the challenges of knowledge-enriched text generation . they will dive deep into various technical components to illustrate how to represent knowledge . |
| Outcome: | This tutorial outlines the state-of-the-art methods to tackle the problem . it aims to show how to represent knowledge, feed knowledge into a generation model, evaluate results . |
DESCGEN: A Distantly Supervised Datasetfor Generating Entity Descriptions (2021.acl-long)
Copied to clipboard
| Challenge: | Short textual descriptions of entities provide summaries of their key attributes but generating entity descriptions can be challenging since information is scattered across multiple sources with varied content and style. |
| Approach: | They propose to generate an entity summary description from 37K entities from Wikipedia and Fandom, paired with nine evidence documents on average. |
| Outcome: | The proposed task is entity-centric, more abstractive, and covers a wide range of domains. |
Ultra-Fine Entity Typing (P18-1)
Copied to clipboard
| Challenge: | Experimental results show that a model that can predict ultra-fine types can be crowd-sourced . head words indicate the type of the noun phrases they appear in, and are important for context-sensitive tasks . |
| Approach: | They propose a task where sentences are given with an entity mention . they introduce a new type of distant supervision: head words, which indicate the type of noun phrases they appear in. |
| Outcome: | The proposed model can predict ultra-fine types at varying granularity and performs well on a fine-grained entity typing benchmark. |
Attributed and Predictive Entity Embedding for Fine-Grained Entity Typing in Knowledge Bases (C18-1)
Copied to clipboard
| Challenge: | Existing methods for identifying semantic type of entities are incomplete even in large knowledge bases. |
| Approach: | They propose an attributed and predictive entity embedding method which can fully utilize various kinds of information comprehensively. |
| Outcome: | Experiments on two real DBpedia datasets show that the proposed method outperforms 8 state-of-the-art methods with 4.0% improvement in Mi-F1 and 5.2% improvement in Ma-F1. |
Metadata Shaping: A Simple Approach for Knowledge-Enhanced Language Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to capture entity knowledge with factual knowledge are limited . despite its simplicity, metadata shaping is quite effective . |
| Approach: | They propose a method which inserts substrings corresponding to readily available entity metadata into examples at train and inference time based on mutual information. |
| Outcome: | The proposed method exceeds the baseline model by 4.3 F1 points and achieves state-of-the-art results. |
Storytelling from Structured Data and Knowledge Graphs : An NLG Perspective (P19-4)
Copied to clipboard
| Challenge: | tutorial aims to explain the basic concepts of translating structured data into natural language . Various solutions for structured data translation will be discussed . |
| Approach: | tutorial aims to cover foundational, methodological, and system development aspects of translating structured data into natural language . Various solutions starting from traditional rule based/heuristic driven and modern data-driven will be discussed . |
| Outcome: | The tutorial aims to convey challenges and nuances in structured data translation, data representation techniques, and domain adaptable solutions for translation of the data into natural language form. |
Instilling Type Knowledge in Language Models via Multi-Task QA (2022.findings-naacl)
Copied to clipboard
| Challenge: | Current methods to learn entity types rely on coarse, noisy labels . current methods rely only on text-to-text pre-training on type-centric questions . |
| Approach: | They propose to instill fine-grained type knowledge in language models by pre-training on type-centric questions. |
| Outcome: | The proposed model achieves state-of-the-art in zero-shot dialog state tracking benchmarks and can accurately infer entity types in Wikipedia articles. |