Challenge: Existing factoid question answering systems rely on annotated datasets such as SimpleQuestions to generate questions from knowledge graphs.
Approach: They propose a neural model that generates questions from knowledge graphs triples in a “zero-shot” setup.
Outcome: The proposed model outperforms state-of-the-art on this task.

Similar Papers

Exploring efficient zero-shot synthetic dataset generation for Information Retrieval (2024.findings-eacl)

Copied to clipboard

Challenge: Recent advances in large language models offer a new avenue of generating synthetic training data to train neural retrieval models for unlabelled data collections.
Approach: They propose a method to generate high-quality synthetic datasets using a small language model and a filtering mechanism to ensure the quality of generated questions.
Outcome: The proposed method outperforms unsupervised retrieval methods such as BM25 and pretrained monoT5.
Self-Supervised Knowledge Triplet Learning for Zero-Shot Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Current supervised Question Answering methods rely on expensive data annotations and can introduce unintended annotator bias.
Approach: They propose a self-supervised task over knowledge graphs that can be supervised by a data annotation tool.
Outcome: The proposed task performs better than pre-trained language models on a large dataset.
Generating Questions from Wikidata Triples (2022.lrec-1)

Copied to clipboard

Challenge: Existing methods for question generation from knowledge bases rely on extensive pre- and post-processing of the input triple.
Approach: They revisit KBQG using pre training, a new (triple, question) dataset and taking question type into account and provide a more extended KBqg dataset.
Outcome: The proposed approach outperforms existing methods in a standard and in 'zero-shot' setting.
Few-Shot Data-to-Text Generation via Unified Representation and Multi-Source Learning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for data-to-text generation focus on specific types of structured data.
Approach: They propose a method that provides a unified representation that can handle various forms of structured data such as tables, knowledge graph triples, and meaning representations.
Outcome: The proposed method improves zero-shot and few-shot scenarios and can adapt to new structured data.
Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss (D19-1)

Copied to clipboard

Challenge: Conventional methods for question generation neglect two crucial research issues: 1) the given predicate needs to be expressed; 2) the answer to the generated question needs to have a definitive answer.
Approach: They propose a neural encoder-decoder model with multi-level copy mechanisms to generate questions . they also introduce answer-aware loss to make generated questions correspond to more definitive answers.
Outcome: The proposed model achieves state-of-the-art performance while corresponding to more definitive answers.
Knowledge Generation for Zero-shot Knowledge-based VQA (2024.findings-eacl)

Copied to clipboard

Challenge: Recent knowledge-based visual question answering methods do not explicitly show the knowledge needed to answer the questions and therefore lack interpretability.
Approach: They propose a method which generates knowledge from an LLM and incorporates it into a zero-shot manner.
Outcome: The proposed method performs better than previous zero-shot K-VQA methods on two benchmarks and is generally relevant and helpful.
ZeroGen: Efficient Zero-shot Learning via Dataset Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generate training data with pre-trained language models have been found effective in various scenarios.
Approach: They propose an unsupervised zero-shot learning method that generates a dataset from scratch and trains a tiny task model under supervision of the synthesized dataset.
Outcome: The proposed method is annotated-free and efficient, but can provide useful insights from the perspective of data-free model-agnostic knowledge distillation and unreferenced text generation evaluation.
Neural Pipeline for Zero-Shot Data-to-Text Generation (2022.acl-long)

Copied to clipboard

Challenge: In data-to-text generation, training on in-domain data leads to overfitting and repeating training data noise.
Approach: They propose to train pretrained language models on general-domain text-based operations by transforming single-item descriptions with modules trained on ordering, aggregation, and paragraph compression.
Outcome: The proposed approach enables D2T generation from RDF triples in zero-shot settings.
PathQG: Neural Question Generation from Facts (2020.emnlp-main)

Copied to clipboard

Challenge: Existing research for question generation encodes text as a sequence of tokens without explicitly modeling fact information.
Approach: They propose to incorporate facts in the input text for question generation in a comprehensive way.
Outcome: The proposed model outperforms state-of-the-art models and human evaluation shows it generates relevant and informative questions.
Pre-trained Language Models Can be Fully Zero-Shot Learners (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to pre-trained language models require fine-tuning on labeled datasets or manually constructing proper prompts.
Approach: They propose a nonparametric prompting PLM for fully zero-shot language understanding . they compare it to previous methods for text classification and text entailment .
Outcome: The proposed method outperforms previous methods on diverse tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations