I already said that! Degenerating redundant questions in open-domain dialogue systems. (2023.acl-srw)
Copied to clipboard
| Challenge: | Neural text generation models have been successful in short open-domain conversations, but their performance degrades significantly in the long term. |
| Approach: | They propose a method to generate training data without crowdsourcing . they adapt negative training, decoding, and classification methods to mitigate redundancy problem . |
| Outcome: | The proposed method reduces the rate of redundant questions from 27.2% to 8.7% while improving the quality of the original model. |
Similar Papers
Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for generating open-domain dialogue systems underutilize training data. |
| Approach: | They propose a retrieval-generation training framework that takes advantage of heterogeneous training data by considering them as "evidence" they use BERTScore retrieval framework which gives better qualities of the training data, they show . |
| Outcome: | The proposed method performs well on zero-shot experiments and is more robust to real-world data. |
A Recurrent BERT-based Model for Question Generation (D19-58)
Copied to clipboard
| Challenge: | Existing QG models rely on recurrent neural networks (RNNs) but the inherent sequential nature of the RNN models suffers from the problem of handling long sequences. |
| Approach: | They propose to employ a pre-trained BERT language model to tackle question generation tasks. |
| Outcome: | The proposed model outperforms the existing models on the question-answering dataset SQuAD and advances the BLEU 4 score from 16.85 to 22.17. |
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Don’t Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training (2020.acl-main)
Copied to clipboard
| Challenge: | Unlikelihood is a technique developed for removal of repetition in language model completions . it allows for a model to be generalized to solve a number of problems . |
| Approach: | They extend the unlikelihood objective to generate generations that contain repetitions . they show that such an objective can be used to improve logical consistency . |
| Outcome: | The proposed approach can be applied to a number of dialogue tasks. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
SPARQL-to-Text Question Generation for Knowledge-Based Conversational Applications (2022.aacl-main)
Copied to clipboard
| Challenge: | a paper focuses on the generation of natural language questions based on SPARQL queries . knowledge-based approaches have become popular in the field of question answering and dialogue . |
| Approach: | This paper focuses on the generation of natural language questions based on SPARQL queries . it uses 4 knowledge-based QA corpora homogenized for the task and a new challenge set is introduced . |
| Outcome: | The proposed task is based on the generation of questions in a conversational context. |
Learning to Generate Questions by Learning to Recover Answer-containing Sentences (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent research has focused on synthetically generating a question from a given context and an annotated answer by training an additional generative model. |
| Approach: | They propose a method that learns to generate contextually rich questions by recovering answer-containing sentences. |
| Outcome: | The proposed approach improves the quality and accuracy of existing models and achieves comparable results to the state-of-the-art on MS MARCO and NewsQA. |
Asking the Crowd: Question Analysis, Evaluation and Generation for Open Discussion on Online Forums (P19-1)
Copied to clipboard
| Challenge: | Existing work on teaching machines to ask questions focused on generating fixed answers. |
| Approach: | They propose a model to generate open-answered questions from real-world news for open discussion . they analyze how language use affects the number of answers . |
| Outcome: | The proposed model generates questions with higher quality than most text generation methods. |
Open-World Factually Consistent Question Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for question generation suffer from factual inconsistencies and incorrect entities and are not answerable from the input paragraph. |
| Approach: | They propose a data processing technique based on de-lexicalization for consistent question generation across domains and a model that is generic across question-generation models. |
| Outcome: | The proposed method produces entity-level factually consistent questions without significant impact on traditional metrics. |
Automatic Generation of Large-scale Multi-turn Dialogues from Reddit (2022.coling-1)
Copied to clipboard
| Challenge: | Using a set of algorithms, we can generate large dialogue corpus from Reddit. |
| Approach: | They propose to automatically convert posts and their comments from discussion forums such as Reddit into multi-turn dialogues. |
| Outcome: | The proposed methods improve on the baseline method by 36.3% . the best method shows an improvement of 36.6% over the previous one . |