Towards Unsupervised Language Understanding and Generation by Joint Dual Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work exploits dual property between understanding and generation to improve performance of modular dialogue systems. |
| Approach: | They propose a dual supervised learning framework that exploits the dual property between understanding and generation. |
| Outcome: | The proposed framework improves both NLU and NLG performance by incorporating supervised and unsupervised learning algorithms. |
Similar Papers
Dual Supervised Learning for Natural Language Understanding and Generation (P19-1)
Copied to clipboard
| Challenge: | Natural language understanding and natural language generation are important research topics in the NLP and dialogue fields. |
| Approach: | They propose a dual-supervised learning framework for natural language understanding and generation on top of dual supervised learning. |
| Outcome: | The proposed framework boosts the performance of both tasks simultaneously in the benchmark experiments. |
Dual Inference for Improving Language Understanding and Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have exploited the duality of the task pairs in machine translation and speech recognition. |
| Approach: | They propose to leverage the duality in the inference stage without retraining whole models. |
| Outcome: | The proposed method is effective in both NLU and NLG tasks, providing the great potential of practical use. |
A Generative Model for Joint Natural Language Understanding and Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Natural language understanding (NLU) and natural language generation (NLG) have opposite goals. |
| Approach: | They propose a generative model which couples NLU and NLG through a shared latent variable. |
| Outcome: | The proposed model achieves state-of-the-art performance on two dialogue datasets with flat and tree-structured formal representations. |
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language. |
| Approach: | They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model. |
| Outcome: | The proposed framework outperforms existing models across multiple datasets in the study of natural language generation. |
Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization (P19-1)
Copied to clipboard
| Challenge: | Semantic parsing aims to transform natural language utterances into formal meaning representations (MRs) whereas an NL generator achieves the reverse, the two tasks are often studied separately. |
| Approach: | They propose a method of dual information maximization to regularize the learning process by matching the joint distributions of p and q of NLs. |
| Outcome: | The proposed method empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. |
DSPM-NLG: A Dual Supervised Pre-trained Model for Few-shot Natural Language Generation in Task-oriented Dialogue System (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for few-shot natural language generation are based on a dual correlation between NLG and SLU from the perspective of probability. |
| Approach: | They propose a dual supervised pre-trained model to regularize the pre-training process . they use a probabilistic approach to learn the dual correlation between NLG and SLU . |
| Outcome: | The proposed model outperforms the previous state-of-the-art models on a few-shot dataset. |
Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labeling (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural natural language generation and understanding models are data-hungry and require massive amounts of annotated data to be competitive. |
| Approach: | They propose a framework that automatically synthesizes weak labels from large-scale weakly-labeled data with a fine-tuned GPT-2 and adapts parameter updates to the models according to the estimated label-quality. |
| Outcome: | The proposed framework outperforms benchmark systems on the E2E and Weather datasets when 100% of the training data is used. |
Programmable Annotation with Diversed Heuristics and Data Denoising (2022.coling-1)
Copied to clipboard
| Challenge: | Neural natural language generation and understanding models require massive amounts of annotated data to be competitive. |
| Approach: | They propose a data programming framework that can jointly construct labeled data for language generation and understanding tasks by allowing annotators to modify an automatically-inferred alignment rule set between sequence labels and text. |
| Outcome: | The proposed framework generates high-quality data within a 1.48 BLEU and 6.42 slot F1 of 100% human-labeled data with just 100 labeled data samples outperforming benchmark annotation frameworks and other semi-supervised approaches. |
DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing vision-and-language generation models cannot utilize pair-wise images and text through bi-directional generation due to the limitations of the model structure and pre-training objectives. |
| Approach: | They propose a framework which unifies vision-and-language generation as sequence generation problems. |
| Outcome: | The proposed framework achieves better performance than variants trained with uni-directional generation objectives or the variant without the commitment loss on image captioning and text-to-image generation datasets. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |