Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization (P19-1)
Copied to clipboard
| Challenge: | Semantic parsing aims to transform natural language utterances into formal meaning representations (MRs) whereas an NL generator achieves the reverse, the two tasks are often studied separately. |
| Approach: | They propose a method of dual information maximization to regularize the learning process by matching the joint distributions of p and q of NLs. |
| Outcome: | The proposed method empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. |
Similar Papers
Dual Supervised Learning for Natural Language Understanding and Generation (P19-1)
Copied to clipboard
| Challenge: | Natural language understanding and natural language generation are important research topics in the NLP and dialogue fields. |
| Approach: | They propose a dual-supervised learning framework for natural language understanding and generation on top of dual supervised learning. |
| Outcome: | The proposed framework boosts the performance of both tasks simultaneously in the benchmark experiments. |
Towards Unsupervised Language Understanding and Generation by Joint Dual Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work exploits dual property between understanding and generation to improve performance of modular dialogue systems. |
| Approach: | They propose a dual supervised learning framework that exploits the dual property between understanding and generation. |
| Outcome: | The proposed framework improves both NLU and NLG performance by incorporating supervised and unsupervised learning algorithms. |
Dual Inference for Improving Language Understanding and Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have exploited the duality of the task pairs in machine translation and speech recognition. |
| Approach: | They propose to leverage the duality in the inference stage without retraining whole models. |
| Outcome: | The proposed method is effective in both NLU and NLG tasks, providing the great potential of practical use. |
Semantic Parsing with Dual Learning (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to parse natural language queries are limited by lack of labeled data and constrained decoding. |
| Approach: | They propose a semantic parsing framework with the dual learning algorithm that makes full use of data through a dual-learning game. |
| Outcome: | The proposed approach achieves state-of-the-art performance on ATIS dataset and gets competitive performance on overnight dataset. |
Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances. |
| Approach: | They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances. |
| Outcome: | The proposed framework is effective and compatible with supervised training. |
A Generative Model for Joint Natural Language Understanding and Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Natural language understanding (NLU) and natural language generation (NLG) have opposite goals. |
| Approach: | They propose a generative model which couples NLU and NLG through a shared latent variable. |
| Outcome: | The proposed model achieves state-of-the-art performance on two dialogue datasets with flat and tree-structured formal representations. |
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning (2022.coling-1)
Copied to clipboard
Xuantao Lu, Jingping Liu, Zhouhong Gu, Hanwen Tong, Chenhao Xie, Junyang Huang, Yanghua Xiao, Wenguang Wang
| Challenge: | Existing methods to parse natural language into structured logical expressions have limitations due to paucity of labeled data. |
| Approach: | They propose a scoring model to automatically learn a model-based reward . they also propose introducing a Chinese-PL/FOL dataset to compensate for paucity of labeled data . |
| Outcome: | The proposed model outperforms competitors on several datasets. |
Is Supervised Syntactic Parsing Beneficial for Language Understanding Tasks? An Empirical Investigation (2021.eacl-main)
Copied to clipboard
| Challenge: | Traditional NLP has long held (supervised) syntactic parsing necessary for successful higher-level semantic language understanding (LU). |
| Approach: | They empirically examine the usefulness of supervised parsing for semantic LU in LM-pretrained transformer networks. |
| Outcome: | The proposed model is based on LM-pretrained transformer networks with a biaffine parsing head and fine-tuned for LU tasks. |
Curate and Generate: A Corpus and Method for Joint Control of Semantics and Style in Neural NLG (P19-1)
Copied to clipboard
| Challenge: | Neural natural language generation (NNLG) models generate syntactically correct utterances from structured inputs without needing hand-crafted rules or templates. |
| Approach: | They propose a method for generating a corpus of parallel meaning representations with rich style markup using freely available and naturally descriptive user reviews. |
| Outcome: | The proposed method can be scalably reused to generate NLG datasets for other domains. |
Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labeling (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural natural language generation and understanding models are data-hungry and require massive amounts of annotated data to be competitive. |
| Approach: | They propose a framework that automatically synthesizes weak labels from large-scale weakly-labeled data with a fine-tuned GPT-2 and adapts parameter updates to the models according to the estimated label-quality. |
| Outcome: | The proposed framework outperforms benchmark systems on the E2E and Weather datasets when 100% of the training data is used. |