Papers by Shuyang Gao

7 papers
Few Shot Dialogue State Tracking using Meta-learning (2021.eacl-main)

Copied to clipboard

Challenge: Existing methods for transferring knowledge from resource-rich domains to unknown domains are data hungry . a meta-learning algorithm is proposed to solve the problem of zero/few-shot DST .
Approach: They propose a meta-learner for the problem of zero/few-shot DST . they propose to agnostically train any existing chatbot system to improve its performance .
Outcome: The proposed meta-learner improves on baseline in a low-data setting.
GRAVL-BERT: Graphical Visual-Linguistic Representations for Multimodal Coreference Resolution (2022.coling-1)

Copied to clipboard

Challenge: Multimodal coreference resolution (MCR) is a crucial capability for building next-generation conversational agents.
Approach: They propose a multimodal coreference resolution model that resolves coreferences made in multi-turn dialogues with scene images.
Outcome: The proposed model resolves coreferences made in multi-turn dialogues with scene images.
Controlled Text Generation for Data Augmentation in Intelligent Artificial Agents (D19-56)

Copied to clipboard

Challenge: Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents.
Approach: They propose to use conditional variational auto-encoders to augment training data of a popular commercial artificial agent with a small set of phrase templates to generate new semantically similar phrases.
Outcome: The proposed approach outperforms the previous controlled text generation techniques with limited data and significantly outperformed the previous methods.
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems (2021.naacl-demos)

Copied to clipboard

Challenge: Traditional goal-oriented dialogue systems require annotations which are hard to obtain for every new domain, limiting scalability.
Approach: They propose a data-driven approach to building goal-oriented dialogue systems . they use a seed dialogue simulator to generate annotated conversations instead of collecting annotations .
Outcome: The proposed system improves turn-level action signature prediction accuracy by 50% . the system is scalable, extensible and data efficient .
MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines (2020.lrec-1)

Copied to clipboard

Challenge: MultiWOZ 2.0 has substantial noise in dialogue state annotations and dialogue utterances . follow-up work has augmented the original dataset with user dialogue acts .
Approach: They propose to reannotate dialogue state and utterances based on original dataset . they then compare their results to other datasets to improve their models .
Outcome: The proposed dataset improves on the noise in the dialogue state annotations and dialogue utterances.
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance (2026.findings-acl)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) assumes a uniform rank r for each incremental matrix, not accounting for the varying significance of weight matrices across modules and layers.
Approach: They propose a framework that allows for faster convergence of low-rank adaptive models . they use a hypernetwork to prune the outputs of the hypernetworks to generate parameters .
Outcome: The proposed framework accelerates convergence of AdaLoRA by leveraging a hypernetwork.
Context-Situated Pun Generation (2022.emnlp-main)

Copied to clipboard

Challenge: a new task for context-situated pun generation uses a given context to generate puns . human evaluation shows that 69% of top retrieved pun words can be used to generate context-based puns.
Approach: They propose a task where puns are generated based on contextual keywords and pun words.
Outcome: The proposed system generates successful puns 31% of the time given a plausible tuple of context words and pun pairs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations