Papers by Tagyoung Chung
FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipeline (2025.findings-emnlp)
Copied to clipboard
Parker Seegmiller, Kartik Mehta, Soumya Saha, Chenyang Tao, Shereen Oraby, Arpit Gupta, Tagyoung Chung, Mohit Bansal, Nanyun Peng
| Challenge: | Recent work improving LLM math reasoning with synthetic data uses unique setups, making comparison of data synthesis strategies impractical. |
| Approach: | They propose a framework for LLM assessment of math reasoning with synthetic data . they use 10 existing data synthesis strategies and multiple other factors to study performance . |
| Outcome: | The proposed data synthesis strategies outperform public datasets on OlympiadBench, CollegeMath, GSMPlus and MATH. |
Few Shot Dialogue State Tracking using Meta-learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for transferring knowledge from resource-rich domains to unknown domains are data hungry . a meta-learning algorithm is proposed to solve the problem of zero/few-shot DST . |
| Approach: | They propose a meta-learner for the problem of zero/few-shot DST . they propose to agnostically train any existing chatbot system to improve its performance . |
| Outcome: | The proposed meta-learner improves on baseline in a low-data setting. |
Mitigating Bias for Question Answering Models by Tracking Bias Influence (2024.naacl-long)
Copied to clipboard
Mingyu Ma, Jiun-Yu Kao, Arpit Gupta, Yu-Hsiang Lin, Wenbo Zhao, Tagyoung Chung, Wei Wang, Kai-Wei Chang, Nanyun Peng
| Challenge: | Existing literature observes bias in question answering (QA) models, but there is no method to mitigate it. |
| Approach: | They propose an approach to mitigate the bias of question answering models by observing the influence of a query instance on another instance. |
| Outcome: | The proposed method reduces bias level in all 9 bias categories while maintaining comparable QA accuracy. |
ExPUNations: Augmenting Puns with Keywords and Explanations (2022.emnlp-main)
Copied to clipboard
Jiao Sun, Anjali Narayan-Chen, Shereen Oraby, Alessandra Cervone, Tagyoung Chung, Jing Huang, Yang Liu, Nanyun Peng
| Challenge: | Puns add the challenge of fusing commonsense and world knowledge with the ability to interpret lexical-semantic ambiguity. |
| Approach: | They propose to augment existing datasets with detailed crowdsourced annotations of puns, keywords and fine-grained funniness ratings to challenge current models' ability to understand and generate humor. |
| Outcome: | The proposed tasks include explanation generation to aid with pun classification and keyword-conditioned pun generation to challenge state-of-the-art models' ability to understand and generate humor. |
GRAVL-BERT: Graphical Visual-Linguistic Representations for Multimodal Coreference Resolution (2022.coling-1)
Copied to clipboard
Danfeng Guo, Arpit Gupta, Sanchit Agarwal, Jiun-Yu Kao, Shuyang Gao, Arijit Biswas, Chien-Wei Lin, Tagyoung Chung, Mohit Bansal
| Challenge: | Multimodal coreference resolution (MCR) is a crucial capability for building next-generation conversational agents. |
| Approach: | They propose a multimodal coreference resolution model that resolves coreferences made in multi-turn dialogues with scene images. |
| Outcome: | The proposed model resolves coreferences made in multi-turn dialogues with scene images. |
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints (2024.findings-emnlp)
Copied to clipboard
Thomas Palmeira Ferraz, Kartik Mehta, Yu-Hsiang Lin, Haw-Shiuan Chang, Shereen Oraby, Sijia Liu, Vivek Subramanian, Tagyoung Chung, Mohit Bansal, Nanyun Peng
| Challenge: | Recent studies have shown that LLMs struggle with instructions containing multiple constraints. |
| Approach: | They propose a self-correction pipeline that decomposes the original instruction into a list of constraints and uses a Critic model to decide when and where the LLM’s response needs refinement. |
| Outcome: | The proposed model outperforms GPT-4 on RealInstruct and IFEval even with weak feedback. |
Simple Question Answering with Subgraph Ranking and Joint-Scoring (N19-1)
Copied to clipboard
| Challenge: | Knowledge graph based simple question answering is a major area of research in question answering. |
| Approach: | They propose a framework to describe and analyze existing knowledge graph based simple question answering approaches. |
| Outcome: | The proposed model achieves a state-of-the-art (85.44% accuracy) on the SimpleQuestions dataset. |
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems (2021.naacl-demos)
Copied to clipboard
Anish Acharya, Suranjit Adhikari, Sanchit Agarwal, Vincent Auvray, Nehal Belgamwar, Arijit Biswas, Shubhra Chandra, Tagyoung Chung, Maryam Fazel-Zarandi, Raefer Gabriel, Shuyang Gao, Rahul Goel, Dilek Hakkani-Tur, Jan Jezabek, Abhay Jha, Jiun-Yu Kao, Prakash Krishnan, Peter Ku, Anuj Goyal, Chien-Wei Lin, Qing Liu, Arindam Mandal, Angeliki Metallinou, Vishal Naik, Yi Pan, Shachi Paul, Vittorio Perera, Abhishek Sethi, Minmin Shen, Nikko Strom, Eddie Wang
| Challenge: | Traditional goal-oriented dialogue systems require annotations which are hard to obtain for every new domain, limiting scalability. |
| Approach: | They propose a data-driven approach to building goal-oriented dialogue systems . they use a seed dialogue simulator to generate annotated conversations instead of collecting annotations . |
| Outcome: | The proposed system improves turn-level action signature prediction accuracy by 50% . the system is scalable, extensible and data efficient . |
Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LM (2024.emnlp-main)
Copied to clipboard
| Challenge: | Contrastive decoding (CD) improves the next-token distribution of a large expert language model (LM) using a small amateur LM. |
| Approach: | They propose a new unsupervised decoding method called Asymptotic Probability Decoding (APD) that extrapolates the probability curves from the LMs of different sizes to infer the asymptototic probabilities from an infinitely large LM. |
| Outcome: | The proposed method improves the next-token distribution of a large expert language model using a small amateur LM. |
Practical Semantic Parsing for Spoken Language Understanding (N19-2)
Copied to clipboard
| Challenge: | Existing systems that can handle a user's utterance are unable to handle Q&A or SLU. |
| Approach: | They build a transfer learning framework for executable semantic parsing . they show it is effective for Q&A and for spoken language understanding . |
| Outcome: | The proposed framework is effective for Q&A and Spoken Language Understanding . it can be learned by exploiting data on other domains, the authors show . |
The Alexa Meaning Representation Language (N18-3)
Copied to clipboard
Thomas Kollar, Danielle Berry, Lauren Stuart, Karolina Owczarzak, Tagyoung Chung, Lambert Mathias, Michael Kayser, Bradford Snow, Spyros Matsoukas
| Challenge: | a new meaning representation language for spoken language is introduced for Alexa . AMRL provides a common representation for how people communicate in spoken language . there is no mechanism to represent ambiguity, forcing the choice of a fixed interpretation for ambiguous utterances. |
| Approach: | They introduce a meaning representation for spoken language, the Alexa meaning represent language . they use a spoken language dataset to collect a sample of utterances from eight domains . |
| Outcome: | The proposed representation provides a common representation for spoken language understanding . it supports cross-domain queries, fine-grained types, complex utterances and composition . the proposed representation was released to developers at a trade show in 2016 . |
Prompting Vision-Language Models For Aspect-Controlled Generation of Referring Expressions (2024.findings-naacl)
Copied to clipboard
Danfeng Guo, Sanchit Agarwal, Arpit Gupta, Jiun-Yu Kao, Emre Barut, Tagyoung Chung, Jing Huang, Mohit Bansal
| Challenge: | Referring Expression Generation (REG) is the task of generating a descriptive caption that uniquely identifies a given target in the scene. |
| Approach: | They propose an Aspect-Controlled REG task which requires generating a referring expression conditioned on the input aspect(s) by changing the input input such as color, location, action etc. |
| Outcome: | The proposed model beats all prior works in the CIDEr score and achieves comparable performance to training with 100% of real data. |
Unsupervised Melody-to-Lyrics Generation (2023.acl-long)
Copied to clipboard
Yufei Tian, Anjali Narayan-Chen, Shereen Oraby, Alessandra Cervone, Gunnar Sigurdsson, Chenyang Tao, Wenbo Zhao, Tagyoung Chung, Jing Huang, Nanyun Peng
| Challenge: | Existing methods for automatic melody-to-lyric generation are limited due to the limited amount of melody-lyrical aligned data. |
| Approach: | They propose a method for automatic melody-to-lyric generation without training on any aligned melody-lyr data. |
| Outcome: | The proposed model generates high-quality lyrics that are singable, intelligible, and coherent than baseline models. |
Context-Situated Pun Generation (2022.emnlp-main)
Copied to clipboard
Jiao Sun, Anjali Narayan-Chen, Shereen Oraby, Shuyang Gao, Tagyoung Chung, Jing Huang, Yang Liu, Nanyun Peng
| Challenge: | a new task for context-situated pun generation uses a given context to generate puns . human evaluation shows that 69% of top retrieved pun words can be used to generate context-based puns. |
| Approach: | They propose a task where puns are generated based on contextual keywords and pun words. |
| Outcome: | The proposed system generates successful puns 31% of the time given a plausible tuple of context words and pun pairs. |