Papers by Yi-Lin Tuan
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing learning metrics are limited to tasks where large human ratings are available. |
| Approach: | They propose a model-based natural language generation (NLG) evaluation metric that is highly correlated with human judgements without requiring human annotation. |
| Outcome: | The proposed metric outperforms all prior unsupervised metrics on multiple NLG tasks including translation, image captioning, and WebNLG text generation. |
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue (2022.emnlp-main)
Copied to clipboard
Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang
| Challenge: | Prior studies of task transfer in dialogue consider only 2-4 tasks, focus on multitasks. |
| Approach: | They propose a benchmark for FEw-sample TAsk transfer in open-domain dialogue. |
| Outcome: | The proposed benchmark analyzes the transferability between 132 source-target task pairs and provides a baseline for future work. |
CausalDialogue: Modeling Utterance-level Causality in Conversations (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans . despite their widespread adoption in society, chatbots have yet not shown natural chat capability . |
| Approach: | They propose a causality-enhanced method to enhance the impact of causality at the utterance level in training neural conversation models. |
| Outcome: | The proposed method improves diversity and agility of loss functions and still needs improvement . the proposed method is based on a CausalDialogue dataset . |
HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets focused on multiturn dialogue systems focus on text or table information. |
| Approach: | They propose a dataset that consists of crowdsourced conversations grounded on Wikipedia text and tables. |
| Outcome: | The proposed dataset shows that there is still ample opportunity for improvement in the current state of dialogue systems. |
Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing systems that require extensive labor to process user requests are limited in their reasoning capabilities and require extensive manual effort to design. |
| Approach: | They propose a method that allows a transformer model to walk on a large-scale knowledge graph to generate responses by reasoning over differentiable knowledge graphs. |
| Outcome: | The proposed method allows a transformer model to walk on a large-scale knowledge graph to generate responses. |
Quality Estimation without Human-labeled Data (2021.eacl-main)
Copied to clipboard
Yi-Lin Tuan, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Francisco Guzmán, Lucia Specia
| Challenge: | Quality estimation aims to measure the quality of translated content without access to a reference translation. |
| Approach: | They propose a method that uses synthetic training data to train supervised quality estimation models. |
| Outcome: | The proposed model outperforms models trained on human-annotated data for sentence and word-level prediction. |
DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphs (D19-1)
Copied to clipboard
| Challenge: | Existing work has not shown that knowledge-grounded models can zero-shot adapt to updated, unseen knowledge graphs. |
| Approach: | They propose a task to apply dynamic knowledge graphs to neural conversation models . they propose 'dyKgChat' that selects an output from two networks at each time step . |
| Outcome: | The proposed model outperforms existing knowledge-grounded conversation models in evaluation metrics. |