Papers by Yen-Chun Chen
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing pre-trained models suffer from slow inference speed due to cross-modal attention in transformer architecture. |
| Approach: | They propose a multimodal approach that accelerates the inference time of ITR by thousands of times . they extract pre-cached feature indexes offline and employ instant dot-product matching online . |
| Outcome: | The proposed approach outperforms existing models that consume 1000 times magnitude of computational hours using the same features. |
Cluster-Former: Clustering-based Sparse Transformer for Question Answering (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for encoding long sequences in deep learning suffer from high latency and memory demands. |
| Approach: | They propose a clustering-based sparse Transformer framework to perform attention across chunked sequences. |
| Outcome: | The proposed framework achieves state-of-the-art on several major QA benchmarks. |
Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting (P18-1)
Copied to clipboard
| Challenge: | Empirically, we achieve the new state-of-the-art on all metrics (including human evaluation) on the CNN/Daily Mail dataset, as well as significantly higher abstractiveness scores. |
| Approach: | They propose a sentence-level policy gradient method that bridges computation between two neural networks in a hierarchical way while maintaining language fluency. |
| Outcome: | The proposed model achieves state-of-the-art on all metrics and higher abstractiveness scores on the CNN/Daily Mail dataset and faster training convergence than previous models. |
Distilling Knowledge Learned in BERT for Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models such as BERT have revolutionized the state of the art in many language understanding tasks. |
| Approach: | They propose a conditional masked language modeling approach to fine tune BERT on target generation tasks by imposing global sequence-level supervision on conventional Seq2Seq models. |
| Outcome: | The proposed model outperforms strong Transformer baselines on multiple language generation tasks such as machine translation and text summarization. |
Explore, Propose, and Assemble: An Interpretable Model for Multi-Hop Reading Comprehension (P19-1)
Copied to clipboard
| Challenge: | Existing models for multi-hop reading comprehension only require a single-hop reasoning, meaning that the evidence needed to answer the question is scattered in a set of supporting documents. |
| Approach: | They propose an interpretable 3-module system called Explore-Propose-Assemble reader (EPAr) that explores and connects relevant information from multiple documents in order to answer a question about the context. |
| Outcome: | The proposed model approximates coarse-to-fine-grained comprehension behavior of human readers when facing multiple long documents. |
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following (2023.emnlp-main)
Copied to clipboard
| Challenge: | Embodied Instruction Following has shown an impressive success rate when the environment has been seen in training, but when deployed in an unseen environment, it tends to struggle when deployed with an unsightly environment. |
| Approach: | They propose to explicitly align the agent’s hidden states with the instructions via contrastive learning to bridge the semantic gap between high-level language instructions and the agent's low-level action space. |
| Outcome: | The proposed meta-actions achieve a 4.5% success rate in unseen environments compared to a strong multi-modal Transformer baseline . |
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training (2020.emnlp-main)
Copied to clipboard
| Challenge: | HERO is a framework for large-scale video+language omni-representation learning. |
| Approach: | They propose a framework for large-scale video+language omni-representation learning that encodes multimodal inputs in a hierarchical structure and uses Masked Language Modeling and Masked Frame Modeling to train models. |
| Outcome: | The proposed framework achieves state-of-the-art on multiple benchmarks over text-based video/video-moment retrieval, video question answering (QA), Video-and-language Inference and video Captioning tasks across different domains. |