Papers by Weihua Yue

8 papers
Multiscale Collaborative Deep Models for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Neural machine translation models with deeper neural networks are difficult to train.
Approach: They propose a MultiScale Collaborative framework to boost gradient back-propagation . they let each encoder block learn a fine-grained representation and enhance it .
Outcome: The proposed framework outperforms baseline models on translation tasks with three translation directions and achieves a BLEU score of 30.56 on the English-to-German task.
G-Transformer for Document-Level Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing work extends translation unit from single sentence to multiple sentences.
Approach: They propose to introduce locality assumption as an inductive bias into Transformer and reduce the hypothesis space of attention from target to source.
Outcome: The proposed model achieves state-of-the-art BLEU scores on three benchmark datasets.
Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentences (2020.acl-main)

Copied to clipboard

Challenge: a monolingual speaker can learn to translate by looking up a bilingual dictionary . a novel task of machine translation (MT) is based on no parallel sentences but can refer to a ground-truth bilingual dictionary and large-scale monolingual corpora.
Approach: They propose a task of machine translation that uses a bilingual dictionary and large-scale monolingual corpora to translate a monolingual speaker.
Outcome: The proposed task is based on a bilingual dictionary and large scale monolingual corpora, while being independent on parallel sentences.
Uncertainty-Aware Semantic Augmentation for Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for neural machine translation only observe one source sentence at training time . this discrepancy in data distribution leads to a formidable learning challenge .
Approach: They propose an uncertainty-aware semantic augmentation approach to capture universal semantic information among multiple source sentences and enhance hidden representations with this information.
Outcome: The proposed approach outperforms baseline and existing methods on translation tasks.
MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering (2024.findings-acl)

Copied to clipboard

Challenge: Existing MVQA models ignore multi-level progressive capabilities due to unspecific data and plain architecture.
Approach: They propose a multi-level visual language model for medical visual question answering (MVQA) which covers multi- level questions and answers as well as reasoning processes from visual clues to semantic cognition.
Outcome: The proposed model outperforms existing medical multimodal large language models on a multi-level instruction dataset and a feature alignment module.
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation (2022.acl-long)

Copied to clipboard

Challenge: Neural machine translation (NMT) tasks require large amounts of parallel data to augment training.
Approach: They propose a data augmentation paradigm that augments each training instance with an adjacency semantic region that could cover adequate variants of literal expression under the same meaning.
Outcome: The proposed paradigm improves on the state-of-the-art in supervised neural machine translation tasks.
Contrastive Attention Mechanism for Abstractive Sentence Summarization (D19-1)

Copied to clipboard

Challenge: Existing attention mechanisms for abstractive sentence summarization are based on rule-based methods and large-scale training corpora.
Approach: They propose a contrastive attention mechanism that extends the sequence-to-sequence framework for abstractive sentence summarization task.
Outcome: The proposed mechanism improves the state-of-the-art on the abstractive sentence summarization task.
Code-Switching for Enhancing NMT with Pre-Specified Translation (N19-1)

Copied to clipboard

Challenge: Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding.
Approach: They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data .
Outcome: The proposed method improves translation quality without hurting unconstrained words.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations