Papers by Yangyang Guo

4 papers
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training (2021.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models have achieved great success on Machine Reading Comprehension (MRC) however, the poor support in evidence extraction hinders them from further advancing MRC.
Approach: They propose a REtrieval-based pre-training approach that strengthens evidence extraction during pre-training by inherited downstream MRC tasks.
Outcome: The proposed approach strengthens evidence extraction during pre-training, which is further inherited by downstream tasks.
MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods to infer logical relations with annotated training data suffer from over-fitting and poor generalization problems due to the dataset sparsity.
Approach: They propose a MEta-path guided contrastive learning method for logical ReasonIng of text that performs self-supervised pre-training on abundant unlabeled text data.
Outcome: The proposed method outperforms the baselines on two logical reasoning benchmarks with significant improvements.
Efficient Prompting for Continual Adaptation to Missing Modalities (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods combine various missing cases to train recovery modules or align multimodal features, resulting in suboptimal performance, high computational costs, and catastrophic forgetting.
Approach: They propose a continual multimodal missing modality task that uses prompts to learn modalities . existing methods often aggregate various missing cases to train recovery modules . authors conduct extensive experiments on three public datasets .
Outcome: The proposed method consistently outperforms state-of-the-art methods on three public datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations