Papers by Xinsong Zhang
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (2023.acl-long)
Copied to clipboard
| Challenge: | Empirical results show that CCLM significantly outperforms the prior state-of-the-art with an average absolute improvement of over 10%. |
| Approach: | They introduce a pre-training framework that unifies cross-lingual and cross-modal pre-trained models with shared architectures and objectives. |
| Outcome: | The proposed framework outperforms the state-of-the-art in two multi-lingual datasets and two multilingual image-text retrieval datasets. |
GAN Driven Semi-distant Supervision for Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to costly hand-labeled training sets and hard to be extended to large-scale relations. |
| Approach: | They propose a semi-distant supervision approach for relation extraction by constructing a small accurate dataset and properly leveraging numerous instances without relation labels. |
| Outcome: | The proposed approach achieves significant improvements over baselines on real-world datasets. |
Active Testing: An Unbiased Evaluation Method for Distantly Supervised Relation Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from low quality of test set, which leads to considerable biased performance evaluation. |
| Approach: | They propose a method to evaluate distantly supervised relation extraction using noisy test sets and manual annotations. |
| Outcome: | Experiments on a widely used benchmark show that the proposed method can yield approximately unbiased evaluations for distantly supervised relation extractors. |
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing foundation models can only perform the best in one type of understanding tasks. |
| Approach: | They propose a method for training a general foundation model, X-FM, using text, image, and image-text data. |
| Outcome: | The proposed method outperforms existing foundation models on language, vision, and vision-language understanding tasks. |
Neural Relation Extraction via Inner-Sentence Noise Reduction and Transfer Learning (D18-1)
Copied to clipboard
| Challenge: | Existing methods for extracting relations are slow and lack precision . a novel approach to extract relations is proposed to reduce noise between sentences . |
| Approach: | They propose a word-level distant supervised approach for relation extraction using New York Times and Freebase. |
| Outcome: | The proposed method improves the area of precision/call(PR) from 0.35 to 0.39 over the state-of-the-art methods. |
AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models such as BERT have shown great power in natural language understanding . fine-grained tokenizations have advantages and disadvantages for learning of pre-tried models . |
| Approach: | They propose a pretrained language model based on both fine-grained and coarse-grain tokenizations . they propose to use both tokenization techniques to learn pre-trained models . |
| Outcome: | The proposed model outperforms BERT on benchmark datasets for Chinese and English . it can perform better with the same computational cost as BERT, the authors show . |
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained vision-language models have achieved impressive results in a range of vision-linguistic tasks. |
| Approach: | They propose a distilling then pruning framework to compress large vision-language models into smaller, faster ones. |
| Outcome: | The proposed framework reduces the size of a pre-trained large vision-language model and improves its performance on vision-linguistic tasks. |