Papers by Zhongfei Zhang
BERT-enhanced Relational Sentence Ordering Network (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve coherence modeling for paragraphs have been developed. |
| Approach: | They propose a BERT-enhanced Relational Sentence Ordering Network to capture better dependency relationship among sentences and exploit it with a deep relational module. |
| Outcome: | The proposed model shows significant improvement over the state-of-the-art on six datasets. |
Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning (D19-1)
Copied to clipboard
| Challenge: | Existing studies on video captioning focus on the association relationships between multiple modalities. |
| Approach: | They propose a video captioning model with high-order cross-modal attention (HOCA) they propose low-rank HOCA which adopts tensor decomposition to reduce the space requirement . |
| Outcome: | The proposed model captures cross-modal interaction of different modalities and reduces space requirement. |
Deep Attentive Sentence Ordering Network (D18-1)
Copied to clipboard
| Challenge: | Existing methods for sentence ordering tasks rely on linguistic knowledge and are domain specific. |
| Approach: | They propose a deep attentive sentence ordering network which integrates self-attention mechanism with LSTMs in the encoding of input sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art models on Sentence Ordering and Order Discrimination tasks and is shown to be highly efficient. |
Dual Low-Rank Multimodal Fusion (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tensor-based fusion methods make poor use of fine-grained temporal dynamics of multimodal sequential features. |
| Approach: | They propose a novel multimodal fusion method called Fine-Grained Temporal Low-Rank Multimodal Fusion that uses low-rank tensor approximation along dual dimensions of input features. |
| Outcome: | The proposed method outperforms the state-of-the-art tensor-based methods with a similar computational complexity. |
Fine-tune BERT with Sparse Self-Attention Mechanism (D19-1)
Copied to clipboard
| Challenge: | Existing sparse self-attention fine-tuning models have been used to improve sentiment analysis, question answering, and natural language inference tasks. |
| Approach: | They propose a Sparse Self-Attention Fine-tuning model which integrates sparsity into self-attention mechanism to enhance the fine-tune performance of BERT. |
| Outcome: | The proposed model outperforms the baseline models on sentiment analysis, question answering, and natural language inference tasks and is able to interpret the input better. |