Papers by Mingliang Zhang1
Enhancing Self-Attention with Knowledge-Assisted Attention Maps (2022.naacl-main)
Copied to clipboard
Jiangang Bai, Yujing Wang, Hong Sun, Ruonan Wu, Tianmeng Yang, Pengfei Tang, Defu Cao, Mingliang Zhang1, Yunhai Tong, Yaming Yang, Jing Bai, Ruofei Zhang, Hao Sun, Wei Shen
| Challenge: | Existing works of knowledge infusion depend on multi-task learning frameworks, which are inefficient and require large-scale retraining when new knowledge is considered. |
| Approach: | They propose a method which integrates knowledge-generated attention maps into the self-attention mechanism and integrates it into the model. |
| Outcome: | The proposed model outperforms existing methods on academic datasets and industry-scale ad relevance applications. |