Papers by Lanjun Wang
T3-Vis: visual analytic for Training and fine-Tuning Transformers in NLP (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Existing visual analytics tools have been shown to support the analysis and interpretation of deep learning models due to the inherent black-box nature of the models. |
| Approach: | They propose to use visual analytic framework to help researchers understand the model's intrinsic properties and behaviours through interactive visualization. |
| Outcome: | The proposed framework provides valuable insights about the model’s intrinsic properties and behaviours through interactive visualization and a suite of built-in algorithms. |
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have investigated the multi-head self-attention mechanism of transformers. |
| Approach: | They propose to use a human-in-the-loop pipeline to discover task-specific attention patterns and inject them into transformer models to improve their accuracy. |
| Outcome: | The proposed methods improve the performance of transformer models by incorporating predefined patterns into their attention matrices. |
A High Precision Pipeline for Financial Knowledge Graph Construction (2020.coling-main)
Copied to clipboard
Sarah Elhammadi, Laks V.S. Lakshmanan, Raymond Ng, Michael Simpson, Baoxing Huai, Zhefeng Wang, Lanjun Wang
| Challenge: | Knowledge graphs are a standard for structured knowledge representation in the Semantic Web. |
| Approach: | They propose to extract financial news articles into a knowledge graph by using a financial dictionary. |
| Outcome: | The proposed pipeline extracts 342,000 financial news articles with a precision of 78% at the top-100 extractions. |