Papers by Jiannong Cao
GGP: Glossary Guided Post-processing for Word Embedding Learning (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing word embedding models require much training time and domain knowledge to improve. |
| Approach: | They propose a GGP-based word embedding model that incorporates the glossary and learns sense representations. |
| Outcome: | The proposed model outperforms existing models on topical/functional similarity datasets by 4.1% and 7%. |
Long Text and Multi-Table Summarization: Dataset and Method (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document summarization methods focus on the text and filter out the non-textual content. Existing methods cannot meet the requirements of summarizing long text and multiple tables in each report. |
| Approach: | They propose a dataset for automatic document summarization that uses text and tabular data to produce a concise summary covering the input document's salient information. |
| Outcome: | The proposed method can produce a concise summary covering the input document's salient information. |
Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on sentence prediction tasks uses shallow neural networks to learn essay representations and constrain calculated scores with regression loss or ranking loss. |
| Approach: | They propose to use a pre-trained language model to learn text representations first and then to constrain the scores with regression loss or ranking loss. |
| Outcome: | The proposed model outperforms state-of-the-art models on the Automated Student Assessment Prize dataset. |
Decode with Template: Content Preserving Sentiment Transfer (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to transfer sentiments for text use only explicit sentiments and templates to remove them from input sentences. |
| Approach: | They propose a method to transfer sentiments from input sentences to output sentences using templates. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models in content preservation. |
Automatically Select Emotion for Response via Personality-affected Emotion Transition (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on rendering specified emotions in responses, yet the individual difference in emotion expression is overlooked. |
| Approach: | They propose to equip a dialog system with personality and enable it to select emotions in responses like humans. |
| Outcome: | The proposed system can select emotions in responses like humans by simulating the emotion transition of humans in conversation. |
GeoEdit: Geometric Knowledge Editing for Large Language Models (2025.emnlp-main)
Copied to clipboard
Yujie Feng, Li-Ming Zhan, Zexin Lu, Yongxin Xu, Xu Chu, Yasha Wang, Jiannong Cao, Philip S. Yu, Xiao-Ming Wu
| Challenge: | Existing training-based model editing methods struggle to incorporate new knowledge while preserving unrelated general knowledge. |
| Approach: | They propose a framework that uses geometric relationships to differentiate between neurons associated with new knowledge updates and those related to general knowledge perturbations. |
| Outcome: | The proposed framework avoids updating neurons with directions approximately orthogonal to existing knowledge, thus preserving the model’s generalization ability. |
Highlight-Transformer: Leveraging Key Phrase Aware Attention to Improve Abstractive Multi-Document Summarization (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models do not consider key phrases in determining attention weights of self-attention . Existing work does not consider the importance of key phrases when determining weights . |
| Approach: | They propose a model with highlighting mechanism to assign greater attention weights to key phrases . they propose two structures of highlighting attention for each head and the multihead highlighting . experimental results show that their proposed model significantly outperforms the baseline model . |
| Outcome: | The proposed model outperforms the baseline models on a multi-news dataset. |