Papers by Ruosong Yang

7 papers
GGP: Glossary Guided Post-processing for Word Embedding Learning (2020.lrec-1)

Copied to clipboard

Challenge: Existing word embedding models require much training time and domain knowledge to improve.
Approach: They propose a GGP-based word embedding model that incorporates the glossary and learns sense representations.
Outcome: The proposed model outperforms existing models on topical/functional similarity datasets by 4.1% and 7%.
Long Text and Multi-Table Summarization: Dataset and Method (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing document summarization methods focus on the text and filter out the non-textual content. Existing methods cannot meet the requirements of summarizing long text and multiple tables in each report.
Approach: They propose a dataset for automatic document summarization that uses text and tabular data to produce a concise summary covering the input document's salient information.
Outcome: The proposed method can produce a concise summary covering the input document's salient information.
Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent work on sentence prediction tasks uses shallow neural networks to learn essay representations and constrain calculated scores with regression loss or ranking loss.
Approach: They propose to use a pre-trained language model to learn text representations first and then to constrain the scores with regression loss or ranking loss.
Outcome: The proposed model outperforms state-of-the-art models on the Automated Student Assessment Prize dataset.
Decode with Template: Content Preserving Sentiment Transfer (2020.lrec-1)

Copied to clipboard

Challenge: Existing methods to transfer sentiments for text use only explicit sentiments and templates to remove them from input sentences.
Approach: They propose a method to transfer sentiments from input sentences to output sentences using templates.
Outcome: The proposed model significantly outperforms state-of-the-art models in content preservation.
Automatically Select Emotion for Response via Personality-affected Emotion Transition (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on rendering specified emotions in responses, yet the individual difference in emotion expression is overlooked.
Approach: They propose to equip a dialog system with personality and enable it to select emotions in responses like humans.
Outcome: The proposed system can select emotions in responses like humans by simulating the emotion transition of humans in conversation.
Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection (2023.acl-long)

Copied to clipboard

Challenge: Existing studies focus on fusing different features but ignore the challenge of modality heterogeneity.
Approach: They propose a text-guided fusion module with novel Sparse-Attention to reduce the negative impacts of redundant visual elements and a sentiment-based congruity constraint task to calibrate the feature shift in the representation space.
Outcome: The proposed model is competitive against existing methods and achieves state-of-the-art results on two public benchmark datasets.
Highlight-Transformer: Leveraging Key Phrase Aware Attention to Improve Abstractive Multi-Document Summarization (2021.findings-acl)

Copied to clipboard

Challenge: Existing models do not consider key phrases in determining attention weights of self-attention . Existing work does not consider the importance of key phrases when determining weights .
Approach: They propose a model with highlighting mechanism to assign greater attention weights to key phrases . they propose two structures of highlighting attention for each head and the multihead highlighting . experimental results show that their proposed model significantly outperforms the baseline model .
Outcome: The proposed model outperforms the baseline models on a multi-news dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations