BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis (N19-1)
Copied to clipboard
| Challenge: | Existing work on question-answering has limited training examples for RRC . question-announced questions are a key component of online commerce . |
| Approach: | They propose to turn customer reviews into a large source of knowledge that can be exploited to answer user questions. |
| Outcome: | The proposed approach improves review reading comprehension on popular language model BERT . it also improves aspect extraction and aspect sentiment classification tasks . |
Similar Papers
Understanding Pre-trained BERT for Aspect-based Sentiment Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies show impressive results on aspects-based sentiment analysis tasks. |
| Approach: | They analyze the attentions and learned representations of BERT for aspects-based sentiment analysis tasks. |
| Outcome: | The proposed model can be used for aspects-based sentiment analysis (ABSA) but it is not clear how it can provide important features for downstream tasks. |
Aspect-based Sentiment Analysis as Machine Reading Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to aspect-based sentiment analysis stack multiple modules and result in severe error propagation. |
| Approach: | They propose a MRC-PrOmpt mOdeL framework where multiple sentiment aspects are elicited by a machine reading comprehension model and their corresponding sentiment polarities are classified in a prompt learning way. |
| Outcome: | The proposed framework significantly outperforms existing state-of-the-art models or achieves comparable performance on widely-used benchmark datasets. |
Towards Interpreting BERT for Reading Comprehension Based QA (2020.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models such as ELMO and XLNet have achieved state-of-the-art performance on various NLP tasks. |
| Approach: | They propose to define a layer’s role or functionality using Integrated Gradients and perform preliminary analysis across all layers. |
| Outcome: | The proposed model performs better than existing models on RCQA and ELMO, but it lacks the human-level performance needed to perform the task. |
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence (N19-1)
Copied to clipboard
| Challenge: | Sentiment analysis (SA) is a computational task that aims to identify opinion polarity towards a specific aspect. |
| Approach: | They propose to convert ABSA into a sentence-pair classification task such as question answering and natural language inference. |
| Outcome: | The proposed model is fine-tuned and achieves state-of-the-art on SentiHood and SemEval-2014 datasets. |
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies on continual learning of a sequence of aspect sentiment classification tasks have not addressed these issues. |
| Approach: | They propose a capsule network based model called B-CL to address these issues . it uses continual learning adapters and capsule networks to encourage knowledge transfer . |
| Outcome: | The proposed model improves the performance on both the new task and the old tasks via forward and backward knowledge transfer. |
Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis (2022.findings-acl)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in a sentence. |
| Approach: | They propose to use a dynamic aspect-oriented semantics-based method to learn ABSA. |
| Outcome: | The proposed method can learn dynamic aspect-oriented semantics for ABSA on three benchmark datasets. |
Exploiting BERT for End-to-End Aspect-based Sentiment Analysis (D19-55)
Copied to clipboard
| Challenge: | Existing studies on ABSA use a sequence tagging problem to extract aspect-specific opinion words from the sentence given the aspect. |
| Approach: | They build a series of simple yet insightful neural baselines to deal with E2E-ABSA task using contextualized embeddings from pre-trained language models. |
| Outcome: | The proposed architecture outperforms state-of-the-art models even with a simple linear classification layer. |
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved great success on Machine Reading Comprehension (MRC) however, the poor support in evidence extraction hinders them from further advancing MRC. |
| Approach: | They propose a REtrieval-based pre-training approach that strengthens evidence extraction during pre-training by inherited downstream MRC tasks. |
| Outcome: | The proposed approach strengthens evidence extraction during pre-training, which is further inherited by downstream tasks. |
Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification (2020.lrec-1)
Copied to clipboard
| Challenge: | Aspect-Target Sentiment Classification (ATSC) is a subtask of Aspect Based Sentimence Analysis (ABSA) . recent deep transfer-learning methods have been applied successfully to a myriad of NLP tasks. |
| Approach: | They propose to use a self-supervised domain-specific BERT language model to exploit ATSC . they also perform cross-domain evaluation to explore the real-world robustness of their models . |
| Outcome: | The proposed model outperforms baseline models on the SemEval 2014 task 4 restaurants dataset. |
Self Question-answering: Aspect-based Sentiment Analysis by Role Flipped Machine Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | unified Aspect-based Sentiment Analysis (ABSA) aims to couple aspect terms with their corresponding opinion terms, which might make it easier to predict sentiment polarities. |
| Approach: | They propose a new paradigm to pair aspect terms with their corresponding opinion terms . they propose to use a machine learning paradigm to solve the unified ABSA task . |
| Outcome: | The proposed framework can solve the ABSA task without any additional data annotation or transformation. |