Translation as Cross-Domain Knowledge: Attention Augmentation for Unsupervised Cross-Domain Segmenting and Labeling Tasks (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Chinese has no word delimiter or inflection that can indicate segment boundaries or word semantics, increasing the difficulty of segmenting and labeling tasks. |
| Approach: | They propose a paradigm based on attention augmentation to introduce crucial cross-domain knowledge via a translation system into Chinese model. |
| Outcome: | The proposed model significantly advances the state-of-the-art results of Chinese cross-domain segmenting and labeling tasks. |
Similar Papers
Generative Cross-Domain Data Augmentation for Aspect and Opinion Co-Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to perform aspect and opinion co-extraction are difficult due to the lack of fine-grained annotations. |
| Approach: | They propose a framework to transfer knowledge from a labeled source domain to an unlabeled target domain. |
| Outcome: | The proposed framework is more effective than previous domain adaptation methods on three datasets. |
Improving Cross-Domain Chinese Word Segmentation with Word Embeddings (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to Chinese word segmentation (CWS) are character-based and word-based . character-driven approaches use conditional random field models to label sequences, with complex hand-crafted discrete features. |
| Approach: | They propose a semi-supervised word-based approach to improve cross-domain Chinese word segmentation given a baseline segmenter. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on five datasets covering domains in novels, medicine, and patent. |
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention (2023.findings-acl)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) graphs embed the semantics of a sentence in a directed acyclic graph, where concepts are represented by nodes, semantic relations between concepts by edges, and the co-references by reentrant nodes. |
| Approach: | They propose a novel aligner for Abstract Meaning Representation graphs that scales cross-lingually and can align units and spans in sentences of different languages. |
| Outcome: | The proposed aligner achieves state-of-the-art in the benchmarks and can scale cross-lingually. |
Cross-Domain Data Augmentation with Domain-Adaptive Language Modeling for Aspect-Based Sentiment Analysis (2023.acl-long)
Copied to clipboard
| Challenge: | Cross-domain Aspect-Based Sentiment Analysis (ABSA) aims to identify aspect-sentiment pairs in sentences from a target domain. |
| Approach: | They propose a domain-adaptive language model to generate labeled data from a source domain. |
| Outcome: | The proposed approach outperforms existing methods on ABSA and Aspect Extraction tasks. |
Context-Aware Cross-Attention for Non-Autoregressive Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies have shown that non-autoregressive translation models can predict all tokens independently and simultaneously. |
| Approach: | They propose to enhance signals of neighbour source tokens into conventional cross-attention to address a locality perception problem in NAT cross- attention. |
| Outcome: | The proposed approach improves translation quality over strong NAT baselines on representative datasets. |
UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies rely on shallow unsupervised data generated by token surface matching regardless of global context-aware semantics of the surrounding text tokens. |
| Approach: | They propose an Unsupervised Pseudo Semantic Data Augmentation mechanism to enrich training data without human intervention. |
| Outcome: | The proposed model improves on general zero-shot cross-lingual understanding tasks on different languages without human intervention. |
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | a series of experiments show that fine-tuning only the cross-attention parameters is nearly as effective as fine-timing all parameters. |
| Approach: | They conduct experiments to fine-tune a translation model on data where either the source or target language has changed. |
| Outcome: | The proposed model can be trained to several new languages with reduced parameter storage overhead. |
Semantic-conditioned Dual Adaptation for Cross-domain Query-based Visual Segmentation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to visual segmentation from language queries require expensive labeling and degradation when deployed to an unseen domain. |
| Approach: | They propose a task to adapt a visual segmentation model from a labeled domain to an unseen domain. |
| Outcome: | The proposed framework achieves precise feature- and relation-invariant across domains via universal semantic structure. |
Deep Pivot-Based Modeling for Cross-language Cross-domain Transfer with Minimal Guidance (D18-1)
Copied to clipboard
| Challenge: | a framework for cross-domain and cross-language transfer has hardly been explored . cross-linguistic and cross language transfer methods are used for multilingual applications . |
| Approach: | They propose a framework that builds on pivot-based learning, structure-aware Deep Neural Networks and bilingual word embeddings to train a model on labeled data from one language pair. |
| Outcome: | The proposed model outperforms existing models even when trained in the lazy setup . the proposed model can be applied to nine English-German and nine English - french domain pairs without retraining . |
Syntactically Aware Cross-Domain Aspect and Opinion Terms Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Supervised-learning approaches fail to scale across domains where labeled data is lacking. |
| Approach: | They propose a method for incorporating external linguistic knowledge into a self-attention mechanism coupled with a transformer-based model. |
| Outcome: | The proposed method enables leveraging syntactic knowledge from transformer-based models to bridge the gap between domains. |