Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word Identification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing datasets for complex word identification (CWI) are limited and the difficulty of the task is augmented by the scarcity of input examples. |
| Approach: | They propose a novel training technique for the complex word identification task based on domain adaptation to improve character and context representations. |
| Outcome: | The proposed training technique improves the target character and context representations and also smooths differences between datasets. |
Similar Papers
Strong Baselines for Complex Word Identification across Multiple Languages (N19-1)
Copied to clipboard
Pierre Finnimore, Elisabeth Fritzsch, Daniel King, Alison Sneyd, Aneeq Ur Rehman, Fernando Alva-Manchego, Andreas Vlachos
| Challenge: | Complex Word Identification (CWI) is the task of identifying which words or phrases in a sentence are difficult to understand by a specific type of reader. |
| Approach: | They propose to use monolingual and cross-lingual CWI models to make predictions for languages not seen during training. |
| Outcome: | The proposed models perform as well as (or better than) most models submitted to the latest CWI Shared Task. |
Complex Word Identification as a Sequence Labelling Task (P19-1)
Copied to clipboard
| Challenge: | Complex Word Identification (CWI) is a crucial first step in a simplification pipeline. |
| Approach: | They propose a system that performs CWI in context without extensive feature engineering and outperforms state-of-the-art systems on this task. |
| Outcome: | The proposed system outperforms state-of-the-art systems on complex word identification. |
One Size Does Not Fit All: The Case for Personalised Word Complexity Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Complex word identification (CWI) aims to identify words in a text that are difficult for a reader to understand and therefore benefit from simplification. |
| Approach: | They propose to use a novel active learning framework to tailor models to individual readers and release a dataset of complexity annotations and models as a benchmark for further research. |
| Outcome: | The proposed model can be tailored to individual readers and released as a benchmark for future research. |
Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups (2024.emnlp-main)
Copied to clipboard
Răzvan-Alexandru Smădu, David-Gabriel Ion, Dumitru-Clementin Cercel, Florin Pop, Mihaela-Claudia Cercel
| Challenge: | Large language models (LLMs) are popular in the Natural Language Processing community because of their versatility and capability to solve unseen tasks in zero/few-shot settings. |
| Approach: | They investigate the use of large language models in CWI, LCP, and MWE settings by evaluating their use in zero-shot, few-shot and fine-tuning settings. |
| Outcome: | The proposed models struggle in certain conditions or achieve comparable results against existing methods. |
Simplification Using Paraphrases and Context-Based Lexical Substitution (N18-1)
Copied to clipboard
| Challenge: | Lexical simplification involves identifying complex words or phrases that need to be simplified and suggesting simpler meaning-preserving substitutes. |
| Approach: | They propose a complex word identification model that exploits both lexical and contextual features and a word-embedding lexical substitution model to replace the detected complex words with simpler paraphrases. |
| Outcome: | The proposed model detects complex words with higher accuracy than other models and proposes good substitutes in context. |
CWID-hi: A Dataset for Complex Word Identification in Hindi Text (2022.lrec-1)
Copied to clipboard
| Challenge: | Text simplification is a method for improving the accessibility of text by converting complex sentences into simple sentences. |
| Approach: | They propose to use Hindi knowledge annotators to capture the annotator’s language knowledge to build an automatic complex word classifier using a soft voting approach. |
| Outcome: | The proposed dataset shows that native and non-native annotators perceive complex words differently depending on their language knowledge. |
Complex Word Identification: A Comparative Study between ChatGPT and a Dedicated Model for This Task (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to assess lexical complexity are used to evaluate the difficulty of vocabulary for language learners. |
| Approach: | They propose to use pre-trained language models to assess the complexity of a word based on its context. |
| Outcome: | The proposed method outperforms the best systems in SemEval-2021. |
Semi-supervised Domain Adaptation for Dependency Parsing via Improved Contextualized Word Representations (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in deep neural network models have improved parsing performance on in-domain texts . however, the problem is to improve performance on out-of-domain text data when there is only a small-scale out-domain labeled data. |
| Approach: | They propose to use adversarial learning and fine-tuning BERT to improve contextualized word representations on out-of-domain texts. |
| Outcome: | The proposed models achieve consistent improvement and fine-tune BERT processes boost parsing accuracy by a large margin. |
Tracing Multilingual Knowledge Acquisition Dynamics in Domain Adaptation: A Case Study of Biomedical Adaptation (2026.eacl-long)
Copied to clipboard
| Challenge: | Multilingual domain adaptation (ML-DA) enables large language models to acquire domain knowledge across languages. |
| Approach: | They propose an adaptive evaluation method that constructs multiple-choice QA datasets from the same bilingual domain corpus used for training. |
| Outcome: | The proposed method constructs multiple-choice QA datasets from the same bilingual domain corpus used for training, thereby enabling direct analysis of multilingual knowledge acquisition. |
A Fine-Grained Domain Adaption Model for Joint Word Segmentation and POS Tagging (2021.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that joint models of word segmentation and POS tagging can lead to better performance because they are closely related. |
| Approach: | They propose a domain adaption method for Chinese word segmentation and POS tagging that uses a simple metric to model the gaps between target and target domains. |
| Outcome: | The proposed method can gain significant performance improvements over baselines on a benchmark dataset. |