Challenge: Existing datasets for complex word identification (CWI) are limited and the difficulty of the task is augmented by the scarcity of input examples.
Approach: They propose a novel training technique for the complex word identification task based on domain adaptation to improve character and context representations.
Outcome: The proposed training technique improves the target character and context representations and also smooths differences between datasets.

Similar Papers

Strong Baselines for Complex Word Identification across Multiple Languages (N19-1)

Copied to clipboard

Challenge: Complex Word Identification (CWI) is the task of identifying which words or phrases in a sentence are difficult to understand by a specific type of reader.
Approach: They propose to use monolingual and cross-lingual CWI models to make predictions for languages not seen during training.
Outcome: The proposed models perform as well as (or better than) most models submitted to the latest CWI Shared Task.
Complex Word Identification as a Sequence Labelling Task (P19-1)

Copied to clipboard

Challenge: Complex Word Identification (CWI) is a crucial first step in a simplification pipeline.
Approach: They propose a system that performs CWI in context without extensive feature engineering and outperforms state-of-the-art systems on this task.
Outcome: The proposed system outperforms state-of-the-art systems on complex word identification.
One Size Does Not Fit All: The Case for Personalised Word Complexity Models (2022.findings-naacl)

Copied to clipboard

Challenge: Complex word identification (CWI) aims to identify words in a text that are difficult for a reader to understand and therefore benefit from simplification.
Approach: They propose to use a novel active learning framework to tailor models to individual readers and release a dataset of complexity annotations and models as a benchmark for further research.
Outcome: The proposed model can be tailored to individual readers and released as a benchmark for future research.
Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are popular in the Natural Language Processing community because of their versatility and capability to solve unseen tasks in zero/few-shot settings.
Approach: They investigate the use of large language models in CWI, LCP, and MWE settings by evaluating their use in zero-shot, few-shot and fine-tuning settings.
Outcome: The proposed models struggle in certain conditions or achieve comparable results against existing methods.
Simplification Using Paraphrases and Context-Based Lexical Substitution (N18-1)

Copied to clipboard

Challenge: Lexical simplification involves identifying complex words or phrases that need to be simplified and suggesting simpler meaning-preserving substitutes.
Approach: They propose a complex word identification model that exploits both lexical and contextual features and a word-embedding lexical substitution model to replace the detected complex words with simpler paraphrases.
Outcome: The proposed model detects complex words with higher accuracy than other models and proposes good substitutes in context.
CWID-hi: A Dataset for Complex Word Identification in Hindi Text (2022.lrec-1)

Copied to clipboard

Challenge: Text simplification is a method for improving the accessibility of text by converting complex sentences into simple sentences.
Approach: They propose to use Hindi knowledge annotators to capture the annotator’s language knowledge to build an automatic complex word classifier using a soft voting approach.
Outcome: The proposed dataset shows that native and non-native annotators perceive complex words differently depending on their language knowledge.
Complex Word Identification: A Comparative Study between ChatGPT and a Dedicated Model for This Task (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to assess lexical complexity are used to evaluate the difficulty of vocabulary for language learners.
Approach: They propose to use pre-trained language models to assess the complexity of a word based on its context.
Outcome: The proposed method outperforms the best systems in SemEval-2021.
Semi-supervised Domain Adaptation for Dependency Parsing via Improved Contextualized Word Representations (2020.coling-main)

Copied to clipboard

Challenge: Recent advances in deep neural network models have improved parsing performance on in-domain texts . however, the problem is to improve performance on out-of-domain text data when there is only a small-scale out-domain labeled data.
Approach: They propose to use adversarial learning and fine-tuning BERT to improve contextualized word representations on out-of-domain texts.
Outcome: The proposed models achieve consistent improvement and fine-tune BERT processes boost parsing accuracy by a large margin.
Tracing Multilingual Knowledge Acquisition Dynamics in Domain Adaptation: A Case Study of Biomedical Adaptation (2026.eacl-long)

Copied to clipboard

Challenge: Multilingual domain adaptation (ML-DA) enables large language models to acquire domain knowledge across languages.
Approach: They propose an adaptive evaluation method that constructs multiple-choice QA datasets from the same bilingual domain corpus used for training.
Outcome: The proposed method constructs multiple-choice QA datasets from the same bilingual domain corpus used for training, thereby enabling direct analysis of multilingual knowledge acquisition.
A Fine-Grained Domain Adaption Model for Joint Word Segmentation and POS Tagging (2021.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that joint models of word segmentation and POS tagging can lead to better performance because they are closely related.
Approach: They propose a domain adaption method for Chinese word segmentation and POS tagging that uses a simple metric to model the gaps between target and target domains.
Outcome: The proposed method can gain significant performance improvements over baselines on a benchmark dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations