Papers by Dan Bareket
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)? (2020.acl-main)
Copied to clipboard
| Challenge: | a decade has passed since the establishment of SPMRL to address the peculiar challenges of Statistical Parsing for Morphologically-rich languages (MRLs). |
| Approach: | They propose a framework for parsing MRLs and propose implementing symbolic ideas into modern neural architectures. |
| Outcome: | The proposed strategies are based on the multi-tagging task in Hebrew, a morphologically-rich, high-fusion, language. |
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses? (2023.eacl-main)
Copied to clipboard
| Challenge: | Semitic morphologically-rich languages are characterized by extreme word ambiguity . many of the words are homographs with multiple possible analyses . |
| Approach: | They evaluate existing models for Hebrew homographs using word-piece embeddings . they find they are more effective when the number of word-part splits is limited . |
| Outcome: | The proposed models outperform non-contextualized embeddings on Hebrew homograph challenge sets. |
AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level (2022.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that large pre-trained language models are not sufficient for Hebrew. |
| Approach: | They propose a large pre-trained language model for Hebrew that recovers morphological segments encoded in contextualized embedding vectors. |
| Outcome: | The proposed model obtains state-of-the-art on all tasks beyond contemporary Hebrew baselines. |
Neural Modeling for Named Entities and Morphology (NEMO2) (2021.tacl-1)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental NLP task, commonly formulated as classification over a sequence of tokens. |
| Approach: | They develop a morphologically rich-and-ambiguous language with a token-level and morpheme-level NER annotation framework to address Named Entity Recognition (NER) a novel hybrid architecture precedes and prunes morphology and outperforms the standard pipeline for Hebrew NER and Hebrew morphologies. |
| Outcome: | The proposed architecture outperforms the standard pipeline for Hebrew NER and Hebrew morphological decomposition tasks. |