What’s Wrong with Hebrew NLP? And How to Make it Right (D19-3)

Copied to clipboard

Challenge: Sub-optimal performance of many morphologically rich languages (MRLs) is due to errors in early morphology disambiguation decisions, that cannot be recovered later on in the pipeline, yielding incoherent annotations on the whole.
Approach: They propose to use a joint morpho-syntactic infrastructure for processing Modern Hebrew texts to provide rich and expressive annotations.
Outcome: The proposed pipelines are based on a morpho-syntactic infrastructure for processing Modern Hebrew texts.

Similar Papers

MRL Parsing Without Tears: The Case of Hebrew (2024.findings-acl)

Copied to clipboard

Challenge: a new approach to parsing morphologically rich languages (MRLs) is needed to overcome the deficiencies of current approaches.
Approach: They propose a "flipped pipeline" where multiple layers are predicted independently on whole-token basis and then synthesized.
Outcome: The proposed model achieves near-SOTA performance on Hebrew NLP tasks.
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses? (2023.eacl-main)

Copied to clipboard

Challenge: Semitic morphologically-rich languages are characterized by extreme word ambiguity . many of the words are homographs with multiple possible analyses .
Approach: They evaluate existing models for Hebrew homographs using word-piece embeddings . they find they are more effective when the number of word-part splits is limited .
Outcome: The proposed models outperform non-contextualized embeddings on Hebrew homograph challenge sets.
HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark (2023.findings-emnlp)

Copied to clipboard

Challenge: Current benchmarks for Hebrew Natural Language Processing (NLP) focus mainly on morpho-syntactic tasks, neglecting the semantic dimension of language understanding.
Approach: They propose to use Hebrew machine reading comprehension (MRC) as extractive Question Answering to address this problem.
Outcome: The proposed benchmark features 30,147 question-answer pairs derived from both Hebrew Wikipedia articles and Israeli tech news.
Multilingual Sequence-to-Sequence Models for Hebrew NLP (2023.findings-acl)

Copied to clipboard

Challenge: Recent work on pretrained language models for Hebrew is under-parameterized and under-trained . previous work on pretraining Hebrew LMs focused on encoder-only architectures .
Approach: They propose to use sequence-to-sequence generative architectures to train large LMs in morphologically rich languages such as Hebrew.
Outcome: The proposed model improves on all existing Hebrew NLP benchmarks.
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)? (2020.acl-main)

Copied to clipboard

Challenge: a decade has passed since the establishment of SPMRL to address the peculiar challenges of Statistical Parsing for Morphologically-rich languages (MRLs).
Approach: They propose a framework for parsing MRLs and propose implementing symbolic ideas into modern neural architectures.
Outcome: The proposed strategies are based on the multi-tagging task in Hebrew, a morphologically-rich, high-fusion, language.
Representations and Architectures in Neural Sentiment Analysis for Morphologically Rich Languages: A Case Study from Modern Hebrew (C18-1)

Copied to clipboard

Challenge: Existing sentiment analyzers for MRLs that use tokens and morpheme-based representations have no empirically studied effects of representation choices on neural sentiment analysis.
Approach: They develop a sentiment analysis benchmark for Hebrew based on 12K social media comments and provide two instances of data.
Outcome: The proposed benchmarks show that representation choices have measurable effects on task perfromance and that they vary depending on architecture type.
AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level (2022.acl-long)

Copied to clipboard

Challenge: a recent study shows that large pre-trained language models are not sufficient for Hebrew.
Approach: They propose a large pre-trained language model for Hebrew that recovers morphological segments encoded in contextualized embedding vectors.
Outcome: The proposed model obtains state-of-the-art on all tasks beyond contemporary Hebrew baselines.
Beyond Word Boundaries: A Hebrew Coreference Benchmark and an Evaluation Protocol for Morphologically Complex Text (2026.acl-long)

Copied to clipboard

Challenge: CR methods originally designed for English struggle with Morphologically Rich Languages (MRLs) a single token in Hebrew may consist of multiple anaphors, and word/morpheme boundary discrepancies make mention detection and coreference resolution difficult in MRLs.
Approach: They propose a CR dataset that identifies mentions at word, sub-word and multi-word levels and an evaluation protocol that directly addresses word/morpheme boundary discrepancies.
Outcome: The proposed evaluation protocol directly addresses word/morpheme boundary discrepancies in Modern Hebrew, an MRL rich with complex words and pronominal clitics.
Fine-grained Morphosyntactic Analysis and Generation Tools for More Than One Thousand Languages (2020.lrec-1)

Copied to clipboard

Challenge: Using morphosyntactic tools, we train and distribute tools for approximately one thousand languages.
Approach: They train and distribute morphosyntactic tools for approximately one thousand languages.
Outcome: The results show that the tools generalize well across rare and common forms alike.
Building a Hebrew Semantic Role Labeling Lexical Resource from Parallel Movie Subtitles (2020.lrec-1)

Copied to clipboard

Challenge: Existing semantic role labeling resources for Hebrew are not available in English.
Approach: They propose a semantic role labeling resource for Hebrew built semi-automatically through annotation projection from English to Hebrew.
Outcome: The proposed resource is built semi-automatically from an English dataset . it includes morphological analysis, dependency syntax and semantic role labeling .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations