Papers with Hebrew
Copied to clipboard
| Challenge: | introductory tutorial to UCCA, a symbolic meaning representation for semantic representations. |
| Approach: | This tutorial introduces UCCA, a cross-linguistically applicable framework for semantic representation . it will provide a detailed introduction to the UCca annotation guidelines, design philosophy and available resources . |
| Outcome: | The tutorial will provide a detailed introduction to the UCCA framework and compare it to other meaning representations. |
Copied to clipboard
| Challenge: | a recent study shows that large pre-trained language models are not sufficient for Hebrew. |
| Approach: | They propose a large pre-trained language model for Hebrew that recovers morphological segments encoded in contextualized embedding vectors. |
| Outcome: | The proposed model obtains state-of-the-art on all tasks beyond contemporary Hebrew baselines. |
Copied to clipboard
| Challenge: | entrainment is a widespread phenomenon in human interaction that leads interlocutors to adapt their linguistic productions to become more similar to each other. |
| Approach: | They propose to use existing measures to analyze Hebrew speakers interacting in a Map Task to find evidence of lexical entrainment. |
| Outcome: | The proposed study is the first to examine lexical entrainment in Hebrew using two existing measures. |
Copied to clipboard
| Challenge: | a system for automatic diacritization of Hebrew Text is available for both casual and expert users. |
| Approach: | They propose a system for automatic diacritization of Hebrew Text . the system combines declarative linguistic knowledge with machine learning models . |
| Outcome: | The proposed system is available for both casual and expert users. |
Copied to clipboard
| Challenge: | a corpus of late antique and medieval Hebrew poetry is rich in metaphors and similes . scholars in the humanities need to distinguish between figurative and literal language . |
| Approach: | They present a corpus of late antique and medieval Hebrew poetry with expert annotations of metaphor . they hope to facilitate further research in this area . |
| Outcome: | The proposed dataset includes a corpus of late antique and medieval Hebrew poetry with expert annotations of metaphor. |
Copied to clipboard
| Challenge: | comparing two corpus texts and searching for words that differ in their usage between them is a common problem in digital humanities and computational social science. |
| Approach: | They propose an alternative approach that does not use vector space alignment, and instead considers the neighbors of each word. |
| Outcome: | The proposed method is interpretable and stable in 9 different setups and is highly reliable. |
Copied to clipboard
| Challenge: | Named entity transliteration is an important component in many search and language understanding tasks. |
| Approach: | They empirically evaluate a named entity transliteration task using traditional methods . they use a stack of convolutional layers to create a neural network with a new approach . |
| Outcome: | The proposed system outperforms two neural approaches in the named entity transliteration task. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental NLP task, commonly formulated as classification over a sequence of tokens. |
| Approach: | They develop a morphologically rich-and-ambiguous language with a token-level and morpheme-level NER annotation framework to address Named Entity Recognition (NER) a novel hybrid architecture precedes and prunes morphology and outperforms the standard pipeline for Hebrew NER and Hebrew morphologies. |
| Outcome: | The proposed architecture outperforms the standard pipeline for Hebrew NER and Hebrew morphological decomposition tasks. |
Copied to clipboard
| Challenge: | Semantic parsers are mostly designed for and evaluated on English resources, such as CFQ. |
| Approach: | They propose a method for creating a multilingual, parallel question-query dataset . they analyze compositional generalization of parsers in Hebrew, Kannada, Chinese, and English . |
| Outcome: | The proposed method analyzes compositional generalization of parsers in Hebrew, Kannada, Chinese, and English. |
Copied to clipboard
| Challenge: | inscriptions are damaged over time due to earthquakes, fires, political conflicts, and other natural and human-related causes. |
| Approach: | They evaluate masked language modeling approach to reconstruct illegible inscriptions . they use transformer-based models to fine-tune models on Biblical texts . |
| Outcome: | The proposed model achieves the highest text completion accuracy on masked parts of the Biblical texts. |
Copied to clipboard
| Challenge: | Semitic morphologically-rich languages are characterized by extreme word ambiguity . many of the words are homographs with multiple possible analyses . |
| Approach: | They evaluate existing models for Hebrew homographs using word-piece embeddings . they find they are more effective when the number of word-part splits is limited . |
| Outcome: | The proposed models outperform non-contextualized embeddings on Hebrew homograph challenge sets. |
Copied to clipboard
| Challenge: | Morphological tasks use large multi-lingual datasets that organize words into inflection tables . lack of a clear linguistic and operational definition of what is a word impairs universality of tasks . |
| Approach: | They propose to view morphology as a clause-level phenomenon, rather than word-level . they propose to use a dataset for clause- level morphological tasks in 4 different languages . |
| Outcome: | The proposed dataset for clause-level morphology covers 4 typologically different languages: English, German, Turkish, and Hebrew. |
Copied to clipboard
| Challenge: | Contemporary multilingual dependency parsers can parse a diverse set of languages, but performance is lower for Morphologically Rich Languages. |
| Approach: | They propose a joint neural architecture where a lattice-based representation is provided to an arc-factored model and solves the morphological segmentation and syntactic parsing tasks at once. |
| Outcome: | The proposed architecture is language-agnostic and language-based to improve on Hebrew . it shows that the proposed model can parse morphological segmentation and syntactic parsing tasks at once. |
Copied to clipboard
| Challenge: | Thousands of JA texts are available online, covering genres such as philosophy, biblical commentary, and Bible translations. |
| Approach: | They propose a two-step approach to automatically transliterate Judeo-Arabic into Arabic script using simple character-level mapping followed by post-correction to address grammatical and orthographic errors. |
| Outcome: | The proposed method enables Arabic NLP tools to perform morphosyntactic tagging and machine translation, which would have been impossible on the original texts. |
Copied to clipboard
| Challenge: | a wealth of Judeo-Arabic texts is available on the internet, but most speakers of Arabic are unfamiliar with the Hebrew script. |
| Approach: | They propose two machine-learning models for transliterating Judeo-Arabic into Arabic . they also propose a model for identifying non-Arabian words, predominantly Hebrew and Aramaic . |
| Outcome: | The proposed models outperform previous solutions for transliterating Judeo-Arabic into Arabic and identifying non-Arabian words, mainly Hebrew and Aramaic. |
Copied to clipboard
| Challenge: | Recurrent neural networks (RNNs) can induce non-trivial properties of language. |
| Approach: | They investigate whether RNNs can track hierarchical syntactic structure . they include nonsensical sentences where RNN cannot rely on semantic cues . |
| Outcome: | The proposed models can predict long-distance agreement in nonsensical sentences in Italian and English. |
Copied to clipboard
| Challenge: | Explicit representations of predicate-argument relations are a cornerstone of natural language understanding. |
| Approach: | They propose a cross-linguistic projection approach that reuses an English QA-SRL parser within a constrained translation and word-alignment pipeline to automatically generate question-answer annotations aligned with target-language predicates. |
| Outcome: | The proposed approach outperforms strong multilingual LLMs in Hebrew, Russian, and French. |
Copied to clipboard
| Challenge: | Existing corpora of Yiddish text are limited to a single, potentially non-standard orthography . non-phonetically spelled Hebrew words are the largest cause of error, according to our study . |
| Approach: | They propose a multi-orthography parallel Yiddish corpus based on Wiktionary scraping . they also demonstrate how the system can be used to bootstrap a transliteration model . |
| Outcome: | The proposed system achieves error rates between 16.79% and 28.47% on the test set. |
Copied to clipboard
| Challenge: | Gender stereotypes are manifest in most of the world's languages and are consequently propagated or amplified by NLP systems. |
| Approach: | They propose a method for converting between masculine-inflected and feminine-infflectes sentences in morphologically rich languages to reduce gender stereotyping by a factor of 2.5 without any sacrifice to grammaticality. |
| Outcome: | The proposed approach reduces gender stereotyping by 2.5 without any sacrifice to grammaticality. |
Copied to clipboard
| Challenge: | Existing sentiment analyzers for MRLs that use tokens and morpheme-based representations have no empirically studied effects of representation choices on neural sentiment analysis. |
| Approach: | They develop a sentiment analysis benchmark for Hebrew based on 12K social media comments and provide two instances of data. |
| Outcome: | The proposed benchmarks show that representation choices have measurable effects on task perfromance and that they vary depending on architecture type. |
Copied to clipboard
| Challenge: | Modern Hebrew lacks lexical resources fundamental to many natural language processing tools. |
| Approach: | They propose a method for generating a cooccurrence based thesaurus in a MRL and a distributional similarity method for Hebrew. |
| Outcome: | The proposed method is not optimal for modern Hebrew, the authors show . they used Hebrew WordNet as their gold standard for the analysis . |
Copied to clipboard
| Challenge: | Existing studies on unlearning in multilingual large language models focus on monolingual settings, typically English. |
| Approach: | They propose to use a multilingual data and concept unlearning model to investigate the problem . they extend benchmarks for factual knowledge and stereotypes into ten languages . |
| Outcome: | The proposed model is able to unlearning in 10 languages across five languages and resource levels. |
Copied to clipboard
| Challenge: | a new method for named entity linking is being developed in the field of public health . it uses an offline unsupervised construction of a translated dictionary and a pre-trained transformer language model to filter candidates according to context. |
| Approach: | They propose a method for mapping mentions in a source language to UMLS concepts . they extend an offline unsupervised translation of a translated UMLS dictionary . |
| Outcome: | The proposed approach achieves state-of-the-art on the Hebrew Camoni corpus and English datasets. |
Copied to clipboard
| Challenge: | a new approach to parsing morphologically rich languages (MRLs) is needed to overcome the deficiencies of current approaches. |
| Approach: | They propose a "flipped pipeline" where multiple layers are predicted independently on whole-token basis and then synthesized. |
| Outcome: | The proposed model achieves near-SOTA performance on Hebrew NLP tasks. |
Copied to clipboard
| Challenge: | Recent studies suggest that summarization in English may be solved, or even "dead" However, there are no accessible, high-quality summarizing datasets in under-represented languages. |
| Approach: | They propose a method for collecting naturally occurring summaries via front-page teasers, where editors summarize full length articles. |
| Outcome: | The proposed method is suited to varying linguistic resources and is available in seven languages. |
Copied to clipboard
| Challenge: | Foundational Hebrew NLP tasks have relied on various versions of the Hebrew Treebank . however, the data in the HTB is now over 30 years old and does not cover many aspects of contemporary Hebrew on the web. |
| Approach: | They propose to use Hebrew Wikipedia to stratify the text from a UD treebank. |
| Outcome: | The proposed treebank is based on a single-source newswire corpus selected from Hebrew Wikipedia. |
Copied to clipboard
| Challenge: | Discourse markers carry information about the discourse structure and organization, and also signal local dependencies or epistemic stance of speaker. |
| Approach: | They propose an ISO-based annotated multilingual parallel corpus for discourse markers . they propose an annotation scheme for discourse relations with a plug-in to ISO 24617-2 . |
| Outcome: | The proposed language resource is based on an ISO-based annotated multilingual parallel corpus of discourse markers. |
Copied to clipboard
| Challenge: | morphological parsers face a formidable challenge with unbalanced ambiguities in homographs . case of unbalanciated ambiguity is difficult to disambiguate, especially in cases of unbalancing . a new dataset improves the overall average F1 score for Hebrew homograph . |
| Approach: | They propose a challenge set for Hebrew homographs with substantial attestation of each analysis of 21 Hebrew homographies. |
| Outcome: | The proposed set improves the average F1 score for Hebrew homographs by 0.67 . the annotated datasets are made publicly available for further research. |
Copied to clipboard
| Challenge: | a corpus of 16th century letters from and to the Zurich reformer Heinrich Bullinger has been preserved . a recent study investigated code-switching in these 8600 letters . |
| Approach: | They investigate the automatic detection of code-switching in a 16th century letter exchange . they use a popular language identifier to bootstrap a word-based language classifier . |
| Outcome: | The proposed language classifier bootstraps with a popular identifier on a small training corpus of 150 sentences per language. |
Copied to clipboard
| Challenge: | Existing efforts to speed up constituent parsing have focused on chart-based or shift-reduce parsers. |
| Approach: | They propose to use auxiliary losses and sentence-level fine-tuning to mitigate greedy decoding issues. |
| Outcome: | The proposed model surpasses the performance of sequence tagging constituent parsers on the English and Chinese Penn Treebank datasets and reduces their parsing time even further. |
Copied to clipboard
| Challenge: | Large language models excel in various natural language tasks in English, but their performance in low-resource languages like Hebrew remains unclear. |
| Approach: | They propose a benchmark dataset specifically designed for Hebrew abstractive text summarization that combines 10,000 article-summary pairs from Hebrew news websites. |
| Outcome: | The proposed dataset shows that it presents distinct difficulties even for state-of-the-art LLMs. |
Copied to clipboard
| Challenge: | Morphologically rich languages present unique challenges to natural language processing . morphological supervision can improve the quality of multilingual language models . |
| Approach: | They propose a multilabel probing task to assess morphosyntactic representations of multilingual word embeddings. |
| Outcome: | The proposed probing task makes it easy to explore morphosyntactic representations . it also allows the study of how language models handle co-occurring features . |
Copied to clipboard
| Challenge: | Morphological Disambiguation (MD) is a task of decomposing tokens into morphemes . a simple pipeline is used to segment and tagging raw tokens . |
| Approach: | They propose a new pointer network model that combines symbolic knowledge of morphemes with the learning capacity of neural end-to-end modeling. |
| Outcome: | The proposed model outperforms all previous reported results on Hebrew and Turkish . it uses morphological knowledge and the learning capacity of neural end-to-end modeling . |
Copied to clipboard
| Challenge: | Various approaches for offensive language detection have been applied for this task . contamination of social networks with offensive content is a new reality affecting almost all of us . |
| Approach: | They propose to use multiple supervised models and text representations to detect offensive language in three languages, including two Semitic languages. |
| Outcome: | The proposed model can detect offensive content in two Semitic languages, including Hebrew and Arabic, and it is able to perform cross-lingual and multilingual learning. |
Copied to clipboard
| Challenge: | a dataset designed to evaluate long premises and complex reasoning models in Hebrew is being used in research. |
| Approach: | They introduce a dataset to evaluate Hebrew NLI models on long premises and complex reasoning tasks. |
| Outcome: | The proposed dataset evaluates models on tasks involving long premises and complex reasoning. |
Copied to clipboard
| Challenge: | Using Colibri Core to detect translation patterns in the Hebrew Bible and its Syriac source text is a promising approach, but does not allow the creation of a bilingual model. |
| Approach: | They propose to use Colibri Core to detect n-gram and skipgram patterns in the Hebrew Bible and its Syriac source text. |
| Outcome: | The proposed modeller can detect n-gram and skipgram patterns in both Hebrew and Syriac texts without the need for textual annotations. |
Copied to clipboard
| Challenge: | Existing datasets in English for textual geolocation are limited because of the location of the place is implicit. |
| Approach: | They propose to use a Hebrew place description corpus to analyze lingual geospatial reasoning. |
| Outcome: | The Hebrew Geo-Location corpus collects literal Hebrew place descriptions and analyzes lingual geospatial reasoning. |
Copied to clipboard
| Challenge: | Recent work on pretrained language models for Hebrew is under-parameterized and under-trained . previous work on pretraining Hebrew LMs focused on encoder-only architectures . |
| Approach: | They propose to use sequence-to-sequence generative architectures to train large LMs in morphologically rich languages such as Hebrew. |
| Outcome: | The proposed model improves on all existing Hebrew NLP benchmarks. |
Copied to clipboard
| Challenge: | CR methods originally designed for English struggle with Morphologically Rich Languages (MRLs) a single token in Hebrew may consist of multiple anaphors, and word/morpheme boundary discrepancies make mention detection and coreference resolution difficult in MRLs. |
| Approach: | They propose a CR dataset that identifies mentions at word, sub-word and multi-word levels and an evaluation protocol that directly addresses word/morpheme boundary discrepancies. |
| Outcome: | The proposed evaluation protocol directly addresses word/morpheme boundary discrepancies in Modern Hebrew, an MRL rich with complex words and pronominal clitics. |
Copied to clipboard
| Challenge: | A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatically sentences with high accuracy. |
| Approach: | They propose to use CLAMS to evaluate LSTM and multilingual BERT models. |
| Outcome: | The proposed model can learn syntax on English, French, German, Hebrew and Russian, and LSTM language models on multilingual and multilingual models. |
Copied to clipboard
| Challenge: | Existing NLP datasets focus on coarse-grained identity categories . existing datasets are mostly English-centric and focus on fine-grain categories based on cultural contexts. |
| Approach: | They introduce the first multilabel Hebrew corpus for social identity detection . they use Hebrew-tuned encoders alongside 2B-9B-parameter decoders . |
| Outcome: | The proposed classifier is based on a national public survey and uses Hebrew-tuned encoders to analyze political discourse and political speeches. |
Copied to clipboard
| Challenge: | a large body of work on probing has demonstrated that language model representations encode a wealth of linguistic information, but it remains unclear whether they also capture cognitive signals about human processing. |
| Approach: | They use regularized linear regression to compare language model representations against scalar predictors. |
| Outcome: | The representations from early layers outperform surprisal in predicting early-pass measures such as first fixation and gaze duration. |
Copied to clipboard
| Challenge: | Currently, studies on bias and fairness in natural language processing focus on a single language and/or across few attributes (e.g. gender, race). However, biases can manifest differently across languages for individual attributes. |
| Approach: | They adapt existing sentiment bias templates in English to Italian, Chinese, Hebrew, and Spanish for race, religion, nationality, and gender. |
| Outcome: | The proposed model favors groups that are dominant in each language's culture, indicating bias amplification, after multilingual finetuning. |
Copied to clipboard
| Challenge: | a decade has passed since the establishment of SPMRL to address the peculiar challenges of Statistical Parsing for Morphologically-rich languages (MRLs). |
| Approach: | They propose a framework for parsing MRLs and propose implementing symbolic ideas into modern neural architectures. |
| Outcome: | The proposed strategies are based on the multi-tagging task in Hebrew, a morphologically-rich, high-fusion, language. |
Copied to clipboard
| Challenge: | Existing semantic role labeling resources for Hebrew are not available in English. |
| Approach: | They propose a semantic role labeling resource for Hebrew built semi-automatically through annotation projection from English to Hebrew. |
| Outcome: | The proposed resource is built semi-automatically from an English dataset . it includes morphological analysis, dependency syntax and semantic role labeling . |
Copied to clipboard
| Challenge: | Current benchmarks for Hebrew Natural Language Processing (NLP) focus mainly on morpho-syntactic tasks, neglecting the semantic dimension of language understanding. |
| Approach: | They propose to use Hebrew machine reading comprehension (MRC) as extractive Question Answering to address this problem. |
| Outcome: | The proposed benchmark features 30,147 question-answer pairs derived from both Hebrew Wikipedia articles and Israeli tech news. |
Copied to clipboard
| Challenge: | Schwartz et al., 2017) have been using transformers for long-range tasks for NLP since the 1990s. |
| Approach: | They propose a transformer-only transformer with unlimited hidden state size that can be converted into bounded multistate RNNs by fixing the size of their hidden state. |
| Outcome: | The proposed compression policy outperforms baseline compression policies on long range tasks and LLMs. |
Copied to clipboard
| Challenge: | a strong classifier (F1 value of 0.80) is trained to predict the category of difference between word pairs as present in collated (aligned) pairs of witnesses. |
| Approach: | The project is based on the relationship between available witnesses of biblical Hebrew and a strong classifier (F1 value of 0.80) is trained to predict the category of difference between word pairs as present in collated pairs of witnesses. |
| Outcome: | The proposed model is non-neural and uses part-of-speech tags, hand-crafted rules per category and synthetically derived data. |
Copied to clipboard
| Challenge: | Using parallel treebanks, syntactic changes can be identified and evaluated in translations, redactions, and commentaries. |
| Approach: | They propose to construct a treebank of Ancient Greek containing portions of the Septuagint by word-aligning and projecting from the parallel Ancient Hebrew text. |
| Outcome: | The proposed treebank contains portions of the Hebrew Scriptures, which are translated into Ancient Greek, and is based on the results of a collaborative effort to create a crosslinguistically consistent treebank annotation scheme. |
Copied to clipboard
| Challenge: | Subword tokenizers are not effective in nonconcatenative languages such as Hebrew and Arabic, where morphology is encoded in root-template patterns, or Malay and Georgian, where split affixes are common. |
| Approach: | They propose a pre-processing step which rearranges text into a linear form that better represents nonconcatenative morphologies. |
| Outcome: | The proposed method is based on measures evaluating token vocabularies in Hebrew, Arabic, and Malay, and on BERT-architecture models trained for Hebrew. |