Normalizing without Modernizing: Keeping Historical Wordforms of Middle French while Reducing Spelling Variants (2024.findings-naacl)
Copied to clipboard
| Challenge: | a new method to normalize orthographic variations of historical documents is needed for digital humanities and diachronic studies. |
| Approach: | They propose to normalize orthographic wordforms found in Middle French archives . authors say it improves accuracy and accuracy over a strong baseline . |
| Outcome: | The proposed methods normalize orthographic variations of historical documents without modernizing them. |
Similar Papers
Semi-supervised Contextual Historical Text Normalization (2020.acl-main)
Copied to clipboard
| Challenge: | Historical text normalization is the task of mapping historical word forms to their modern counterparts. |
| Approach: | They propose to use a generative normalization model to obtain contextualization from the target-side language model. |
| Outcome: | et al., 2018) show that the most effective approach reduces manual normalization time and manual training costs. |
From FreEM to D’AlemBERT: a Large Corpus and a Language Model for Early Modern French (2022.lrec-1)
Copied to clipboard
Simon Gabay, Pedro Ortiz Suarez, Alexandre Bartz, Alix Chagué, Rachel Bawden, Philippe Gambette, Benoît Sagot
| Challenge: | Anguage models for historical states of language are becoming more complex to process and more scarce in the corpora available. |
| Approach: | They propose to use a contextualised language model to analyse historical states of language in French. |
| Outcome: | The proposed model is based on a corpus of historical texts and is evaluated with an NLP task. |
A Large-Scale Comparison of Historical Text Normalization Systems (N19-1)
Copied to clipboard
| Challenge: | a large study of historical text normalization is done on eight languages . there is no consensus on the state-of-the-art approach to normalization . |
| Approach: | They present a large study of historical text normalization done on eight languages . they evaluate four different systems based on supervised learning on datasets from eight different languages based in the literature . |
| Outcome: | The proposed methods are based on supervised learning and are available online. |
OFrLex: A Computational Morphological and Syntactic Lexicon for Old French (2020.lrec-1)
Copied to clipboard
| Challenge: | Using heterogeneous language resources, we extract structured and exploitable information from a large-coverage morphological and syntactic Old French lexicon. |
| Approach: | They propose to use a large-coverage morphological and syntactic Old French lexicon to extract structured and exploitable information from heterogeneous language resources. |
| Outcome: | The proposed extension technique will be validated manually in the near future and take advantage of OFrLex’s viewing, searching and editing interface. |
A Workflow for HTR-Postprocessing, Labeling and Classifying Diachronic and Regional Variation in Pre-Modern Slavic Texts (2024.lrec-main)
Copied to clipboard
Piroska Lendvai, Maarten van Gompel, Anna Jouravel, Elena Renje, Uwe Reichel, Achim Rabus, Eckhart Arnold
| Challenge: | a workflow for classifying diachronic and regional language variation in medieval texts is currently being developed . the workflow is generic or language-agnostic, but can be applied to other historical languages as well. |
| Approach: | They propose a workflow for classifying diachronic and regional language variation in medieval texts . they use handwritten text recognition and manual transcription to obtain the data . |
| Outcome: | The proposed workflow covers HTR-postprocessing, annotating and classifying medieval texts . it is accessible to humanists with limited experience in research data infrastructures, analysis or NLP . |
Evaluating Historical Text Normalization Systems: How Well Do They Generalize? (N18-2)
Copied to clipboard
| Challenge: | Historical text normalization systems aim to convert historical wordforms to their modern equivalents . many of these systems have been developed and tested on a single language . |
| Approach: | They propose to use a nave baseline system to evaluate historical text normalization systems . they show that the models generalize well to unseen words in tests on five languages . |
| Outcome: | The proposed models generalize well to unseen words on five languages, but provide no clear benefit over the nave baseline. |
Text Normalization Infrastructure that Scales to Hundreds of Language Varieties (L18-1)
Copied to clipboard
| Challenge: | a multi-language text normalization infrastructure is used to train language models for keyboards and speech recognition systems. |
| Approach: | They describe a multi-language text normalization infrastructure that prepares textual data to train language models used in Google's keyboards and speech recognition systems. |
| Outcome: | The proposed system can normalize training data across hundreds of languages . it can detect errors in training data and detect corruption issues . |
Normalising Non-standardised Orthography in Algerian Code-switched User-generated Data (D19-55)
Copied to clipboard
| Challenge: | a new corpus of unstructured data from social media is presenting challenges to NLP research . standardisation is neither natural nor universal, it is rather a human invention. |
| Approach: | They compile a parallel corpus of Arabic textual data matched with human annotations . they use a deep neural model designed to deal with context-dependent spelling correction . |
| Outcome: | The proposed model performs best with two CNN sub-network encoders and an LSTM decoder . pre-processing data token-by-token with edit-distance aligner significantly improves performance . |
A Data-driven Approach to Named Entity Recognition for Early Modern French (2022.coling-1)
Copied to clipboard
| Challenge: | Named entity recognition is an important task in natural language processing. |
| Approach: | They propose to use a data-driven approach to identify historical French with fine-grained annotations instead of a specialised architecture to tackle particularities. |
| Outcome: | The proposed corpus is larger than the most popular NER evaluation corpora for both Contemporary English and French. |
BERTrade: Using Contextual Embeddings to Parse Old French (2022.lrec-1)
Copied to clipboard
| Challenge: | a growing interest in digital humanities for automatic processing and annotation of historical texts is generating new models for historical languages. |
| Approach: | They use POS-tagging and dependency parsing to evaluate contextual word embedding models . Old French is one of the historical languages for which they have the largest amount of syntactically annotated data . |
| Outcome: | The proposed model can be used to improve performance in Old French, the authors show . they use POS-tagging and dependency parsing to evaluate the model's quality . |