Errator: a Tool to Help Detect Annotation Errors in the Universal Dependencies Project (L18-1)
Copied to clipboard
| Challenge: | UD project aims to develop cross-linguistically consistent treebank annotations for a wide array of languages. |
| Approach: | They introduce tools that implement the annotation variation principle to help annotators find and correct errors in UD treebanks. |
| Outcome: | The proposed tools can be used to correct errors in UD treebank annotations. |
Similar Papers
Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection (2020.lrec-1)
Copied to clipboard
Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Jan Hajič, Christopher D. Manning, Sampo Pyysalo, Sebastian Schuster, Francis Tyers, Daniel Zeman
| Challenge: | Universal Dependencies is an open community effort to create cross-linguistically consistent treebank annotation for many languages. |
| Approach: | They describe version 2 of the universal guidelines and discuss major changes from UD v1 to UD 2 . they propose a morphological layer, a syntactic layer and a word segmentation layer . |
| Outcome: | The proposed treebanks are available for 90 languages and have been updated to meet the needs of multilingual parsers and researchers. |
Marking Irony Activators in a Universal Dependencies Treebank: The Case of an Italian Twitter Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing annotations for irony are difficult, and the recognition of it is difficult due to its polarity. |
| Approach: | They propose a fine-grained annotation scheme centered on irony that highlights the tokens responsible for its activation and their morpho-syntactic features. |
| Outcome: | The proposed scheme highlights the tokens responsible for irony activation and their morpho-syntactic features. |
Treebanking User-Generated Content: A Proposal for a Unified Representation in Universal Dependencies (2020.lrec-1)
Copied to clipboard
Manuela Sanguinetti, Cristina Bosco, Lauren Cassidy, Özlem Çetinoğlu, Alessandra Teresa Cignarella, Teresa Lynn, Ines Rehbein, Josef Ruppenhofer, Djamé Seddah, Amir Zeldes
| Challenge: | Despite the increasing number of contributions on Part-of-Speech tagging and parsing, automatic processing of user-generated content (UGC) still represents a challenging task. |
| Approach: | They propose a set of guidelines for the annotation of user-generated texts within the Universal Dependencies framework. |
| Outcome: | The proposed annotation guidelines promote cross-linguistic consistency, which has always been in the spirit of UD. |
How Bad are PoS Tagger in Cross-Corpora Settings? Evaluating Annotation Divergence in the UD Project. (N19-1)
Copied to clipboard
| Challenge: | Using annotation variation principles, Part-of-Speech tagging performance degrades when applied to test sentences that depart from training data. |
| Approach: | They propose to use the annotation variation principle to identify inconsistencies between annotations . they also evaluate their impact on prediction performance . |
| Outcome: | The proposed method can detect errors in gold standard annotations and improve prediction performance. |
Investigating UD Treebanks via Dataset Difficulty Measures (2023.eacl-main)
Copied to clipboard
| Challenge: | Treebanks annotated with Universal Dependencies (UD) are currently available for over 100 languages and are only partially reflected in parser evaluations via accuracy metrics like LAS. |
| Approach: | They propose to use dataset cartography, V-information, and minimum description length to analyze UD treebanks using three accuracy-free methods to provide insights about them. |
| Outcome: | The proposed methods provide insights about UD treebanks that would remain undetected if only LAS was considered. |
Cheating a Parser to Death: Data-driven Cross-Treebank Annotation Transfer (L18-1)
Copied to clipboard
| Challenge: | Using annotated corpus for linguistic purposes is no longer justified . hand-crafted syntactic resources such as grammars and lexicons can be used as sources of features to guide data driven systems. |
| Approach: | They propose an efficient method for transferring annotations between two different treebanks of the same language. |
| Outcome: | The proposed method is based on the Universal Dependency annotation scheme and was evaluated on the gold standard (94.75% of LAS, 99.40% UAS on the test set). |
Parsing Tweets into Universal Dependencies (N18-1)
Copied to clipboard
| Challenge: | a new tweet treebank for English is designed to analyze tweets with universal dependencies (UD). |
| Approach: | They extend the universal dependencies guidelines to include special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies. |
| Outcome: | The proposed method outperforms state-of-the-art parsers on other treebanks in accuracy and speed. |
A Universal Dependencies Treebank of Ancient Hebrew (2022.lrec-1)
Copied to clipboard
| Challenge: | Using a rule-based parser, we construct a treebank with morphological annotations of Ancient Hebrew . the Hebrew Scriptures are a collection of 39 books written in the first millennium BC in Ancient Hebrew. |
| Approach: | They propose to use a Universal Dependencies treebank with morphological annotations of Ancient Hebrew for comparative study with ancient translations and analysis of Hebrew syntax. |
| Outcome: | The proposed treebank can be used in comparative study with ancient translations and analysis of Hebrew syntax. |
Building a Universal Dependencies Treebank for Occitan (2020.lrec-1)
Copied to clipboard
Aleksandra Miletic, Myriam Bras, Marianne Vergez-Couret, Louise Esher, Clamença Poujade, Jean Sibille
| Challenge: | Low-resourced regional, non-official or minority languages often face lack of institutional support . low-resource languages often find themselves in a similar situation . |
| Approach: | They propose to create the first treebank for Occitan, a low-resourced regional language . they use an agile annotation approach and rely on pre-processing using existing tools . |
| Outcome: | The proposed treebank is the first for the low-resourced regional language Occitan . the project uses an agile annotation approach and automated pre-annotation . |
Sprucing up the trees – Error detection in treebanks (C18-1)
Copied to clipboard
| Challenge: | a method for detecting annotation errors in manually annotated dependency trees is presented . the method is based on ensemble parsing and Bayesian inference guided by active learning . |
| Approach: | They propose a method for detecting annotation errors in manually annotated dependency parse trees . they use ensemble parsing in combination with Bayesian inference guided by active learning . |
| Outcome: | The proposed method detects errors in annotated dependency treebanks and improves parsing accuracy on in- and out-of-domain data. |