Neural Dependency Parsing of Biomedical Text: TurkuNLP entry in the CRAFT Structural Annotation Task (D19-57)
Copied to clipboard
| Challenge: | Syntactic analysis (parsing) is a fundamental task in natural language processing (NLP). |
| Approach: | They propose to use the Turku neural parser to adapt it to the biomedical domain . they evaluated custom word embeddings, combination with other in-domain resources . |
| Outcome: | The proposed approach achieved a labeled attachment score of 89.7%, the best among task participants. |
Similar Papers
Leveraging Dependency Forest for Neural Medical Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing methods for medical relation extraction use dependency syntax as a source of features. |
| Approach: | They propose a method to extract relational information from medical literature by using dependency forests. |
| Outcome: | The proposed method outperforms the standard tree-based methods in the medical domain. |
Dependency Tree Annotation with Mechanical Turk (D19-59)
Copied to clipboard
| Challenge: | a recent study shows that crowdsourcing is often used to obtain linguistic annotations but is rarely used for parsing. |
| Approach: | They propose to use Mechanical Turk to crowdsource parse trees using an interactive graphical dependency tree editor. |
| Outcome: | The proposed method is the first published use of Mechanical Turk to crowdsource parse trees . the authors find that the workers achieve high levels of accuracy on 72% of the sentences . |
Hexatagging: Projective Dependency Parsing as Tagging (2023.acl-short)
Copied to clipboard
| Challenge: | Using a pretrained language model, we can train language models on increasingly large amounts of data. |
| Approach: | They propose a dependency parser that constructs dependency trees by tagging words with elements from a finite set of possible tags. |
| Outcome: | The proposed approach achieves state-of-the-art performance of 96.4 LAS and 97.4 UAS on the Penn Treebank test set. |
Syntactic Nuclei in Dependency Parsing – A Multilingual Exploration (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing models for syntactic dependency parsing assume words are elementary units that enter into dependency relations. |
| Approach: | They propose to use composition functions to make a transition-based dependency parser aware of the notion of nucleus. |
| Outcome: | The proposed concept of nucleus gives small but significant improvements in parsing accuracy on 12 languages. |
BioReddit: Word Embeddings for User-Generated Biomedical NLP (D19-62)
Copied to clipboard
| Challenge: | a corpus of medical-themed posts was scrapped from Reddit to train word embeddings on downstream tasks. |
| Approach: | They propose to train word embeddings from a corpus of medical forums from reddit scrapping posts from medical-themed subreddits. |
| Outcome: | The proposed system outperforms embeddings trained on general purpose data or on scientific papers when applied on user-generated content. |
Neural Ranking Models for Temporal Dependency Structure Parsing (D18-1)
Copied to clipboard
| Challenge: | a new neural temporal dependency parser is being developed for news reports and narrative stories . a similar system is used for other NLP applications such as timeline construction . |
| Approach: | They build a neural temporal dependency parser that parses time expressions and events in a text . their results shed light on the nature of temporal relation structures in different domains . |
| Outcome: | The proposed model beats baselines on news reports and narrative stories on two data domains. |
AMR dependency parsing with a typed semantic algebra (P18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) are graphs which describe the predicate-argument structure of a sentence. |
| Approach: | They propose a semantic parser which parses strings into tree representations of the compositional structure of an AMR graph. |
| Outcome: | The proposed parser outperforms baselines and standard neural techniques for supertagging and dependency tree parsing. |
Dynamic Head Selection for Neural Lexicalized Constituency Parsing (2025.acl-long)
Copied to clipboard
| Challenge: | Lexicalized parsing has traditionally been neglected in favor of unlexicalized, span-based methods. |
| Approach: | They propose a latent lexicalization framework that dynamically infers lexicals from data without relying on predefined head-finding rules. |
| Outcome: | The proposed model learns lexical dependencies directly from data, offering greater adaptability across languages and datasets. |
A Survey of Unsupervised Dependency Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Syntactic dependency parsing is an important task in natural language processing . unsupervised learning of dependency parses requires training sentences to be manually annotated with their correct parse trees. |
| Approach: | They propose to survey existing approaches to unsupervised dependency parsing . they identify two major classes of approaches and discuss recent trends . |
| Outcome: | The proposed methods can be used in semantic parsing, machine translation, relation extraction, and many other tasks. |
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples (2021.findings-acl)
Copied to clipboard
| Challenge: | Neural network-based models have been successful in a wide range of NLP tasks, but their performance is undermined by adversarial examples that would pose no confusion for humans. |
| Approach: | They propose a method to generate high-quality adversarial examples with a higher number of candidate generators and stricter filters and then verify their quality using automatic and human evaluations. |
| Outcome: | The proposed method improves the robustness of English parsing models by relying on adversarial training and model ensembling. |