Neural Combinatory Constituency Parsing (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches to constituency parsing are based on symbolic engineering, but they are simplified by their adaptive distributed representation.
Approach: They propose two fast combinatory models for constituency parsing: binary and multibranching.
Outcome: The proposed models achieve an F1 score of 92.54 on Penn Treebank, speeding at 1327.2 sents/sec.

Similar Papers

Discontinuous Combinatory Constituency Parsing (2023.tacl-1)

Copied to clipboard

Challenge: Discontinuous parsing is more challenging than continuous parsers because children can group with syntactic cousins in the sentence rather than its two adjacent neighbors.
Approach: They extend a pair of combinator-based constituency parsers into a discontinuous pair . they use a swap action and biaffine attention to iteratively compose constituent vectors from word embeddings without any grammar constraints.
Outcome: The proposed parsers achieve state-of-the-art discontinuous accuracy with a significant speed advantage over continuous parsing.
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance (P18-1)

Copied to clipboard

Challenge: Compared to traditional shift-reduce parsing schemes, our approach is free from the potentially disastrous compounding error.
Approach: They propose a model that predicts a scalar for each split position in a sentence and then determines the topology of grammar tree based on syntactic distances.
Outcome: The proposed model achieves the state-of-the-art single model F1 score of 92.1 on PTB and 86.4 on CTB dataset, surpassing the previous single model results by a large margin.
What’s Going On in Neural Constituency Parsers? An Analysis (N18-1)

Copied to clipboard

Challenge: a number of differences have emerged between classical and modern constituency parsing approaches . structural components like grammars and feature-rich lexicons are becoming less central . recurrent neural networks have gained traction as a powerful and general purpose tool for representation .
Approach: They propose a model that implicitly learns to encode much of the same information as grammars and lexicons in the past.
Outcome: The proposed model outperforms state-of-the-art models under similar conditions.
Cross-Domain Generalization of Neural Constituency Parsers (P19-1)

Copied to clipboard

Challenge: Neural parsers perform well on in-domain benchmarks, but their performance degrades in well-understood ways.
Approach: They analyze generalization on English and Chinese corpora to see if they can generalize to other domains.
Outcome: The proposed neural parsers perform better on in-domain benchmarks than on out-of-domain corpora.
Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference (2020.acl-main)

Copied to clipboard

Challenge: Using custom architectures, constituency parsers are limited and require specialized hardware.
Approach: They propose an algorithm that assigns labels to each word in a sentence in parallel and then performs a reconciliation phase to extract a tree in (empirically) linear time.
Outcome: The proposed model achieves 95.4 F1 on the WSJ test set while also achieving substantial speedups compared to current state-of-the-art parsers with comparable accuracies.
Unsupervised Parsing via Constituency Tests (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for unsupervised parsing rely on constituency tests . linguists can judge a sentence's grammatical validity by modifying it via some transformation .
Approach: They propose a method for unsupervised parsing based on a constituency test . they specify a set of transformations and use an unsupervised neural acceptability model to make grammaticality decisions.
Outcome: The proposed method achieves 62.8 F1 on the Penn Treebank test set, an improvement of 7.6 points over the previous best results.
Dynamic Head Selection for Neural Lexicalized Constituency Parsing (2025.acl-long)

Copied to clipboard

Challenge: Lexicalized parsing has traditionally been neglected in favor of unlexicalized, span-based methods.
Approach: They propose a latent lexicalization framework that dynamically infers lexicals from data without relying on predefined head-finding rules.
Outcome: The proposed model learns lexical dependencies directly from data, offering greater adaptability across languages and datasets.
Revisiting the Practical Effectiveness of Constituency Parse Extraction from Pre-trained Language Models (2022.coling-1)

Copied to clipboard

Challenge: Constituency Parse Extraction from Pre-trained Language Models (CPE-PLM) is a new paradigm that attempts to induce constituency parse trees based on the internal knowledge of pre-tried language models.
Approach: They propose to use constituency parse trees from pre-trained language models to induce constituency trees by introducing a set of heterogeneous PLMs combined using two advanced ensemble methods.
Outcome: The proposed approach is more effective than typical supervised parsers in few-shot settings.
Parsing Headed Constituencies (2024.lrec-main)

Copied to clipboard

Challenge: Using constituency and dependency trees, syntactic representations are preferred for tasks such as nominal phrase extraction and identification of terminology.
Approach: They propose a parsing technique that generates headed constituency trees which combine information typically contained in constituency and dependency trees.
Outcome: The proposed method generates headed constituency trees with discontinuities and can generate constituency tree with discontinuity.
Efficient Constituency Parsing by Pointing (2020.acl-main)

Copied to clipboard

Challenge: Constituency parsing is a core task in natural language processing (NLP) Existing methods for constituency paring are greedy transition-based or globally optimized.
Approach: They propose a constituency parsing model that casts the problem into a series of pointing tasks.
Outcome: The proposed model achieves 92.78 F1 without pre-trained models, which is faster than existing models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations