Neural Constituency Parsing of Speech Transcripts (N19-1)

Copied to clipboard

Challenge: a neural parser for transcribed speech can find EDITED disfluency nodes . this makes specialized mechanisms for parsing disfluencies unnecessary .
Approach: They propose a neural self-attentive parser that finds EDITED disfluency nodes in transcribed speech.
Outcome: The proposed parser finds EDITED disfluency nodes with an accuracy surpassing that of specialized systems.

Similar Papers

What’s Going On in Neural Constituency Parsers? An Analysis (N18-1)

Copied to clipboard

Challenge: a number of differences have emerged between classical and modern constituency parsing approaches . structural components like grammars and feature-rich lexicons are becoming less central . recurrent neural networks have gained traction as a powerful and general purpose tool for representation .
Approach: They propose a model that implicitly learns to encode much of the same information as grammars and lexicons in the past.
Outcome: The proposed model outperforms state-of-the-art models under similar conditions.
Improving Disfluency Detection by Self-Training a Self-Attentive Model (2020.acl-main)

Copied to clipboard

Challenge: Existing self-attentive parsers using contextualized word embeddings produce state-of-the-art results in joint parsing and disfluency detection.
Approach: They propose to use contextualized word embeddings to train a neural model using unlabeled data to train parsers.
Outcome: The proposed method produces state-of-the-art results in parsing and disfluency detection in speech transcripts.
Parsing Speech: a Neural Approach to Integrating Lexical and Acoustic-Prosodic Information (N18-1)

Copied to clipboard

Challenge: acoustic signals provide cues that help listeners disambiguate difficult parses . speech carries useful extra information associated with prosodic structure .
Approach: They propose a model that integrates transcribed text and acoustic-prosodic features into a neural network that accepts text and prosodic feature.
Outcome: The proposed model improves parse and disfluency detection scores over a strong text-only baseline.
Constituency Parsing with a Self-Attentive Encoder (P18-1)

Copied to clipboard

Challenge: Recent work on LSTM encoders based on recurrent neural networks has led to improvements in constituency parsing accuracy.
Approach: They propose to replace an LSTM encoder with a self-attentive architecture to improve a discriminative constituency parser.
Outcome: The proposed model outperforms the previous best-published results on 8 of the 9 languages in the SPMRL dataset.
Unsupervised Parsing via Constituency Tests (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for unsupervised parsing rely on constituency tests . linguists can judge a sentence's grammatical validity by modifying it via some transformation .
Approach: They propose a method for unsupervised parsing based on a constituency test . they specify a set of transformations and use an unsupervised neural acceptability model to make grammaticality decisions.
Outcome: The proposed method achieves 62.8 F1 on the Penn Treebank test set, an improvement of 7.6 points over the previous best results.
Challenges to Open-Domain Constituency Parsing (2022.findings-acl)

Copied to clipboard

Challenge: Existing findings on cross-domain constituency parsing are only made on a limited number of domains.
Approach: They manually annotate a high-quality constituency treebank containing five domains and analyze challenges to open-domain constituency parsing using a set of linguistic features.
Outcome: The proposed model significantly improves the performance of the proposed model on the domain-variant features.
Semantic Parsing of Disfluent Speech (2021.eacl-main)

Copied to clipboard

Challenge: Semantic parsing is a key component for understanding user utterances in voice assistants . however, most research on disfluent speech is focused on written text .
Approach: They investigate semantic parsing of disfluent speech with the ATIS dataset . they add real and synthetic disfluencies at training time to improve model performance .
Outcome: The proposed parser outperforms the state-of-the-art parsers on the ATIS dataset in terms of performance and accuracy.
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance (P18-1)

Copied to clipboard

Challenge: Compared to traditional shift-reduce parsing schemes, our approach is free from the potentially disastrous compounding error.
Approach: They propose a model that predicts a scalar for each split position in a sentence and then determines the topology of grammar tree based on syntactic distances.
Outcome: The proposed model achieves the state-of-the-art single model F1 score of 92.1 on PTB and 86.4 on CTB dataset, surpassing the previous single model results by a large margin.
The Limitations of Limited Context for Constituency Parsing (2021.acl-long)

Copied to clipboard

Challenge: a language model that is syntax-aware can produce better samples, authors say . a recent study shows that neural approaches to syntax can perform unsupervised syntactic parsing .
Approach: They propose to incorporate syntax into neural approaches in NLP to produce better samples . they find that the first time neural approaches were able to perform unsupervised syntactic parsing .
Outcome: The proposed models can perform unsupervised syntactic parsing, but they are lagging behind . the proposed models are based on a sandbox of probabilistic context-free-grammars .
Disfluency Detection using Auto-Correlational Neural Networks (D18-1)

Copied to clipboard

Challenge: a recent study proposes an auto-correlational neural network (ACNN) that can detect disfluency in speech . the model uses a convolutional neural system and augments it with a new auto-corrector .
Approach: They propose a convolutional neural network model that captures "rough copy" dependencies . the model is based on a new auto-correlation operator that capture the kinds of "rough copies" dependency .
Outcome: The proposed model outperforms the baseline CNN on a disfluency detection task with a 5% increase in f-score.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations