Papers with parsers
Copied to clipboard
| Challenge: | Existing methods for negation scope resolution without syntactic structure performed better. |
| Approach: | They re-evaluate the effectiveness of syntactic structure in negation scope resolution . they replace the parser employed in previous studies with state-of-the-art parsers . |
| Outcome: | The proposed method performs better without syntactic structure than previous methods . the proposed method is comparable to state-of-the-art methods based on heuristic rules . |
Copied to clipboard
| Challenge: | a recent study shows transformer-based parsers struggle with disambiguating intents/slots and producing syntactically valid frames. |
| Approach: | They propose to use seq2seq transformers to map textual utterances to semantic frames . they propose to model transformer-based parsers across monolingual and multilingual settings . |
| Outcome: | The proposed parsers struggle with disambiguating intents/slots and produce syntactically valid frames. |
Copied to clipboard
| Challenge: | RNGTr is a non-recursive Graph-to-Graph Transformer for iterative refinement of graphs . it can improve the accuracy of initial parsers on 13 languages . |
| Approach: | They propose a recursive non-autoregressive Graph-to-Graph Transformer architecture for iterative refinement of arbitrary graphs and apply it to syntactic dependency parsing. |
| Outcome: | The proposed architecture can improve state-of-the-art on 13 languages and the German CoNLL2009 corpus. |
Copied to clipboard
| Challenge: | Compchains are a categorization of the hierarchy of predicate dependency relations present within a UD parse. |
| Approach: | They introduce compchains, a categorization of the hierarchy of predicate dependency relations present within a UD parse. |
| Outcome: | The proposed model performs poorly on sentences with predicate-argument structure with more than one level of embedding. |
Copied to clipboard
| Challenge: | Semantic parsers are used to convert user’s natural language commands to executable logical form in intelligent personal agents. Labeled datasets required to train such parser are expensive to collect, and are never comprehensive. |
| Approach: | They propose to use a sequence-to-sequence/tree attention based attention-based sequence-based parsers which support fast near real time retraining. |
| Outcome: | The proposed parsers can maintain high accuracy and fast retraining time while leveraging paraphrases already present in the training dataset. |
Copied to clipboard
| Challenge: | Existing findings on cross-domain constituency parsing are only made on a limited number of domains. |
| Approach: | They manually annotate a high-quality constituency treebank containing five domains and analyze challenges to open-domain constituency parsing using a set of linguistic features. |
| Outcome: | The proposed model significantly improves the performance of the proposed model on the domain-variant features. |
Copied to clipboard
| Challenge: | Existing non-neural dependency parsers benefit from information coming from structural features . however, their successors lack explicit information about the structural context . |
| Approach: | They propose to model the structural context of a biLSTM-based dependency parser with features built from partial subtrees. |
| Outcome: | The proposed models do not use any conventional structural features but capture implicitly the structural context. |
Copied to clipboard
| Challenge: | Existing methods for Combinatory Categorial Grammar (CCG) parsing are limited to a specific parser architecture, making it non-trivial to apply to current parsers. |
| Approach: | They propose a domain adaptation method for Combinatory Categorial Grammar (CCG) they propose to generate CCG corpora using cheaper dependency trees. |
| Outcome: | The proposed method improves on speech conversation and math problems. |
Copied to clipboard
| Challenge: | Existing sentiment analysis models lack temporal information to capture semantics of long texts. |
| Approach: | They propose a framework to exploit task-related discourse structures for sentiment analysis. |
| Outcome: | The proposed framework improves the performance even beyond existing approaches based on human annotated data. |
Copied to clipboard
| Challenge: | Discontinuous parsing is more challenging than continuous parsers because children can group with syntactic cousins in the sentence rather than its two adjacent neighbors. |
| Approach: | They extend a pair of combinator-based constituency parsers into a discontinuous pair . they use a swap action and biaffine attention to iteratively compose constituent vectors from word embeddings without any grammar constraints. |
| Outcome: | The proposed parsers achieve state-of-the-art discontinuous accuracy with a significant speed advantage over continuous parsing. |
Copied to clipboard
| Challenge: | Incremental NLP aims to learn and adapt partial representations as information unfolds, but studies on incremental approaches have focused on non-incremental approaches. |
| Approach: | They build incremental constituent parsers that adhere to a strong definition of incrementality across languages and compare them against non-incremental and partially incremental models. |
| Outcome: | The proposed models are compared against non-incremental and partially incremental models. |
Copied to clipboard
| Challenge: | Existing methods for extracting complete (binary) parses from pre-trained language models are expensive and time-consuming. |
| Approach: | They propose a chart-based method and an effective top-K ensemble technique to extractbinary parses from PLMs. |
| Outcome: | The proposed method can induce non-trivial parses for sentences from nine languages in an integrated and language-agnostic manner, and is robust to cross-lingual transfer. |
Copied to clipboard
| Challenge: | Abstract Meaning Representation (S3BERT) embeddings are composed of explainable sub-embeddings that emphasize various sentence meaning features. |
| Approach: | They propose to induce Semantically Structured Sentence BERT embeddings (S3BERT) that emphasize various sentence meaning features. |
| Outcome: | The proposed model shows high correlation to human similarity ratings, but lacks interpretability. |
Copied to clipboard
| Challenge: | Existing document embedding approaches focus on capturing sequences of words in documents . however, some document classification and regression tasks need to consider discourse structure of text . |
| Approach: | They propose an unsupervised approach to capture discourse structure in terms of coherence and cohesion for document embedding that does not require expensive parsers or annotation. |
| Outcome: | The proposed method improves essay Organization scoring and Argument Strength scoring. |
Copied to clipboard
| Challenge: | Semantic parsers are mostly designed for and evaluated on English resources, such as CFQ. |
| Approach: | They propose a method for creating a multilingual, parallel question-query dataset . they analyze compositional generalization of parsers in Hebrew, Kannada, Chinese, and English . |
| Outcome: | The proposed method analyzes compositional generalization of parsers in Hebrew, Kannada, Chinese, and English. |
Copied to clipboard
| Challenge: | Existing dependency treebanks for learner writing are limited due to morphosyntactic features. |
| Approach: | They propose to use a dependency treebank for Spanish learner writing from the UC Davis COWSL2H corpus to incorporate lemmatization, POS tagging, and syntactic dependencies. |
| Outcome: | The proposed treebanks are openly accessible to motivate future development of learner-oriented language technologies. |
Copied to clipboard
| Challenge: | Existing graph-based dependency parsers use a standard two-pipeline approach that only scores arcs and labels . |
| Approach: | They propose a graph-based dependency parsing architecture that explicitly constructs vectors from which both arcs and labels are scored. |
| Outcome: | The proposed model outperforms state-of-the-art models on PTB and UD in accuracy and efficiency. |
Copied to clipboard
| Challenge: | Non-projective dependency trees account for 12.59% of all training sentences in the annotated Universal Dependencies (UD) 2.1 data. |
| Approach: | They generalize Cohen et al.'s (2011) parser to a family of non-projective transition-based dependency parsers allowing polynomial-time exact inference. |
| Outcome: | The proposed system can be extended to include a variant that reduces time complexity to O(n6), improving over the known bounds in exact inference for non-projective transition-based parsing. |
Copied to clipboard
| Challenge: | Existing models for constituency parsing are transition based, decomposing production of each parse tree into a sequence of action decisions. |
| Approach: | They propose to use a policy gradient method to reduce exposure bias by allowing exploration during training. |
| Outcome: | The proposed method outperforms static oracle likelihood training on four constituency parsers in three languages on four parser-agnostic languages. |
Copied to clipboard
| Challenge: | Question Under Discussion (QUD) uses implicit questions to reveal discourse relationships between sentences. |
| Approach: | They propose a framework that selectively decodes the QUD dependency structures considering the QUC criteria. |
| Outcome: | The proposed framework outperforms the state-of-the-art baseline models by 9% in human evaluation and 4% in automatic evaluation. |
Copied to clipboard
| Challenge: | Existing work on dependency parsing by sequence labeling suggested that it was impractical. |
| Approach: | They propose to use dependency trees as sequence labels to obtain fast and accurate parsers using a conventional BILSTM-based model. |
| Outcome: | The proposed models are conceptually simple, not needing traditional parsing algorithms or auxiliary structures, and provide a good speed-accuracy tradeoff, with results competitive with more complex approaches. |
Copied to clipboard
| Challenge: | incorporating structure information can enhance the performance of aspect-based sentiment analysis. |
| Approach: | They propose to use pre-trained language models to induct latent structures from a spectrum perspective. |
| Outcome: | The proposed model shortens Aspects-sentiment Distance and improves structure induction ability. |
Copied to clipboard
| Challenge: | Contemporary multilingual dependency parsers can parse a diverse set of languages, but performance is lower for Morphologically Rich Languages. |
| Approach: | They propose a joint neural architecture where a lattice-based representation is provided to an arc-factored model and solves the morphological segmentation and syntactic parsing tasks at once. |
| Outcome: | The proposed architecture is language-agnostic and language-based to improve on Hebrew . it shows that the proposed model can parse morphological segmentation and syntactic parsing tasks at once. |
Copied to clipboard
| Challenge: | Numerous parsing methods have been developed for a single sentence, while a typical human-computer interaction session or conversation is not singleturn. |
| Approach: | They propose to modify an existing scene graph given a new user's command by using graph-based sparse transformer and cross attention information fusion to improve performance. |
| Outcome: | The proposed models outperform previous systems adapted from the machine translation and graph generation literature and contribute to the research community. |
Copied to clipboard
| Challenge: | a new tweet treebank for English is designed to analyze tweets with universal dependencies (UD). |
| Approach: | They extend the universal dependencies guidelines to include special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies. |
| Outcome: | The proposed method outperforms state-of-the-art parsers on other treebanks in accuracy and speed. |
Copied to clipboard
| Challenge: | Existing approaches to parsing are greedy transition-based and globally optimized . however, the decision-making process is based on local information, causing error propagation to subsequent steps. |
| Approach: | They propose hierarchical pointer network parsers and apply them to dependency and sentence-level discourse parsing tasks. |
| Outcome: | The proposed method outperforms existing methods and sets new state-of-the-art methods on benchmark datasets. |
Copied to clipboard
| Challenge: | Recent years pretrained language models (PLMs) have shown their power on modeling language . however, few efforts have been made to explore grounding capabilities of PLMs . |
| Approach: | They propose to use pretrained language models to explore syntactic structures . they propose to combine their approach with an erasingthen-awakening approach . their results show that the approach can awaken latent grounding, which is understandable to humans . |
| Outcome: | Empirical studies show that the proposed approach can awaken latent grounding . it shows great potential to benefit downstream semantic parsing models, it says . |
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) research has focused on English . Qualitative analysis shows that the new parsers overcome structural differences between the languages. |
| Approach: | They propose to use an AMR parser for English and parallel corpora to learn AMR for Italian, Spanish, German and Chinese. |
| Outcome: | The proposed method overcomes structural differences between the target languages and requires no gold standard data. |
Copied to clipboard
| Challenge: | a new approach to parsing discontinuous constituency structures uses supertags to improve parsability . traditional approaches use grammar formalisms to model hierarchies of noncontiguous phrases . but supertags are still useful for analyzing these grammars and parsers . |
| Approach: | They propose to reformulate and parameterize extraction process for LCFRS supertags to improve parsing quality. |
| Outcome: | The proposed method improves the quality and speed of parsing with supertags over the previous method. |
Copied to clipboard
| Challenge: | Sentences with gapping lack an overt predicate to indicate the relation between two or more arguments. |
| Approach: | They propose two methods for parsing to a Universal Dependencies graph representation that explicitly encodes the elided material with additional nodes and edges. |
| Outcome: | The proposed methods reconstruct elided material from dependency trees with high accuracy when the parser correctly predicts the existence of a gap. |
Copied to clipboard
| Challenge: | Existing approaches to learn latent structure are limited by factorization assumptions or end-to-end differentiability. |
| Approach: | They propose a method that allows for end-to-end learning of latent structure predictors jointly with a downstream predictor. |
| Outcome: | The proposed method allows for unrestricted dynamic graph construction from the global latent structure while maintaining differentiability. |
Copied to clipboard
| Challenge: | Statistical parsers are often criticized for their performance outside of the domain they were trained on . we show that word representations reduce the need for domain adaptation when the target domain is syntactically similar to the source domain. |
| Approach: | They propose a way to adapt a parser to a syntactically similar target domain using partial annotations. |
| Outcome: | The proposed model increases the accuracy of a parser on the Wall Street Journal by 1.7% over the previous state-of-the-art model. |
Copied to clipboard
| Challenge: | Existing semantic parsers are not accurate enough for use in text-to-SQL parsing tasks. |
| Approach: | They propose to build clause-level edit models to correct SQL queries instead of token-level ones. |
| Outcome: | The proposed model improves the exact set match accuracy of different parsers by 2.4-6.5 and obtains up to 4.3 point absolute improvement over two strong baselines. |
Copied to clipboard
| Challenge: | Incorporating syntactic information in machine translation can lead to better reorderings, especially useful when the language pairs are syntaktically highly divergent. |
| Approach: | They propose a forest-to-sequence NMT model which uses exponentially many parse trees of the source sentence to compensate for parser errors. |
| Outcome: | The proposed model outperforms the sequence-to-sequence and tree-to tree-based models on English, Chinese and Farsi translation tasks. |
Copied to clipboard
| Challenge: | Existing discourse annotations are limited and annotated data scarcity has hindered progress in discourse parsing. |
| Approach: | They propose a framework for augmenting discourse-annotated corpora via speaker stylistic transfer using Large Language Models (LLMs). |
| Outcome: | The proposed framework outperforms parsers trained on STAC and Molweni corpora on a multi-party dialogue with consistent gains for underrepresented discourse patterns and in low-resource scenarios. |
Copied to clipboard
| Challenge: | linguistic differences between English pronouns that are not inherently biased can become biases in some machine learning models. |
| Approach: | They propose a method to detect bias by alternating pronouns in different contexts. |
| Outcome: | The proposed method can be used to detect bias in language models and for text generation more broadly. |
Copied to clipboard
| Challenge: | Symbolic meaning representations of natural language text have been studied since at least the 1960s . with the availability of large annotated corpora, the field has recently seen several new developments . |
| Approach: | They propose a framework for expressing meaning in natural language text using annotated corpora and a set of tools for machine learning. |
| Outcome: | The frameworks are based on a set of theoretical and practical problems and their applications. |
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction are unreliable when processing ungrammatically . a new approach is proposed that incorporates dependency syntactic information into the encoder part of GEC models. |
| Approach: | They propose a syntax-enhanced grammatical error correction approach called SynGEC that incorporates dependency syntactic information into the encoder part of GEC models. |
| Outcome: | The proposed approach outperforms strong baselines and achieves competitive performance on mainstream English and Chinese GEC datasets. |
Copied to clipboard
| Challenge: | Experimental results show that LLMs with tens of billion parameters can perform discourse parsing tasks. |
| Approach: | They employ Llama 2 and fine-tune it with QLoRA to achieve similar results . they show that LLMs with tens of billion parameters can perform a wide range of NLP tasks . |
| Outcome: | The proposed model performs better than existing models on three benchmark datasets. |
Copied to clipboard
| Challenge: | Currently, computational tools for low-resource languages are limited by a lack of supervised training data. |
| Approach: | They propose to use English taggers and parsers to project morphological information onto translations of the Bible in 26 different test languages. |
| Outcome: | The proposed method reduces lemmatization and morphological analysis over a strong initial system. |
Copied to clipboard
| Challenge: | Existing representation models for text classification learn little structure information or rely on pre-defined structures. |
| Approach: | They propose a sandwich neural network to learn local semantic and global structure representations without relying on parsers. |
| Outcome: | The proposed approach achieves competitive performance on several text classification tasks. |
Copied to clipboard
| Challenge: | Text-to-SQL parsers are crucial in enabling non-experts to effortlessly query relational data. |
| Approach: | They propose a weak supervision approach for training text-to-SQL parsers by using a question meaning representation called QDMR to synthesize SQL queries from annotated NL-SqL data. |
| Outcome: | The proposed model performs competitively with those trained on annotated NL-SQL data. |
Copied to clipboard
| Challenge: | arc-eager parsers are often driven by a classifier that determines the next step given features extracted from the current configuration. |
| Approach: | They propose to calculate the optimal next step of an arc-eager parser relative to a non-projective dependency structure in cubic time. |
| Outcome: | The proposed method can be used to train dependency parsers on configurations that correspond to 'gold' trees from a treebank. |
Copied to clipboard
| Challenge: | a high annotation cost for dependency parsers is a challenge . batch active learning (AL) is based on batch mode, which is more efficient for annotators to label in bulk. |
| Approach: | They propose to reduce the number of labeled examples needed to train a strong dependency parser using batch active learning. |
| Outcome: | The proposed approach improves on an English newswire corpus by enforcing diversity in the sampled batches. |
Copied to clipboard
| Challenge: | Recent work on aspect-level sentiment classification has shown that syntactic information is effective in capturing long-range syntaktic relations that are obscure from the surface form. |
| Approach: | They propose a graph ensemble technique that integrates syntactic structures with GNNs to better leverage syntaktic information in the face of parsing errors. |
| Outcome: | The proposed model outperforms models with single dependency tree and beats other models without adding model parameters. |
Copied to clipboard
| Challenge: | Modern Hebrew lacks lexical resources fundamental to many natural language processing tools. |
| Approach: | They propose a method for generating a cooccurrence based thesaurus in a MRL and a distributional similarity method for Hebrew. |
| Outcome: | The proposed method is not optimal for modern Hebrew, the authors show . they used Hebrew WordNet as their gold standard for the analysis . |
Copied to clipboard
| Challenge: | Existing approaches to RST parsing use discriminative models, but these are less sample efficient and datasets are typically small. |
| Approach: | They propose a document-level RNN grammar with a bottom-up traversal order and a beam search algorithm that keeps track of both structure-and word-generating actions without exhibit-ing this branching bias. |
| Outcome: | The proposed model outperforms a discriminative model with the same features by 2.6 F1points and achieves comparable performance to the state-of-the-art. |
Copied to clipboard
| Challenge: | Discourse parsing is a fundamental NLP task known to enhance key downstream tasks, such as sentiment analysis, text classification and summarization. |
| Approach: | They propose a method that uses document supervision to generate abundant data for RST-style discourse structure prediction by using an optimal CKY-style tree generation algorithm. |
| Outcome: | The proposed approach performs well on the more difficult task of inter-domain discourse structure prediction, but it does not match the performance of a parser trained and tested on the same dataset. |
Copied to clipboard
| Challenge: | Continual Semantic Parsing (CSP) enables parsers to generate SQL from natural language questions in task streams, using minimal annotated data to handle dynamically evolving databases in real-world scenarios. |
| Approach: | They propose a Adaptive PET eXpert meta-learning approach that assists experts in adaptively warming up, ensuring better model initialization. |
| Outcome: | The proposed method outperforms existing methods on two benchmarks and achieves superior performance without data replay or ideal settings. |
Copied to clipboard
| Challenge: | SSPR is a Python 3.5 application based on the Microsoft Cognitive Toolkit 2.0 Python API. |
| Approach: | a Python 3.5 application is based on the Microsoft Cognitive Toolkit 2.0 Python API. |
| Outcome: | SSPR outperforms the best individual parser at the CONLL 2017 dependency parsing shared task. |
Copied to clipboard
| Challenge: | Existing parsers that capture dependency graphs are lacking in capturing explicit dependencies . graph-based parsing is a popular choice for capturing dependency relationships between words . |
| Approach: | They propose a semi-autoregressive dependency parser that generates dependency graphs by adding nodes and edge groups autoregressively while pouring out all group elements in parallel. |
| Outcome: | The proposed method outperforms baselines on Enhanced Universal Dependencies of multiple languages. |
Copied to clipboard
| Challenge: | Syntactic parsing improves the quality of natural language processing tasks. |
| Approach: | They evaluated Vietnamese Treebank model to find most suitable parsing method . they found that Vietnamese parsers produced limited training data and POS errors . |
| Outcome: | The proposed method improves the parsing quality in Vietnamese . the results highlight three possible sources of parser errors . |
Copied to clipboard
| Challenge: | Experimental results show that our AMR aligner outperforms the rule-based aligner by achieving higher alignment F1 score and consistently improving two open-source AMR parsers. |
| Approach: | They propose a rich resource enhanced AMR aligner which produces multiple alignments and a new transition system for AMR parsing along with its oracle parser. |
| Outcome: | The proposed AMR aligner outperforms the current state-of-the-art parser by achieving higher alignment F1 score and consistently improving two open-source AMR parsers. |
Copied to clipboard
| Challenge: | a new approach to parsing morphologically rich languages (MRLs) is needed to overcome the deficiencies of current approaches. |
| Approach: | They propose a "flipped pipeline" where multiple layers are predicted independently on whole-token basis and then synthesized. |
| Outcome: | The proposed model achieves near-SOTA performance on Hebrew NLP tasks. |
Copied to clipboard
| Challenge: | Recent trend for dependency parsing is adopting neural networks due to their significant success in a wide range of applications. |
| Approach: | They propose a sequence to sequence (seq2seque) dependency parser that predicts the relative position of head for each word. |
| Outcome: | The proposed parser achieves 94.11% UAS on PTB and 88.78% UAS . |
Copied to clipboard
| Challenge: | In recent years, dependency parsing has shifted from discrete features to neural networks and continuous representations. |
| Approach: | They propose to use deep contextualized word embeddings to pack information about global sentence structure into local feature representations to make the two approaches virtually equivalent in terms of accuracy and error profile. |
| Outcome: | The proposed model improves the accuracy and error profile of transition-based and graph-based dependency parsers on 13 languages. |
Copied to clipboard
| Challenge: | a neural parser for transcribed speech can find EDITED disfluency nodes . this makes specialized mechanisms for parsing disfluencies unnecessary . |
| Approach: | They propose a neural self-attentive parser that finds EDITED disfluency nodes in transcribed speech. |
| Outcome: | The proposed parser finds EDITED disfluency nodes with an accuracy surpassing that of specialized systems. |
Copied to clipboard
| Challenge: | Existing models rely on rich representations of dialogue history that include all previously generated components of the output. |
| Approach: | They propose a model that abstracts over values to focus prediction on type- and function-level context. |
| Outcome: | The proposed model outperforms baseline models by 7.3% and 10.6% on SMCalFlow and TreeDST datasets. |
Copied to clipboard
| Challenge: | a novel chart-based method for extracting parse trees from masked language models is proposed . a graph-based approach can be used to extract parser trees without training separate parsers . |
| Approach: | They propose a chart-based method for extracting parse trees from masked language models . they use a set of perturbations motivated by the linguistic concept of constituency tests to score each span . |
| Outcome: | The proposed method outperforms state-of-the-art methods on english with masked LMs and in multilingual settings. |
Copied to clipboard
| Challenge: | a new method for parsing sentences using captioned videos is being developed . we use video clips to ground the semantics of language, but without annotations . |
| Approach: | They develop a semantic parser that is trained in a grounded setting using captioned videos . they use a corpus of sentences paired with videos without other annotations to train it . |
| Outcome: | The proposed parser recovers the meaning of English sentences despite no annotations . learning a grounded semantic parsers can expand the range of data that parseurs can be trained on . |
Copied to clipboard
| Challenge: | ellipsis is a phenomenon present in many natural languages, but it complicates syntactic parsing of the content that is not omitted. |
| Approach: | They analyze outputs of state-of-the-art parsers to learn about parsing accuracy and typical errors from the perspective of elliptical constructions. |
| Outcome: | The proposed treebank is a semi-artificially constructed treebank of ellipsis. |
Copied to clipboard
| Challenge: | Existing query parsers that account for the unique grammar of web queries rely on resources not available outside of big web corporations. |
| Approach: | They propose a biLSTM query parser that explicitly accounts for the unique grammar of queries. |
| Outcome: | The proposed query parser outperforms existing state-of-the-art parsers on 2500 annotated queries. |
Copied to clipboard
| Challenge: | Semantic parsing maps natural language (NL) utterances into logical forms (LFs) adversarial examples are created by adding tiny perturbations to inputs but can severely deteriorate model performance. |
| Approach: | They propose to construct robustness test sets based on existing benchmark corpora and to evaluate the effect of data augmentation. |
| Outcome: | The proposed method measures the performance of the proposed parsers on robustness test sets and evaluates the effect of data augmentation. |
Copied to clipboard
| Challenge: | Existing top-down discourse rhetorical structure parsers make local decisions and ignore global parsing. |
| Approach: | They propose a method to transform gold standard and predicted constituency trees into tree diagrams with two color channels. |
| Outcome: | The proposed method improves performance on RST-DT and CDTB corpora and can leverage global context. |
Copied to clipboard
| Challenge: | Existing methods for continual learning for semantic parsing fail to account for special properties of structured outputs . retraining from scratch is not feasible due to the fast growing number of tasks . |
| Approach: | They propose a continual learning method that uses sequential learning to learn tasks without accessing full training data from previous tasks. |
| Outcome: | The proposed method achieves a 3-6 times speedup compared to re-training from scratch. |
Copied to clipboard
| Challenge: | Using automated analysis of connected speech is a promising direction for diagnosing cognitive impairments. |
| Approach: | They propose to use a novel model to segment impaired speech transcriptions . they propose to include a Linear Chain CRF and a self-attention mechanism . |
| Outcome: | The proposed system performs better than the existing model with three new datasets used to diagnose cognitive impairments. |
Copied to clipboard
| Challenge: | Existing approaches to semantic role labeling rely on word alignments, translation engines or preprocessing tools. |
| Approach: | They propose a cross-lingual semantic role labeling model which only requires annotations in a source language and access to raw text in . |
| Outcome: | The proposed model minimizes the effort required to construct annotations or models for a new target language. |
Copied to clipboard
| Challenge: | Existing methods for word embedding evaluation are computationally expensive and task-specific. |
| Approach: | They propose a minimally supervised method for generating word embedding evaluation datasets for a large number of languages using existing dependency treebanks and parsers. |
| Outcome: | The proposed method evaluates three popular word embedding algorithms against these datasets and shows that their performance varies between syntactic categories. |
Copied to clipboard
| Challenge: | Semantic parsers treat graphs as strings or trees, but there is no guarantee that the output is a well-formed graph. |
| Approach: | They propose a graph-aware sequence model that utilizes a DAG grammar to guide graph generation. |
| Outcome: | The proposed model outperforms string-based and DAG-grammar models by a large margin and can guarantee the well-formed graphs. |
Copied to clipboard
| Challenge: | Existing algorithms for AM dependency parsing are slow and do not support linguistic principles. |
| Approach: | They propose an A* parser and a transition-based parsing algorithm which guarantee well-typedness and improve parse speed by up to 3 orders of magnitude. |
| Outcome: | The proposed algorithms guarantee well-typedness and improve parsing speed by up to 3 orders of magnitude while maintaining or improving accuracy. |
Copied to clipboard
| Challenge: | Existing word sense disambiguation and named entity recognition systems have no explicit metonymy detection. |
| Approach: | They propose an end-to-end word-level classification approach based only on BERT . they show that their approach generalises well to unseen data . |
| Outcome: | The proposed approach surpasses conventional models and benchmarks on 5 datasets and generalises well to unseen data. |
Copied to clipboard
| Challenge: | Existing multilingual AMR evaluation metrics are not available for cross-lingual parsers . existing studies show that source language has a dramatic effect on cross-linguistic AMRs . |
| Approach: | They propose to use three multilingual adaptations of monolingual AMR evaluation metrics to evaluate cross-lingual AML parsers. |
| Outcome: | The proposed metric is the most highly correlated to english AMRs, while the most correlated is S2match. |
Copied to clipboard
| Challenge: | linguistic studies have shown the prevalence of various lexical and grammatical patterns in texts authored by a person of a particular gender, but models for part-of-speech tagging and dependency parsing have not adapted to account for these differences. |
| Approach: | They annotate the Wall Street Journal part of the Penn Treebank with the gender information of the articles’ authors and build taggers and parsers trained on this data. |
| Outcome: | The proposed model can account for gendered differences in syntactic tasks and highlight future venues for developing more accurate taggers and parsers. |
Copied to clipboard
| Challenge: | Existing efforts to speed up constituent parsing have focused on chart-based or shift-reduce parsers. |
| Approach: | They propose to use auxiliary losses and sentence-level fine-tuning to mitigate greedy decoding issues. |
| Outcome: | The proposed model surpasses the performance of sequence tagging constituent parsers on the English and Chinese Penn Treebank datasets and reduces their parsing time even further. |
Copied to clipboard
| Challenge: | Existing parsers that learn graph representations based on static graphs are error-prone and disjointed . Graph-based parser can parse sentences efficiently but suffer from error propagation . |
| Approach: | They propose a dynamic graph learning framework to learn graph representations based on a static graph constructed by an existing parser. |
| Outcome: | The proposed parser outperforms the previous parsers on the SemEval-2015 task 18 dataset in three languages. |
Copied to clipboard
| Challenge: | Low-resourced regional, non-official or minority languages often face lack of institutional support . low-resource languages often find themselves in a similar situation . |
| Approach: | They propose to create the first treebank for Occitan, a low-resourced regional language . they use an agile annotation approach and rely on pre-processing using existing tools . |
| Outcome: | The proposed treebank is the first for the low-resourced regional language Occitan . the project uses an agile annotation approach and automated pre-annotation . |
Copied to clipboard
| Challenge: | Existing text-to-SQL parsers struggle with out-of-domain generalization problems, arguing that they lack the ability to match domain specific phrases to composite operations over columns. |
| Approach: | They propose to use a synthetic dataset and a re-purposed train/test split to quantify out-of-domain generalization over column operations to address this problem. |
| Outcome: | The proposed method outperforms baseline parsers on the domain generalization problem, while boosting the underlying parser’ overall performance by 13.8% relative accuracy gain (5.1% absolute). |
Copied to clipboard
| Challenge: | Experimental results show that Rex can benefit from cross-lingual training and improve the effectiveness of semantic parsers. |
| Approach: | They propose a Representation Mixup Framework for effectively exploiting translations in the cross-lingual Text-to-SQL task. |
| Outcome: | The proposed framework can benefit from cross-lingual training and improve the effectiveness of semantic parsers, achieving state-of-the-art performance. |
Copied to clipboard
| Challenge: | a dependency tree has a root constraint, but only one edge may emanate from the root node. |
| Approach: | They propose an algorithm which enforces a root constraint without compromising the original runtime. |
| Outcome: | The proposed algorithm satisfies the constraint without compromising the original runtime. |
Copied to clipboard
| Challenge: | Existing universal models to describe the syntax of languages are debated for decades . a new study examines the plausibility of universal grammars in dependency parsing . |
| Approach: | They propose to use typological features to describe the syntax of languages to train a multilingual dependency parser. |
| Outcome: | The proposed model can be trained on 40 languages with the help of typological features. |
Copied to clipboard
| Challenge: | AMR parsing has experienced an unprecendented increase in performance in the last three years due to a mixture of effects including architecture improvements and transfer learning. |
| Approach: | They propose to combine Smatch-based ensembling techniques with ensemble distillation to overcome this diminishing returns of silver data. |
| Outcome: | The proposed technique can produce gains rivaling those of human annotated data for QALD-9 and achieve a new state-of-the-art for BioAMR. |
Copied to clipboard
| Challenge: | etymology is the study of words' origins. |
| Approach: | They develop an extensible Wiktionary parser that predicts the etymology of a word across the full range of ethymological types and languages in Wiktionaries. |
| Outcome: | The proposed parser predicts the etymology of a word across the full range of ethymologies and languages in Wiktionary, and shows the application of tymatics in modeling this phenomenon. |
Copied to clipboard
| Challenge: | Current approaches typically merge sentence-level parsing outputs for discourse input, resulting in fragmented graphs and degraded downstream performance. |
| Approach: | They propose a task for discourse-level text scene graph parsing that merges sentence-level outputs for discourse input and propose 'DiscoSG' a dataset of 400 expert-annotated and 8,430 synthesised multi-sentence caption-graph pairs is used to test the new task. |
| Outcome: | The proposed task improves SPICE by 30% over the baseline while achieving 86 faster inference than existing models. |
Copied to clipboard
| Challenge: | Pre-trained parsers perform poorly on domain-specific questions, a paper argues . retraining parser with domain- specific questions is expensive, as these require linguistic expertise. |
| Approach: | They propose an automatic labeled domain question generation framework leveraging domain knowledge and seed domain questions. |
| Outcome: | The proposed framework improves state-of-the-art parsers on domain questions. |
Copied to clipboard
| Challenge: | Using the examples of English and German, we examine how parsers trained on modern variants of these languages can be transferred to older language levels without loss. |
| Approach: | They develop a treebank of diachronic corpora enriched with dependency annotations using 3 parsers, 6 pre-trained language models, 5 newly trained models for German, and two tag sets. |
| Outcome: | The proposed treebank covers the time period from 1800 until today and is based on the DependencyAnnotator annotation tool. |
Copied to clipboard
| Challenge: | Part-of-speech tags are used for word-contextualized parsers, but their impact is limited to word-based models. |
| Approach: | They propose an adversarial attack to test whether morphological tags contribute to error propagation or correct parsing mistakes. |
| Outcome: | The proposed attack on 14 treebanks shows that if morphological tags were utopically robust against lexical perturbations, they would be able to correct parsing mistakes. |
Copied to clipboard
| Challenge: | Existing training data is limited for languages other than English, so is the performance of the developed parsers. |
| Approach: | They propose to apply a pre-trained multilingual model to Italian, German and Dutch parsers where only a small number of manually annotated parses are available. |
| Outcome: | The proposed model improves on six parsers in English and Italian, German and Dutch, with the addition of universal dependency relations and universal POS tags as model-agnostic features. |
Copied to clipboard
| Challenge: | Modern Irish is a minority language lacking computational resources for accurate automatic syntactic parsing of user-generated content. |
| Approach: | They propose to use a treebank to facilitate natural language parsing of user-generated content in Irish. |
| Outcome: | The proposed treebank enables natural language processing of user-generated content in Irish. |
Copied to clipboard
| Challenge: | a limitation in NLP evaluation lies in the association between solving a dataset versus solving . authors often run their models only in a handful of treebanks . |
| Approach: | They propose to run a large-scale experiment on a single treebank and compare them on many parsers whose scores are available. |
| Outcome: | The proposed model can be biased on a single treebank and spurious effects can be avoided. |
Copied to clipboard
| Challenge: | Dependency parsing is an important natural language processing task which analyzes the syntactic structure of an input sentence. |
| Approach: | They propose a structure-aware encoder pre-trained on auto-parsed data to improve dependency parsing . they propose combining gold dependency trees with existing parsers to improve parser performance . |
| Outcome: | The proposed approach outperforms baselines under different parsers and dependency standards under different parameters and model architectures. |
Copied to clipboard
| Challenge: | Recent work shows that pre-trained sequence-to-sequence Transformer models are effective in predicting linearized Abstract Meaning Representation graphs. |
| Approach: | They propose a structure-aware transition-based approach to AMR parsing that integrates general pre-trained sequence-to-sequence language models with a structured transition set. |
| Outcome: | The proposed approach retains the desirable properties of previous approaches while reaching the new parsing state of the art for AMR 2.0. |
Copied to clipboard
| Challenge: | Existing flow graph parsers lack sufficient annotated data to train them . a lack of annotation can cause costly training, and poor flow graph training results in a large improvement. |
| Approach: | They propose a multi-task framework that performs tagging and graph generation simultaneously . they take advantage of the abundance of unlabelled recipes and generate noisy silver annotations . |
| Outcome: | The proposed model can unify the input representation and use compact encoders, resulting in small models with significantly fewer parameters than existing models. |
Copied to clipboard
| Challenge: | Prior studies have focused on translating utterances from high-resource languages to low-resourced languages. |
| Approach: | They propose an active learning approach that exploits the strengths of both human and machine translations by iteratively adding small batches of human translations into the machine-translated training set. |
| Outcome: | The proposed approach reduces errors and bias in the translated data, resulting in higher parser accuracies than the current model trained on machine translations. |
Copied to clipboard
| Challenge: | a recent study suggests that large datasets require large amounts of simulated data and scores to perform model evaluation. |
| Approach: | They propose to use dependency parsing to optimize annotation efforts by using a sample size of 5,000 tokens for in-language in-domain datasets. |
| Outcome: | The proposed method can be applied to other tasks, including classification and translation tasks. |
Copied to clipboard
| Challenge: | Existing bubble representations encoding coordination boundaries and internal relationships are difficult to detect and parse . |
| Approach: | They propose a bubble parser to perform coordination structure identification and dependency-based syntactic analysis simultaneously. |
| Outcome: | The proposed bubble parser beats state-of-the-art approaches on coordination structure prediction . the proposed system is based on a GENIA corpus and a Penn treebank . |
Copied to clipboard
| Challenge: | Using custom architectures, constituency parsers are limited and require specialized hardware. |
| Approach: | They propose an algorithm that assigns labels to each word in a sentence in parallel and then performs a reconciliation phase to extract a tree in (empirically) linear time. |
| Outcome: | The proposed model achieves 95.4 F1 on the WSJ test set while also achieving substantial speedups compared to current state-of-the-art parsers with comparable accuracies. |
Copied to clipboard
| Challenge: | In Natural Language Interfaces to Databases systems, text-to-SQL parsers allow users to query databases by using natural language questions. |
| Approach: | They propose a parser-independent interactive approach that interacts with users using multi-choice questions and can easily work with arbitrary parsers. |
| Outcome: | The proposed approach improves performance with limited interaction turns by using simulation and human evaluation on two cross-domain datasets with five state-of-the-art parsers. |
Copied to clipboard
| Challenge: | a proposed multimodal system can resolve syntactic ambiguities by exploiting external evidence, says a researcher . a parser that processes linguistic information is expected to handle syntakically unambiguous sentences, but it cannot. |
| Approach: | They propose to exploit external contextual information to resolve ambiguous sentences . they propose to use data-driven and grammar-based approaches to solve ambiguities . |
| Outcome: | The proposed system confirms this hypothesis in experiments on syntactically ambiguous sentences. |
Copied to clipboard
| Challenge: | Fig. 1 shows the video's story structure and event relationships in discourse parsing. |
| Approach: | They propose to construct an RST tree for a video to represent its storyline and illustrate the event relationships between events. |
| Outcome: | The proposed model outperforms two existing approaches to video RST parsing: the ‘parsing after captioning’ framework and parser using visual features. |
Copied to clipboard
| Challenge: | Existing discourse parsers do not generalize well across genres and text types. |
| Approach: | They propose to integrate large language models into RST discourse parsers to improve parser performance in a social media context. |
| Outcome: | The proposed model improves parser performance in a social media context without pre-identified discourse units. |
Copied to clipboard
| Challenge: | Previously studies focused on semantic tasks such as sentiment analysis, question answering and reading comprehension. |
| Approach: | They propose two approaches to study where and how adversarial examples exist in dependency parsing . they use a state-of-the-art parser to find adversarials in existing texts . |
| Outcome: | The proposed approaches show that adversarial examples exist in dependency parsing . they show that up to 77% of input examples admit adversarials . |
Copied to clipboard
| Challenge: | Existing discourse treebanks are limited in the application of data-driven approaches to discourse parsing. |
| Approach: | They propose a method to automatically generate discourse treebanks using distant supervision from sentiment annotated datasets by heuristic beam-search strategy extended with a stochastic component. |
| Outcome: | The proposed method generates discourse trees incorporating structure and nuclearity for documents of arbitrary length using an efficient beam-search strategy, extended with a stochastic component. |
Copied to clipboard
| Challenge: | Existing approaches to reduce constituency parsing to tagging are based on linearization, learning, and decoding . linearization of the derivation tree is the most critical factor in achieving accurate parsers as taggers . |
| Approach: | They propose a pipeline with three steps for reducing constituency parsing to tagging . they find that linearization and learning are critical factors for accurate parsers . |
| Outcome: | The proposed pipelines are linearized, learning, and decoded, and have three steps to achieve accurate parsing as taggers. |
Copied to clipboard
| Challenge: | morphological parsers for two Afroasiatic languages are developed using a parser-combinator paradigm . the paradigm allows rapid development and ease of integration with other systems, but at a cost of non-optimal theoretical efficiency. |
| Approach: | They propose a rule-based morphological parser paradigm for Tigrinya and Oromo languages . they use a parsers-combinator paradigm instead of a finite-state paradigm . |
| Outcome: | The proposed paradigm allows rapid development and ease of integration with other systems, but at cost of non-optimal theoretical efficiency. |
Copied to clipboard
| Challenge: | Abstract Meaning Representation abstracts the meaning of sentences into a single-rooted, acyclic and directed graph. |
| Approach: | They propose to use a metric to evaluate concept alignment and relation alignment to improve Chinese AMR parsing evaluation methods. |
| Outcome: | The proposed method is more robust and compatible with concept alignment and relation alignment and more robust in evaluating arcs. |
Copied to clipboard
| Challenge: | Abstract Meaning Representation parsers have improved in recent years, but not solved. |
| Approach: | They propose an evaluation suite that evaluates AMR parsers on a range of phenomena . they find that current parser outputs are far from satisfactory . |
| Outcome: | The proposed evaluation suite reveals the abilities and shortcomings of current parsers. |
Copied to clipboard
| Challenge: | Recent work attempts to explicitly incorporate human-defined linguistic priors into fine-tuning tasks. |
| Approach: | They replace parsed graphs or trees with trivial ones to investigate linguistic priors . they propose to use trivial graphs as baselines to design advanced knowledge fusion methods . |
| Outcome: | The use of trivial graphs improves performance in fully-supervised and few-shot settings. |
Copied to clipboard
| Challenge: | Large language models increasingly require structured inference, says aaron sagar . meta-learning learns universal constraint propagation policies without task-specific training . standard schedulers are inexpensive but myopic, because they optimize local effects . |
| Approach: | MetaJuLS learns universal constraint propagation policies applicable across languages and tasks without task-specific retraining. |
| Outcome: | MetaJuLS achieves 1.5-2.0 speedups over GPU-optimized baselines while maintaining accuracy within 0.2% of state-of-the-art parsers. |
Copied to clipboard
| Challenge: | Existing grammar generation models perform sub-optimally, resulting in inconsistent syntactic and semantic accuracy. |
| Approach: | They propose an LLM-driven hybrid genetic algorithm to optimize grammar generation by inferring grammars from a set of examples and generated in Backus-Naur Form. |
| Outcome: | The proposed algorithm improves syntactic and semantic accuracy of generated grammars across LLMs. |
Copied to clipboard
| Challenge: | Using a frequency-based method, we can identify subsets of the same word contexts without any reference data. |
| Approach: | They compare 11 different French dependency parsers on a specialized corpus to generate distributional thesauri using a frequency-based method. |
| Outcome: | The proposed method can identify relevant subsets without reference data and the similarity is confirmed on a restricted distributional benchmark. |
Copied to clipboard
| Challenge: | Syntactic parsing aims to reveal how sentences are syntactically structured. |
| Approach: | They propose to produce compatible constituency and dependency trees simultaneously for input sentences . they adopt a much more efficient decoding algorithm and explore joint modeling at training phase . |
| Outcome: | The proposed model significantly improves matching ratio of whole trees compared to separate models . the proposed model adopts a much more efficient decoding algorithm . |
Copied to clipboard
| Challenge: | phonological, morphological, and syntactic distinctions between formal and informal Persian are important . formal Persian is not a universally recognized form of language, but is a dialect of informal Persian . |
| Approach: | They develop an open-source treebank for informal Persian to train dependency parsers . they then train dependency lexicographers on existing treebanks and evaluate them on out-of-domain data . |
| Outcome: | The proposed treebanks show that they perform poorly when training on formal and informal Persians. |
Copied to clipboard
| Challenge: | Annotation inconsistencies between data sets can cause problems for low-resource NLP . a simple method for automatically detecting annotation mismatches between corpora is proposed . |
| Approach: | They propose a method for automatically detecting annotation mismatches between dependency parsing corpora . they also propose three related methods for automatically configuring the mismatch . |
| Outcome: | The proposed method improves performance on both converted and unconverted data. |
Copied to clipboard
| Challenge: | Headless multi-word expressions are frequent in natural language but lack internal syntactic dominance relations. |
| Approach: | They propose an efficient joint decoding algorithm that combines scores from both strategies. |
| Outcome: | The proposed algorithm combines scores from parsing and tagging for predicting flat MWEs . the proposed algorithm is more accurate than parse and more efficient for non-BERT features . |
Copied to clipboard
| Challenge: | Existing text-to-SQL parsers are often over-confident, thus casting doubt on their trustworthiness when deployed for real use. |
| Approach: | They propose a parser-independent error detection model for text-to-SQL semantic parsing . they use a language model of code as its bedrock and graph neural networks to learn structural features of queries . |
| Outcome: | The proposed model outperforms parser-dependent uncertainty metrics on three strong parsers . it could improve the performance and usability of text-to-SQL semantic parsing, it is shown . |
Copied to clipboard
| Challenge: | Existing approaches to analyzing code-switched data are limited in their ability to generalize to multilingual and mixed-language inputs. |
| Approach: | They propose a large-language model-based annotation pipeline to produce UD annotations for code-switched text. |
| Outcome: | The proposed pipeline outperforms existing parsers and baselines in syntactic analysis. |
Copied to clipboard
| Challenge: | Currently, existing systems cannot accurately identify most of the world's 7000 languages due to lack of data and computational challenges. |
| Approach: | They propose a misprediction-resolution hierarchical model, LIMIT, that reduces error by 55% on a children's stories dataset and by 40% on 'fLORES-200' benchmark. |
| Outcome: | The proposed model reduces error by 55% on the MCS-350 and 40% on the FLORES-200 benchmarks. |
Copied to clipboard
| Challenge: | Unsupervised grammar induction models lack analysis of traditional challenges, especially regarding the training loss. |
| Approach: | They propose a method to reduce the parse pool per sentence for loss evaluation using structural bias from pre-trained parsers. |
| Outcome: | The proposed method significantly improves performance while reducing variance and bias toward overly simplistic parses. |
Copied to clipboard
| Challenge: | Large Language Models have revolutionized Natural Language Processing but their application in extracting information from visually rich documents has not been successful. |
| Approach: | They propose a language model-based document information extraction and localization methodology to reframe the document information extract task for a LLM. |
| Outcome: | The proposed method enables extraction of singular, repeated, and hierarchical entities with and without training data. |
Copied to clipboard
| Challenge: | Extensive experiments on the STAC and Molweni datasets demonstrate that our approach effectively resolves ambiguities and significantly outperforms the state-of-the-art (SOTA) baselines. |
| Approach: | They propose a Discourse-aware Clarification Module (DCM) that generates clarifications for the parser through systematic clarification type reasoning and discourse goal reasoning. |
| Outcome: | Extensive experiments on the STAC and Molweni datasets demonstrate that the proposed module significantly outperforms the state-of-the-art (SOTA) framework. |
Copied to clipboard
| Challenge: | incorporating structure information can improve the performance of aspect-based sentiment analysis. |
| Approach: | They propose a method to conduct neuron-level manipulations on word representations in the frequency domain. |
| Outcome: | The proposed method can achieve or come close to state-of-the-art in ABSA. |
Copied to clipboard
| Challenge: | CKY algorithm is a cubic dependence on sentence length, but transformers can be used to approximate it. |
| Approach: | They propose a transformer-based approach that approximates the CKY algorithm by directly predicting a sentence's parse and avoiding its cubic dependence on sentence length. |
| Outcome: | The proposed approach achieves better performance than comparable parsers that make use of CKY, while being faster. |
Copied to clipboard
| Challenge: | Discourse Representation Structure (DRS) parsers are constrained when trained exclusively on monolingual data. |
| Approach: | They propose a cross-lingual training strategy that leverages cross-linguistic training data to train models in multiple languages. |
| Outcome: | The proposed method improves clause and graph parsing in English, German, Italian and Dutch. |
Copied to clipboard
| Challenge: | Controllable and transparent text generation has been a long-standing goal in NLP . but previous approaches were hindered by parsing and generation insufficiencies . |
| Approach: | They propose a framework for English that has three steps: 1. Parsing a sentence into a semantic graph. 2. Applying human-designed semantic manipulation rules. 3. Generating text from the manipulated graph. |
| Outcome: | The proposed framework for English is based on a neural network and parsers. |