Is “My Favorite New Movie” My Favorite Movie? Probing the Understanding of Recursive Noun Phrases (2022.naacl-main)
Copied to clipboard
| Challenge: | Recursive noun phrases have interesting semantic properties, yet it is unknown whether language models have such knowledge. |
| Approach: | They propose a dataset of three textual inference tasks targeting recursive noun phrases . they show that such knowledge is learnable with appropriate data . |
| Outcome: | The proposed model achieves strong zero-shot performance on an extrinsic Harm Detection task. |
Similar Papers
Implicit n-grams Induced by Recurrence (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that self-attention based models have limitations on modeling sequential transformations. |
| Approach: | They propose to extract some explainable features from trained RNNs that are reminiscent of classical n-grams features. |
| Outcome: | The proposed models can model interesting linguistic phenomena such as negation and intensification. |
Context Matters: A Pragmatic Study of PLMs’ Negation Understanding (2022.acl-long)
Copied to clipboard
| Challenge: | In linguistics, there are two main perspectives on negation: a semantic and a pragmatic view. |
| Approach: | They propose to use transformer-based pre-trained language models to study negation understanding using a pragmatic paradigm. |
| Outcome: | The proposed transformer-based model outperforms the human benchmark at NLU and GLUE, and the results are much more optimistic than previous studies. |
You Only Need Attention to Traverse Trees (P19-1)
Copied to clipboard
| Challenge: | Recent research has focused on sentence representations. |
| Approach: | They propose a tree-based model that captures phrase-level syntax and word-level dependencies by doing recursive traversal with attention. |
| Outcome: | a new model captures phrase-level syntax and word-level dependencies with attention. |
Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment (2024.findings-acl)
Copied to clipboard
| Challenge: | et al. argued that sentence co-occurrence probabilities should reflect entailment . but it is unclear whether probabilities predicted by neural LMs encode enanglement based on their theory . |
| Approach: | They propose a test that decodes entailment relations between natural sentences . they argue that the test that predicts a flipped test does not account for redundancy . |
| Outcome: | The proposed test can decode entailment relations between natural sentences, but not perfectly. |
Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning? (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models are highly effective tools for solving different kinds of problems in natural language processing. |
| Approach: | They propose to use large language models to solve a myriad of problems. |
| Outcome: | The proposed model performs worse on word meaning comprehension than an encoder-only model with vastly fewer parameters. |
Proceedings of the First Workshop on Commonsense Inference in Natural Language Processing (D19-60)
Copied to clipboard
| Challenge: | Workshop on Commonsense Inference in Natural Language Processing focuses on commonsense knowledge representation and application in NLP tasks. |
| Approach: | COIN is a workshop on commonsense inference in natural language processing . workshop included two shared tasks on reading comprehension using commonsensense knowledge . |
| Outcome: | the workshop focused on modeling commonsense knowledge and commonsensing in natural language processing tasks. |
On the Importance of Delexicalization for Fact Verification (D19-1)
Copied to clipboard
| Challenge: | Neural networks (NNs) perform state-of-the-art (SOA) performance in many complex tasks. |
| Approach: | They investigate the importance that a model assigns to various aspects of data . they experiment with two strategies of masking to mitigate this dependence on lexicalized information . |
| Outcome: | The proposed model improves on the in-domain dataset by 10% compared to the fully lexicalized model. |
On the Importance of Distinguishing Word Meaning Representations: A Case Study on Reverse Dictionary Mapping (N19-1)
Copied to clipboard
| Challenge: | Sense representations target meaning conflation deficiency but their potential impact has not been investigated in downstream NLP applications. |
| Approach: | They propose to use a reverse dictionary system to address meaning conflation deficiency . they propose to integrate senses into the system to improve semantic understanding . |
| Outcome: | The proposed approach can improve the performance of a downstream NLP application. |
Revisiting subword tokenization: A case study on affixal negation in large language models (2024.naacl-long)
Copied to clipboard
| Challenge: | Negation is central to language understanding but is not properly captured by modern NLP methods. |
| Approach: | They propose to use subword tokenization methods to detect negation in large language models . they find that models can reliably recognize negation, despite mismatches in tokenization accuracy . |
| Outcome: | The proposed models can detect negation in English using subword tokenization methods despite some mismatches in tokenization accuracy and negation detection performance. |
Interpreting Recurrent and Attention-Based Neural Models: a Case Study on Natural Language Inference (D18-1)
Copied to clipboard
| Challenge: | In this paper, we examine the behavior of deep learning models in their intermediate layers . saliency determines what is critical for the final decision of a deep model . |
| Approach: | They propose to interpret the intermediate layers of deep models by visualizing the saliency of attention and LSTM gating signals. |
| Outcome: | The proposed methods reveal interesting insights and identify critical information contributing to the model decisions. |