| Challenge: | Lexical features are useful beyond predictive performance. they can also be used to understand the subjective properties of a text. |
| Approach: | They propose two deep learning algorithms that separate the explanatory power of text from confounds. |
| Outcome: | The proposed algorithms are predictive of a set of target variables yet uncorrelated to confounds . they pick words associated with narrative persuasion and are more predictive than standard features . |
Similar Papers
Inducing Generalizable and Interpretable Lexica (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Lexica are widely used as generalizable language features to predict sentiment, emotions, mental health, and personality. |
| Approach: | They propose to induce lexica using context-oblivious and context-aware approaches and compare their performance using crowd-worker assessment. |
| Outcome: | The proposed models can be induced using context-oblivious and context-aware approaches and evaluate their quality using crowd-worker assessment. |
From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work in this field has looked most commonly into gender bias, racial bias, and religious bias. |
| Approach: | They propose an algorithm that uses a neural network to perform ‘soft debiasing’ and build on the seminal work of (CITATION) and (CitATION). |
| Outcome: | The proposed algorithm outperforms current methods on gender, race, and religion metrics on a wide range of metrics. |
The Return of Lexical Dependencies: Neural Lexicalized PCFGs (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to grammar induction focus on discovering constituents or dependencies. |
| Approach: | They propose to model lexical dependencies using context free grammars instead of lexicals . they show that this unified framework induces both constituents and dependencies . |
| Outcome: | The proposed model overcomes sparsity problems and induces constituents and dependencies better than the current methods. |
Lexicosyntactic Inference in Neural Models (D18-1)
Copied to clipboard
| Challenge: | lexicosyntactic inferences are triggered by surprising aspects of the syntactical context that a word occurs in. |
| Approach: | They build a factuality judgment dataset for English clause-embedding verbs in various syntactic contexts and use it to probe the behavior of current state-of-the-art neural systems. |
| Outcome: | The proposed model makes systematic errors that are visible through the lens of factuality prediction. |
Randomized Deep Structured Prediction for Discourse-Level Processing (2021.eacl-main)
Copied to clipboard
| Challenge: | Expressive text encoders have been at the center of recent NLP work . however, some tasks require complex structural dependencies between texts . |
| Approach: | They propose to leverage deep structured prediction and expressive neural encoders for argumentation mining tasks. |
| Outcome: | The proposed framework can be used for argumentation mining tasks without expensive inference tools. |
Topics to Avoid: Demoting Latent Confounds in Text Classification (D19-1)
Copied to clipboard
| Challenge: | Despite impressive performance on many text classification tasks, deep neural networks tend to learn frequent superficial patterns that are specific to the training data and do not always generalize well. |
| Approach: | They propose a method that represents latent topical confounds and a model which “unlearns” confounding features by predicting both the label of the input text and the confound. |
| Outcome: | The proposed model generalizes better and learns features indicative of the writing style rather than the content. |
Discovering influential text using convolutional neural networks (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for estimating the effects of text on human evaluation are limited to testing a small number of pre-specified text treatments. |
| Approach: | They propose a method for flexibly discovering clusters of similar text phrases that are predictive of human reactions to texts using convolutional neural networks. |
| Outcome: | The proposed method can detect and predict human reactions to texts under certain assumptions. |
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction (D18-1)
Copied to clipboard
| Challenge: | Existing methods for bilingual lexicon induction take advantage of word embeddings, but our model is not as efficient as previous work. |
| Approach: | They propose a discriminative latent-variable model for bilingual lexicon induction that combines the bipartite matching dictionary prior and an embedding-based approach. |
| Outcome: | The proposed model outperforms existing models on six language pairs and shows that it mitigates hubness problem. |
Inducing a Lexicon of Abusive Words – a Feature-Based Approach (N18-1)
Copied to clipboard
| Challenge: | a new classification task is needed to identify abusive words among a set of negative polar expressions. |
| Approach: | They propose to calibrate a domain-independent lexicon for detection of abusive words . they use a small manually annotated base lexico to calibrated a large lexical . |
| Outcome: | The proposed feature can be calibrated on a small manually annotated base lexicon and produced on large datasets. |
Interpreting Predictions of NLP Models (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide a background on interpretation techniques for neural NLP models. |
| Approach: | This tutorial will provide a background on interpretation techniques for NLP models . it will examine saliency maps, input perturbations, adversarial attacks and influence functions . |
| Outcome: | This tutorial will provide a background on interpretation techniques . examples-specific interpretations include saliency maps, input perturbations, adversarial attacks, influence functions . |