Papers by Smaranda Muresan
Copied to clipboard
| Challenge: | Existing approaches to authorship attribution model only learn from the output layer of pre-trained transformers, ignoring representations learned at other layers. |
| Approach: | They propose a model that leverages the various linguistic representations learned at different layers of pre-trained transformer-based models to model the authorship attribution task more effectively. |
| Outcome: | The proposed model performs better on out-of-domain and in-domain scenarios, while ignoring representations learned at other layers. |
Copied to clipboard
| Challenge: | Existing models for metaphor generation lack conceptualization of meaning of the metaphors . recent neural models have led to advances in many areas of natural language generation . |
| Approach: | They propose to encode conceptual mappings between cognitive domains to generate metaphoric expressions by embedding verbs into a literal expression and deriving source/target pairs to train a controlled seq-to-seq generation model. |
| Outcome: | The proposed method outperforms existing models in automatic and human evaluations for basic metaphoricity and conceptual metaphor presence. |
Copied to clipboard
| Challenge: | Literary tropes are at the crux of human imagination and communication. |
| Approach: | They propose to automatically transform similes from reddit to their literal counterparts using common sense knowledge to generate simile models. |
| Outcome: | The proposed method generates 88% novel similes that do not share properties with training data. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are typically trained to reflect a relatively uniform set of values, which limits their applicability to tasks that require understanding of nuanced human perspectives. |
| Approach: | They propose to use Chain-of-Thought reasoning techniques to build steerable pluralistic models by fine-tuning on human-authored CoT and synthetic explanations. |
| Outcome: | The proposed methods outperform others and demonstrate strong sample efficiency. |
Copied to clipboard
| Challenge: | The system was evaluated on a unified development set without distributing the gold labels. |
| Approach: | They propose to use fine-grained propaganda detection to build models that can explain why an article is propagandistic. |
| Outcome: | The proposed model performed on all eighteen propaganda techniques in the corpus of the shared task. |
Copied to clipboard
| Challenge: | Recent work on large language models relies on intuition that most tasks can be described via natural language instructions. |
| Approach: | They propose that a model should be able to keep extending its knowledge without forgetting previous skills. |
| Outcome: | The proposed model can learn 8 new diverse language generation tasks while maintaining good performance on previous tasks, spanning in total of 70 datasets. |
Copied to clipboard
| Challenge: | Among social media platforms, Reddit has emerged as the most promising one due to its anonymity and its focus on topic-based communities (subreddits) . a challenge for previous work on suicide risk assessment has been the small amount of labeled data. |
| Approach: | They propose to use social media to collect user data from r/SuicideWatch subreddit and annotate it with user-level suicide risk: no-risk, low-risk and high-risk. |
| Outcome: | The proposed model improves by using pseudo-labeling based on related issues around mental health (e.g., anxiety, depression) |
Copied to clipboard
| Challenge: | Fact Extraction and Verification datasets provide a resource for end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. |
| Approach: | They propose a system that is resilient to attacks by multiple propositions, temporal reasoning, ambiguity and lexical variation and a sequence of evidence sentences and veracity relation predictions. |
| Outcome: | The proposed system is resilient to three realistic “attacks” and obtains state-of-the-art results due to improved evidence retrieval. |
Copied to clipboard
| Challenge: | Unsupervised morphological segmentation is beneficial for many natural language processing tasks. |
| Approach: | They propose a framework for unsupervised morphological segmentation that uses Adaptor Grammars. |
| Outcome: | The proposed framework achieves state-of-the-art results across languages of different typologies, from fusional to polysynthetic and from high-resource to low-resourced. |
Copied to clipboard
| Challenge: | Visual metaphors are powerful rhetorical devices used to communicate creative ideas through images. |
| Approach: | They propose to generate visual metaphors from linguistic metaphors by using large language models and Diffusion models. |
| Outcome: | The proposed task requires the ability to model implicit meaning and compositionality. |
Copied to clipboard
| Challenge: | despite improvements in machine translation quality, automatic poetry translation remains a challenging problem . et al., a study of automatic poetry translators shows that multilingual fine-tuning on poetic data outperforms bilingual fine-timing on non-poetic text . |
| Approach: | They propose to use poetic parallel corpora for 6 languages to study poetry translation . they find that multilingual fine-tuning on poetic data outperforms bilingual fine-uning . |
| Outcome: | The proposed model outperforms bilingual and multilingual models on poetic data . the proposed model is based on a parallel dataset of poetry translations for several languages . |
Copied to clipboard
| Challenge: | In argumentation theory, an enthymeme is defined as incomplete argument found in discourse . encoding discourse-aware commonsense improves the quality of the generated implicit premises . |
| Approach: | They propose a task that generates an implicit premise in an enthymeme using commonsense . they use a narrative text dataset to analyze the quality of the generated premises . |
| Outcome: | The proposed model outperforms baseline models on three datasets. |
Copied to clipboard
| Challenge: | Recent work on question generation has largely focused on factoid questions such as who, what, where, when about basic facts. |
| Approach: | They propose an end-to-end system for generating openended questions that are answerable from and faithful to the input text. |
| Outcome: | The proposed model outperforms existing models and can be used in news media organizations. |
Copied to clipboard
| Challenge: | Existing methods to improve few-shot performance in aspect-based sentiment analysis (ABSA) require complex interactions between the target and the polarity of the sentiment. |
| Approach: | They propose a pipeline approach to construct a noisy ABSA dataset and adapt it to the ABSA tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art on the aspect extraction sentiment classification task and is capable of performing the harder aspect sentiment triplet extraction task. |
Copied to clipboard
| Challenge: | a new method for fact-checking is needed to detect disinformation on the web . a dataset COVID-Fact contains 4,086 claims concerning the COVId-19 pandemic . |
| Approach: | They propose a FEVER-like dataset COVID-Fact of 4,086 claims concerning the COVId-19 pandemic . they automatically detect true claims and their source articles and generate counter-claims using automatic methods . |
| Outcome: | The proposed method reduces the cost of building domain-specific datasets for detecting misinformation . the proposed dataset contains 4,086 claims concerning the COVID-19 pandemic . |
Copied to clipboard
| Challenge: | Public opinion has been shown to be significantly influenced by framing effects. |
| Approach: | They propose a method for reframing arguments that combines controllable text generation with a post-decoding entailment component to achieve the same denotation. |
| Outcome: | The proposed method is effective compared to baselines along the dimensions of fluency, meaning, and trustworthiness/reduction of fear. |
Copied to clipboard
| Challenge: | Experimental results shed light on the emotional connotation of color in context . color is a powerful tool for conveying emotion across cultures . |
| Approach: | They propose a multimodal dataset for exploring the emotional connotation of color as mediated by line, stroke, texture, shape, and language. |
| Outcome: | The proposed model sheds light on the emotional connotation of color in context and the potential for future studies. |
Copied to clipboard
| Challenge: | Multimodal approaches to object recognition ground adjectives and nouns from text using comparative adjectives. |
| Approach: | They propose a new paradigm of grounding comparative adjectives within the realm of color descriptions by using a vector model. |
| Outcome: | The proposed model generates representations of comparative adjectives with an average accuracy of 0.65 cosine similarity to the desired direction of change. |
Copied to clipboard
| Challenge: | Existing RTE models struggle to capture figurative language, despite its ubiquity, it remains a bottleneck in automatic text understanding. |
| Approach: | They propose to frame five existing figurative language datasets into over 12,500 RTE examples. |
| Outcome: | The proposed models struggle to perform pragmatic inference and reasoning about world knowledge. |
Copied to clipboard
| Challenge: | a corpus of propositional content is a set of cognitive attitudes of different agents towards a text . propositional attitudes are a cognitive attitude, including belief and sentiment, towards . |
| Approach: | They propose a corpus which records cognitive state: who believes what, who has what sentiment . they use newswire and discussion forums in Chinese, English, and Spanish . |
| Outcome: | The proposed corpus records who believes what (i.e., factuality) and who has what sentiment towards what. |
Copied to clipboard
| Challenge: | We evaluate the performance of large language models (LLMs) against expert and novice human players. |
| Approach: | They propose to use the New York Times Connections game as a test bed to evaluate the abstract reasoning capabilities of large language models (LLMs) they propose to test the ability of large-language models to be able to cluster and categorize words using semantic relations. |
| Outcome: | The proposed game is a test bed for evaluating abstract reasoning capabilities in humans and AI systems. |
Copied to clipboard
| Challenge: | Recent interest in Argumentation Mining has brought to the fore the need for corpora annotated with argument information, which can be used as training data. |
| Approach: | They propose a set of guidelines for the annotation of argument schemes and a new annotation tool for the 'inferential' argument schemes. |
| Outcome: | The proposed corpus includes 112 argumentative microtexts and a new annotation tool. |
Copied to clipboard
| Challenge: | Argument mining is a field of corpus-based discourse analysis that involves the automatic identification of argumentative structures in text. |
| Approach: | They propose a computational model for argument mining in online persuasive discussion forums that brings together the micro-level (argument as product) and macro-level models of argumentation. |
| Outcome: | The proposed model improves on existing models using pointer networks and a pre-trained language model. |
Copied to clipboard
| Challenge: | Social norms fundamentally shape interpersonal communication. |
| Approach: | They propose a human-in-the-loop pipeline to synthesize a bilingual dyadic dialogue dataset with turn-by-turn annotations of social norms for Chinese and American cultures. |
| Outcome: | The proposed dataset is high-quality through human evaluation and compares with existing models. |
Copied to clipboard
| Challenge: | Current research on developing computational models of social norms has focused on American society. |
| Approach: | They propose to leverage a Chinese Q&A platform and a socialchiemistry dataset as proxies for contrasting cultural axes and align social situations cross-culturally. |
| Outcome: | The proposed model can reason across cultures using a Chinese Q&A platform and the existing socialChemistry dataset. |
Copied to clipboard
| Challenge: | Existing models for visual entailment and visual question-answering have limited ability to understand figurative meaning in images and captions. |
| Approach: | They propose a task framing the figurative meaning understanding problem as an explainable visual entailment task where the model has to predict whether the image entitles a caption and justify the predicted label with a textual explanation. |
| Outcome: | The proposed dataset contains 6,027 image, caption, label, explanation instances covering five diverse figurative phenomena. |
Copied to clipboard
| Challenge: | Affective responses to music are highly personal, but it's difficult to measure marginal effects of these variables . a study of 403M listener comments on a social music platform in china aims to address this gap . |
| Approach: | They propose to measure affective responses to music from 403M listener comments on a Chinese social music platform. |
| Outcome: | The proposed method identifies musical, lyrical, contextual, demographic, and mental health effects that drive listener affective responses from over 403M listener comments on a Chinese social music platform. |
Copied to clipboard
| Challenge: | Polysynthetic languages are low-resource, lacking large scale annotated datasets needed to build and/or evaluate computational models. |
| Approach: | They propose to use linguistic priors to help with morphological segmentation and part-of-speech tagging tasks for Adyghe and Inuktitut . |
| Outcome: | The proposed methods improve morphological segmentation and part-of-speech tagging tasks on Adyghe and Inuktitut. |
Copied to clipboard
| Challenge: | Existing work on sarcasm generation focuses on context incongruity, but new work addresses this problem . |
| Approach: | They propose an unsupervised approach for sarcasm generation based on a non-sarcastic input sentence. |
| Outcome: | The proposed method generates sarcasm better than humans 34% of the time and better than a reinforced hybrid baseline 90% of the times. |
Copied to clipboard
| Challenge: | Fallacies are used as seemingly valid arguments to support a position and persuade the audience about its validity. |
| Approach: | They propose to use instruction-based prompting to recognize 28 unique fallacies across datasets . they also analyze the effect of model size and prompt choice on model performance . |
| Outcome: | The proposed approach can recognize 28 unique fallacies across domains and genres. |
Copied to clipboard
| Challenge: | a new method for generating metaphors is proposed to generate literal sentences . human evaluations show that our best model generates metaphors better than three well-crafted baselines 66% of the time on average. |
| Approach: | They propose a method to automatically construct a parallel corpus by transforming literal sentences to metaphorical ones using commonsense inference and masked language modeling. |
| Outcome: | The proposed method generates metaphors better than baselines 66% of the time on average. |
Copied to clipboard
| Challenge: | a limited set of translations into one or more high-resource languages are available for POS tagging . a bi-LSTM architecture that uses contextualized word embeddings improves performance . |
| Approach: | They propose an unsupervised cross-lingual transfer approach for part-of-speech tagging . they use the Bible as parallel data to learn POS taggers for target languages . |
| Outcome: | The proposed approach improves accuracy on 12 diverse languages . the Bible is used as a parallel corpus for the study . |
Copied to clipboard
| Challenge: | Experimental results show that identifying the phases of opioid use disorder is highly contextual and challenging. |
| Approach: | They analyze 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use . they annotate span-level extractive explanations and critically evaluate state-of-the-art models in a supervised, few-shot, or zero-shot setting. |
| Outcome: | The proposed models improve classification accuracy and quality of the extracted explanations. |
Copied to clipboard
| Challenge: | A 2018 study led by the Media Insight Project showed that most journalists think that their news organizations should clearly mark what is news reporting and what is commentary or opinion in order to combat fake news and gain public trust. |
| Approach: | They propose to classify news articles into newsstories and opinion pieces using models that aim to sup-plement the article content representation with argumentation features. |
| Outcome: | The proposed model outperforms linguistic features and improves on fine-tuned transformer-based models on data from publishers. |
Copied to clipboard
| Challenge: | Detecting arguments in online interactions is useful to understand how conflicts arise and get resolved. |
| Approach: | They propose to use a corpus annotated with argumentative moves and sarcasm to model sarcastic relationships using deep learning architectures. |
| Outcome: | The proposed setup improves the argumentative relation classification task using deep learning architectures. |
Copied to clipboard
| Challenge: | a new study examines the use of emotion detection for detecting psychological stress in online posts . traditional multi-task learning and emotion-based language model fine-tuning are used to improve the model . |
| Approach: | They propose to use a semantically related task, emotion detection, for detecting psychological stress in online posts . they propose multi-task learning and emotion-based language model fine-tuning to improve the model . |
| Outcome: | The proposed model is more explainable and human-like than a black-box model . the proposed model mirrors psychological components of stress, the authors show . |
Copied to clipboard
| Challenge: | Recent authorship attribution methods learn authorship representations of text in a latent, uninterpretable space, which hinders their usability in real-world applications. |
| Approach: | They propose a method for interpreting latent authorship representations by identifying representative points in the latent space and leveraging large language models to generate informative natural language descriptions of the writing style associated with each point. |
| Outcome: | The proposed method outperforms baseline methods on the authorship attribution task by +20% on average when aided with explanations from the method. |
Copied to clipboard
| Challenge: | Existing methods to understand acceptable behavior have focused on a single culture and manually built datasets from non-conversational settings. |
| Approach: | They propose a framework to automatically extract culture-specific norms from multi-lingual conversations. |
| Outcome: | The proposed framework extracts culture-specific norms from multi-lingual conversations. |
Copied to clipboard
| Challenge: | Figurative language understanding is a recognizing textual entailment task, but lacks data for figurative language. |
| Approach: | They propose to use a dataset to analyze figurative NLI instances with explanations to improve models' performance. |
| Outcome: | The proposed dataset can scale up models even for figurative language using human annotations. |
Copied to clipboard
| Challenge: | Using large amounts of unlabeled data to improve performance has become the foundation for many natural language processing tasks. |
| Approach: | They propose a task-specific semi-supervised approach that uses unlabeled data in a more task-agnostic manner. |
| Outcome: | The proposed approach achieves similar performance to BERT on a set of sequence tagging tasks with less financial and environmental impact. |
Copied to clipboard
| Challenge: | avrahami et al., 2022b,a): natural language instructions are often underspecified, requiring models to uncover their implicit meaning. |
| Approach: | They propose to use paired data to model the implicit meaning of instructions . they also propose to ground the model to localize where the edit has to be performed . |
| Outcome: | The proposed model performs better than state-of-the-art baselines on paired data, showing improvements in quality and faithfulness. |
Copied to clipboard
| Challenge: | Detecting what emotions are expressed in text is a well-studied problem in natural language processing. |
| Approach: | They propose methods that combine common-sense knowledge with multi-task learning to perform joint emotion classification and emotion cause tagging. |
| Outcome: | The proposed models improve on both tasks when using common-sense reasoning and a multitask framework. |
Copied to clipboard
| Challenge: | Existing work on fallacy recognition is still in its early stages, with limited datasets available. |
| Approach: | They propose to use GPT3.5 to generate synthetic examples and explore prompt settings to improve the representation of the infrequent classes. |
| Outcome: | The proposed model improves on existing models and generates synthetic examples with GPT3.5. |
Copied to clipboard
| Challenge: | Unsupervised morphological segmentation is an essential subtask in many natural language processing applications. |
| Approach: | They introduce two types of priors: grammar definition and linguist-provided affixes . they show that priors boost morphological segmentation performance in a minimally-supervised manner . |
| Outcome: | The proposed priors achieve 8.9% and 34.2% error reductions over the state-of-the-art unsupervised system. |
Copied to clipboard
| Challenge: | BLUR is a tip-of-the-tongue known-item search and reasoning benchmark for general AI assistants. |
| Approach: | They introduce a tip-of-the-tongue known-item search and reasoning benchmark for general AI assistants. |
| Outcome: | The proposed benchmark demands searching and reasoning across multimodal and multilingual inputs, as well as proficient tool use, in order to excel on. |
Copied to clipboard
| Challenge: | Low-resource languages lack annotated data even for basic syntactic information such as parts of speech. |
| Approach: | They propose an unsupervised cross-lingual approach for POS tagging for low-resource languages of rich morphology . they further investigate morpheme-level alignment and projection and use of linguistic priors for morphological segmentation . |
| Outcome: | The proposed approach outperforms the word-based approach and outperfies word-driven approaches. |