Papers by Erik Cambria
Copied to clipboard
| Challenge: | Prompt Engineering has garnered significant attention for enhancing the performance of large language models across a multitude of tasks. |
| Approach: | They propose a simple prompting technique that yields more than 70% improvement in interpretability. |
| Outcome: | The proposed method improves interpretability by 70% across multiple dimensions. |
Copied to clipboard
| Challenge: | Existing charge prediction datasets focus on single-defendant cases, but real-world cases involve multiple defendants. |
| Approach: | They propose a benchmark that encompasses legal cases involving multiple defendants . they develop an interpretable model called EJudge that incorporates crime elements and legal rules to infer charges. |
| Outcome: | The proposed model outperforms state-of-the-art models in predicting crime charges while providing corresponding rationales. |
Copied to clipboard
| Challenge: | Inductive reasoning is a core component of human intelligence. |
| Approach: | They propose a task to induce natural language rules from natural language facts using natural language as representation for knowledge instead of formal language. |
| Outcome: | The proposed task surpasses baselines in both automatic and human evaluations. |
Copied to clipboard
| Challenge: | Present neural-based models exploit aspect and its contextual information in the sentence but ignore inter-aspect dependencies. |
| Approach: | They propose to combine aspect-based sentiment analysis with temporal dependency processing to incorporate this pattern into a sentence. |
| Outcome: | The proposed approach is based on the SemEval 2014 dataset and shows that it is effective for predicting sentiments of aspects in sentences with multiple aspects. |
Copied to clipboard
| Challenge: | EmpathyEar is an open-source, avatar-based multimodal empathetic chatbot . currently, ERG systems rely on text, sound, and vision . |
| Approach: | They propose an open-source, avatar-based multimodal empathetic chatbot to fill the gap in traditional text-only ERG systems. |
| Outcome: | The proposed system enables users to generate emotional responses to user queries . it can also generate avatars with talking faces and synchronized speeches . |
Copied to clipboard
| Challenge: | Existing methods for metaphor interpretation are slow due to lack of annotated datasets and effective pre-trained language models. |
| Approach: | They propose a large annotated dataset and a PLM for the metaphor interpretation task. |
| Outcome: | The proposed method improves on metaphor identification and interpretation with comparable baselines on the new dataset. |
Copied to clipboard
| Challenge: | Cross-domain Named Entity Recognition (CDNER) is crucial for Knowledge Graph (KG) construction and natural language processing (NLP) |
| Approach: | They propose to automatically generate task-oriented knowledge using large language models (LLMs) and then employ task-orientated pre-training (TOPT) to facilitate domain adaptation. |
| Outcome: | The proposed model can learn to distinguish between different entities and improve its domain adaptation. |
Copied to clipboard
| Challenge: | Existing systems that generate only coarse facial expressions ignore the rich and dynamic nature of face-to-face communication. |
| Approach: | They propose an end-to-end text-to expression model that explicitly focuses on emotional dynamics. |
| Outcome: | The proposed model outperforms baselines on 15,000 text–3D expression pairs on a large-scale dataset. |
Copied to clipboard
| Challenge: | Larger language models become better and worse at handling contextual information . et al. (2017) formalized contextual entrainment as a tendency to favor tokens in context . |
| Approach: | They formalize the first scaling laws for contextual entrainment . they find large models are four times more resistant to counterfactual misinformation . |
| Outcome: | The largest models are four times more resistant to counterfactual misinformation than the smallest, but twice as prone to copying arbitrary tokens. |
Copied to clipboard
| Challenge: | Emotion recognition in conversations has gained popularity due to its potential applications. Until now, a large multimodal multi-party emotional conversational database containing more than two speakers per dialogue was missing. |
| Approach: | They propose to extend and enhance EmotionLines by combining 13,000 utterances from Friends dialogues with emotion and sentiment labels. |
| Outcome: | The proposed dataset contains about 13,000 utterances from 1,433 dialogues from the TV-series Friends. |
Copied to clipboard
| Challenge: | Existing discourse parsing approaches are constrained by predefined relation types, which can impede the adaptability of the parser for downstream tasks. |
| Approach: | They propose to introduce a task-aware paradigm to improve the versatility of the parser. |
| Outcome: | Empirical studies on dialogue discourse parsing datasets and a downstream task demonstrate the proposed framework. |
Copied to clipboard
| Challenge: | Existing black-box-like deep learning methods for depression detection focus on improving classification performance, but it is impossible to explain and interpret those models that rely on state-of-the-art (SOTA) deep learning techniques. |
| Approach: | They propose to use hierarchical attention mechanisms and feed-forward neural networks to encode a model for depression detection on Twitter that leverages metaphorical concept mappings as input. |
| Outcome: | The proposed model leverages metaphorical concept mappings as input to detect depressed individuals and identify features of such users’ tweets. |
Copied to clipboard
| Challenge: | Existing large language models are limited in understanding, reasoning, calculation, and generation, limiting their performance in complex reasoning and dynamic tasks. |
| Approach: | They propose a plug-and-play framework that integrates a small-scale LLM (as agent) with large-scale large-level LLMs (a as environment) they propose generating prompts that are used to interact with LLM, and a double constraint reward that optimizes correctness and quality of generation. |
| Outcome: | The proposed framework significantly outperforms baseline large-scale large-language models across various tasks. |
Copied to clipboard
| Challenge: | Existing research on hypothetical induction is limited by the observation annotations in the dataset and the ground truth hypotheses are mostly commonsense knowledge. |
| Approach: | They propose a first dataset for social science academic hypotheses discovery using raw web corpus as observations and propose valid, useful scientific hypothese . they propose 'a multi-module framework' that includes feedback mechanisms to boost performance. |
| Outcome: | The proposed dataset generates valid, novel, and helpful scientific hypotheses, even new to humanity, using open-domain data and a web corpus as observations. |
Copied to clipboard
| Challenge: | Existing NLP methods lack robustness against greenwashed ESG content . existing methods often extract insights that reflect misleading or exaggerated sustainability claims rather than objective ESG performance. |
| Approach: | They propose to use a dataset to improve the robustness of ESG analysis amid the prevalence of greenwashing to analyze sustainability reports. |
| Outcome: | The proposed model improves robustness against greenwashed claims rather than objective ESG performance. |
Copied to clipboard
| Challenge: | SEA-BED examines how multilingual text embeddings perform across tasks and languages . performance gaps arise from data coverage, training objectives, and architectural design, authors say . |
| Approach: | They propose a large-scale benchmark covering 10 SEA languages and diverse embedding tasks. |
| Outcome: | The proposed model performs poorly across languages and tasks, but language-task analyses reveal inconsistencies . the results suggest that performance gaps arise from limitations in data coverage, training objectives, and architectural design. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown remarkable progress in reasoning capabilities, yet they still face challenges in complex, multi-step reasoning tasks. |
| Approach: | They propose a framework that synergistically integrates LLMs with knowledge graphs (KGs) to enhance reasoning performance and interpretability. |
| Outcome: | The proposed framework outperforms existing state-of-the-art methods on two benchmark KGQA datasets and improves on the MCTS process. |
Copied to clipboard
| Challenge: | Existing approaches to generalize deep neural networks are datahungry and generalize poorly from small datasets. |
| Approach: | They propose an agreement score to evaluate routing processes at instance-level and an adaptive optimizer to enhance routing. |
| Outcome: | The proposed approach improves on two NLP tasks and in low-resource settings with few training instances. |
Copied to clipboard
| Challenge: | a study of refusal in instruction-tuned language models identifies latent features that causally mediate refusal behaviors. |
| Approach: | They conduct a mechanistic study of refusal in instruction-tuned LLMs using sparse autoencoders . they identify latent features that causally mediate refusal behaviors using sparsed autoencoding . |
| Outcome: | The proposed method validates refusal-related features across multiple datasets. |
Copied to clipboard
| Challenge: | Recent abstractive approaches generate KPs based on sentences, resulting in overlapping and hallucinated opinions. |
| Approach: | They propose to use supervised learning to extract short sentences as key points before matching them to review comments for quantification of KP prevalence. |
| Outcome: | The proposed framework achieves state-of-the-art performance on Yelp and SPACE. |
Copied to clipboard
| Challenge: | Existing studies do not explicitly consider inter-personal influences that thrive in the emotional dynamics of dialogues. |
| Approach: | They propose a multimodal emotion detection framework that extracts multimodal features from conversational videos and hierarchically models the self- and inter-speaker emotional influences into global memories. |
| Outcome: | The proposed model outperforms state-of-the-art networks on multiple classification and regression tasks in two benchmark datasets. |
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis is a new approach to extract aspect specific sentimental information from user feedback. |
| Approach: | They propose a method that incorporates neighboring aspects related information into the sentiment classification of a target aspect using memory networks. |
| Outcome: | The proposed method outperforms the state-of-the-art by 1.6% on average in restaurant and laptop domains. |
Copied to clipboard
| Challenge: | Existing consistency training methods for named entity recognition (NER) are likely to violate the consistency hypothesis or focus on coarse-grain consistency. |
| Approach: | They propose a consistency training framework for cross-lingual named entity recognition that leverages unlabeled target-language data and dropout-based consistency training on labeled source-language datasets. |
| Outcome: | The proposed framework improves on translation-based consistency training on unlabeled target-language data and dropout-based consistent training on labeled source-language datasets. |
Copied to clipboard
| Challenge: | Traditional neural network models represent word senses as vectors that are uninterpretable for humans. |
| Approach: | They propose a framework that incorporates word Sense Disambiguation (WSD) by identifying and paraphrasing ambiguous words to improve sentiment predictions. |
| Outcome: | The proposed framework improves sentiment analysis accuracy and interpretability on a downstream task without ground-truth word sense labels. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are being used to generate content at an unprecedented scale, raising concerns over their misuse and saturation of the content space with artificially generated material. |
| Approach: | They propose to use large language models to generate text that looks indistinguishable from that written by humans. |
| Outcome: | The proposed model can generate 10-30 sentences to breach the plagiarism limit, the authors estimate . |
Copied to clipboard
| Challenge: | Sarcasm is an implicit form of sarcasm, involving an intended meaning that contradicts the literal expression . human use conflict between factual information and a statement as cues to detect sarcasm . sarkasmatic analysis is challenging due to its implicit nature . |
| Approach: | They propose a multimodal sarcasm detection dataset that uses multiple modalities to detect sarcasm. |
| Outcome: | The proposed model improves on previous models based on a single label . human sarcasm cannot be detected using a unified label across multiple modalities . |
Copied to clipboard
| Challenge: | Abstract: Large language models are gaining widespread adoption in natural language processing tasks. |
| Approach: | They propose a semi-supervised approach to optimize for plausibility of extracted rationales by using a pre-trained natural language inference model and a supervised NLI predictor. |
| Outcome: | The proposed model outperforms unsupervised models by > 100% on a ERASER dataset. |
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks have limited amount of labeled data . data augmentation methods suffer from token-label misalignment, which leads to unsatsifactory performance. |
| Approach: | They propose a data augmentation framework that explicitly injects NER labels into sentence context and generates high-quality augmented data with novel entities. |
| Outcome: | The proposed framework outperforms baseline methods on low-resource tasks. |
Copied to clipboard
| Challenge: | Existing methods for forward counterfactual generation face limitations . large language models (LLMs) offer promise but remain unexplored for this application . |
| Approach: | They propose a benchmark to support forward counterfactual generation in finance . they use financial news headlines to curate financial news and provide structured evaluation . |
| Outcome: | The proposed benchmark aims to provide scalable, automated insights into potential market opportunities and risks for stakeholders. |
Copied to clipboard
| Challenge: | Large language models have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. |
| Approach: | They propose a benchmark for evaluating large language models on a sufficient set of scientific discovery sub-tasks. |
| Outcome: | The proposed framework extracts critical components from papers across 12 disciplines with expert validation confirming its accuracy. |
Copied to clipboard
| Challenge: | Existing frameworks for extrapolating knowledge graphs are incomplete and do not represent real-world knowledge. |
| Approach: | They propose an explainable extrapolation reasoning framework that integrates propositional reasoning and first-order reasoning by introducing a reasoning graph that iteratively expands to find the answer. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines in explaining future facts based on past counterparts. |
Copied to clipboard
| Challenge: | Existing pretrained language models for mental health detection are inadequate . one in four people worldwide suffers from mental disorders . |
| Approach: | They train and release two pretrained masked language models to benefit machine learning for mental healthcare research . they demonstrate that language representations pretrained in the target domain improve the performance of mental health detection tasks. |
| Outcome: | The proposed models improve mental health detection tasks on several benchmarks and are available for free. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are capable of generating persuasive Natural Language Explanations (NLEs) however, the faithfulness of these explanations should not be readily trusted at face value. |
| Approach: | They propose to use a causal mediation technique called activation patching to measure the faithfulness of an explanation towards supporting the explained answer. |
| Outcome: | The proposed metric, Causal Faithfulness, quantifies the consistency of causal attributions between explanations and the corresponding model outputs as the indicator of faithfulness. |
Copied to clipboard
| Challenge: | Existing studies struggle with achieving global understanding of large language models . GraphMPA is a graph-based framework with mode-seeking preference alignment . |
| Approach: | They propose a graph-based framework with mode-seeking preference alignment to improve model outputs. |
| Outcome: | The proposed framework constructs a hierarchical document graph mimicking human cognitive processes for information understanding and synthesis. |
Copied to clipboard
| Challenge: | Existing methods to analyze images focus on superficial features or descriptions, omitting subtle contextual information. |
| Approach: | They propose a Visual Connotation and Aesthetic Attributes Understanding Network (Vanessa) for Multimodal Aspect-based Sentiment Analysis. |
| Outcome: | The proposed network captures both implicit and explicit sentimental cues and can be used to enrich textual sentiment analysis. |
Copied to clipboard
| Challenge: | Existing methods to bridge the linguistic gap between self-training and monolingual named entity recognition (NER) however, due to sub-optimal performance on target languages, the pseudo labels are noisy and limit the overall performance. |
| Approach: | They propose to combine representation learning and pseudo label refinement in one coherent framework to improve self-training for cross-lingual named entity recognition (NER) |
| Outcome: | The proposed method improves cross-lingual named entity recognition (NER) on multiple transfer pairs. |
Copied to clipboard
| Challenge: | Large language models (LLMs) often require extensive labeled datasets and training compute to achieve impressive performance across downstream tasks. |
| Approach: | They propose a self-training paradigm where the LLM curates its own labels and selectively trains on unknown data samples identified through a reference-free consistency method. |
| Outcome: | The proposed model reduces the dependency on large labeled datasets and mitigates catastrophic forgetting in out-of-distribution benchmarks. |
Copied to clipboard
| Challenge: | Existing approaches to tackle learning challenges such as knowledge forgetting and extensive computing resources are not effective. |
| Approach: | They propose a novel neurosymbolic method for sentiment analysis that places emphasis on human subjectivity within varying domain annotations. |
| Outcome: | The proposed method is lightweight, robust across domains and languages, efficient few-shot training, and rapid convergence. |
Copied to clipboard
| Challenge: | emergence of ChatGPT has generated speculation about its potential to disrupt social and economic systems. |
| Approach: | They analyze prior assessments of ChatGPT and GPT-4 to analyze their language and reasoning abilities, scientific knowledge, ethical considerations and existing evaluation methods. |
| Outcome: | The proposed model performs satisfactorily in science knowledge and can answer open questions. |
Copied to clipboard
| Challenge: | Existing methods for persona attribute extraction from conversations are inconsistent and unreliable. |
| Approach: | They propose a model with a hard negative sampling strategy for generalized zero-shot persona attribute extraction. |
| Outcome: | The proposed model outperforms existing models in persona attribute extraction tasks. |
Copied to clipboard
| Challenge: | Recent dominance of machine learning-based natural language processing methods has overemphasized model accuracies rather than studying the reasons behind their errors. |
| Approach: | They investigate the error patterns of some widely acknowledged sentiment analysis methods in the finance domain. |
| Outcome: | The proposed models are based on the existing models and have important clues for improving them. |
Copied to clipboard
| Challenge: | Pretrained language models have been shown to store knowledge in their parameters and have achieved reasonable performance in knowledge-intensive tasks. |
| Approach: | They propose to provide retrieved passages that contain relevant knowledge as additional input to the commonsense knowledge base completion (CKBC) task. |
| Outcome: | The proposed framework generates more valid, informative, and novel knowledge than the state-of-the-art COMET model for commonsense knowledge base completion (CKBC) tasks. |
Copied to clipboard
| Challenge: | Metaphors do not take literal meanings in contexts, which may cause difficulties for language learners and machines to understand them. |
| Approach: | They propose a computational metaphor processing online system that queries metaphoricity labels, paraphrases and concept mappings for non-domain-specific text. |
| Outcome: | The proposed system can query metaphoricity labels, paraphrases, and concept mappings for non-domain-specific text without coding background. |
Copied to clipboard
| Challenge: | Recent studies have revealed some issues of Multi-Head Attention (MHA) e.g., redundancy and over-parameterization. |
| Approach: | They propose to train attention heads with a self-supervised group constraint to focus on an essential but distinctive feature subset. |
| Outcome: | The proposed method achieves significant performance gains on three well-established tasks while significantly compressing parameters. |
Copied to clipboard
| Challenge: | Curriculum learning fails to generate consistent step-by-step reasoning in multilingual and low-resource settings. |
| Approach: | They propose a framework that combines supervised fine-tuning with reverse curriculum reinforcement learning to generate consistent step-by-step reasoning. |
| Outcome: | The proposed framework outperforms single-axis benchmarks and multilingual test sets on math reasoning tasks and in high-resource languages. |
Copied to clipboard
| Challenge: | Existing studies on sarcasm detection focus on lexical, syntactic and semantic cues, but sarcasm can be expressed implicitly without such cue. |
| Approach: | They propose a ContextuAl SarCasm DEtector which extracts contextual information from the discourse of a discussion thread. |
| Outcome: | The proposed model improves on a large Reddit corpus. |
Copied to clipboard
| Challenge: | Existing benchmarks for legal general intelligence (GI) are result-oriented and do not evaluate the legal intelligence of large language models (LLMs). |
| Approach: | They propose a Chinese legal benchmark for evaluating legal GI in large language models . they use recent legal cases and exam questions to create multiple-choice questions . |
| Outcome: | The proposed benchmarks lack a systematic evaluation of the legal intelligence of large language models (LLMs) the results show that even the best LLMs lagging behind human legal professionals. |
Copied to clipboard
| Challenge: | Analyzing human multimodal language is emerging area of research in NLP. |
| Approach: | They propose a multimodal fusion technique to exploit how modalities interact in multimodal language. |
| Outcome: | The proposed technique exploits how modalities interact with each other in human multimodal language. |
Copied to clipboard
| Challenge: | Despite recent advances, AI still struggles with complex tasks that require commonsense reasoning such as natural language understanding. |
| Approach: | They propose a commonsense-based framework that aims to overcome these limitations in the context of sentiment analysis. |
| Outcome: | The proposed framework overcomes these limitations in the context of sentiment analysis. |
Copied to clipboard
| Challenge: | Existing methods for recognizing emotions in conversations ignore inter-speaker dependency relations . dyadic conversations are a form of dialogue between two entities . |
| Approach: | They propose a deep neural framework which leverages contextual information from the conversation history to model past utterances of each speaker into memories. |
| Outcome: | The proposed framework improves by 3 4% over the state-of-the-art in recognizing emotions in dyadic conversational videos. |