Papers with recognition
Copied to clipboard
| Challenge: | This PhD thesis focuses on the automatic generation and recognition of verbal punning humor in Portuguese. |
| Approach: | They propose to combine natural language generation and cognitive processing to generate and recognize verbal humor in Portuguese. |
| Outcome: | The proposed methods aim to generate and recognize humor in Portuguese, an underdeveloped language compared to English. |
Copied to clipboard
| Challenge: | Existing studies show that speech recognition systems depend on multiple factors including lexical content, speaker identity and dialect. |
| Approach: | They propose a method that evaluates the impact of emotion on recognition even when manual transcripts are not available. |
| Outcome: | The proposed method allows to evaluate the impact of emotion on recognition even when manual transcripts are not available. |
Copied to clipboard
| Challenge: | lexical studies of word processing and lexicon access provide evidence of preferred nature of word-initial versus word-final segments . conjecture that languages have evolved to provide more information earlier in words is based on existing methods . |
| Approach: | They propose to use a new method to assess the informativeness of word-initial versus word-final segments. |
| Outcome: | The proposed measures avoid the confounds found in existing methods. |
Copied to clipboard
| Challenge: | Existing work on vision and language navigation relies on navigation-related losses to establish the connection between vision and modalities, neglecting aspects of helping the navigation agent build a deep understanding of the visual environment. |
| Approach: | They propose to provide indirect supervision to the navigation agent through a hint generator that generates visual descriptions during navigation. |
| Outcome: | The proposed method improves the navigation performance and interpretability of the R2R and R4R datasets. |
Copied to clipboard
| Challenge: | BiomedCurator uses state-of-the-art natural language processing techniques to extract structured data from scientific articles. |
| Approach: | They propose a web application that extracts structured data from PubMed and ClinicalTrials.gov . the application uses a combination of natural language processing techniques and a pattern-based extraction approach . |
| Outcome: | The proposed system extracts the structured data from PubMed and ClinicalTrials.gov datasets. |
Copied to clipboard
| Challenge: | Despite the lack of acoustic-phonetic invariance in speech, listeners can reliably recognize spoken words despite the lack aural-phonemic invariancy. |
| Approach: | They propose a deep neural model which is trained to retrieve the meaning of a word given its spoken form, a task which resembles that faced by a human listener. |
| Outcome: | The proposed model is more sensitive to dialectical variation than gender variation and more related to related languages. |
Copied to clipboard
| Challenge: | Existing approaches to extract aspects from text are supervised and unsupervised . experimental results show that unsupervised approaches are more accurate than supervised ones . |
| Approach: | They propose to combine a lexical rule-based approach with coreference resolution to improve accuracy. |
| Outcome: | The proposed approach outperforms baseline methods on two benchmark datasets. |
Copied to clipboard
| Challenge: | Prior work has studied fingerspelling recognition, but little attention has been paid to how well models understand it in context of entire sentences. |
| Approach: | They annotate instances of fingerspelling within FLEURS-ASL and use it to evaluate how well translation models understand it. |
| Outcome: | The proposed model family significantly improves understanding of fingerspelling, but the effect of the mixed model is mixed. |
Copied to clipboard
| Challenge: | BB system is among the top two systems in five of all six subtasks . knowledge about microbial diversity is crucial for the study of microbiome and bacteria . |
| Approach: | They present a system that uses word embedding and lexical features to perform entities recognition, normalization and relation extraction. |
| Outcome: | The proposed system achieves state-of-the-art in five of six subtasks and is among the top two in five. |
Copied to clipboard
| Challenge: | Mainstream cross-lingual task-oriented dialogue systems often overlook the transfer to lower-resource colloquial varieties due to limited test data. |
| Approach: | They propose to train a model for intent recognition and slot-filling in English and apply it to other languages. |
| Outcome: | The proposed model performs better than existing models on English and other languages. |
Copied to clipboard
| Challenge: | Existing concepts recognition methods that rely on explicit mention identification fail to capture complex concepts not explicitly stated in the text. |
| Approach: | They propose a framework that reformulates concept recognition as an indexing-recognition task. |
| Outcome: | The proposed framework reduces computational requirements and improves recognition efficiency in low-resource settings. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental task aimed at identifying entities such as names, locations, and organizations. |
| Approach: | They propose a self-correcting and noise-augmented method for complex Biological and Chemical Named Entity Recognition that improves learning diversity and confidence. |
| Outcome: | The proposed method outperforms baseline methods on CHEMDNER and microbial ecology datasets by 1.80 and 2.73 F1-scores. |
Copied to clipboard
| Challenge: | Existing negation detection methods in English are not available. |
| Approach: | They propose to annotate a Dutch dialogue corpus with negation cues and their scopes. |
| Outcome: | The proposed method can detect negation cues and scope in Dutch dialogues with high precision and recall. |
Copied to clipboard
| Challenge: | Existing punctuation in the transcripts has a massive effect on the models’ performance, and specific label set specificity does not affect dialog act segmentation performance. |
| Approach: | They apply two pre-trained transformer models to a conversation transcript as a sequence of dialog acts and achieve strong results on Switchboard Dialog Act and Meeting Recorder Dialog Act corpora. |
| Outcome: | The proposed models achieve 8.4% and 14.2% error rates on the Switchboard Dialog Act and Meeting Recorder Dialog Act corpora. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are used in psychological counseling to provide universal advice. |
| Approach: | They constructed a multi-turn empathetic conversation dataset with 2 million samples . they found that the model's empathy ability is enhanced when finetuning . |
| Outcome: | Experiments show that large language models can be finetuned to provide empathy . but, when applied to mental health or emotional support conversation, there are three main issues . |
Copied to clipboard
| Challenge: | LVLMs have been shown to perform well on simple uni-modal benchmarks, but their detailed study on multi-modal models is still lacking. |
| Approach: | They propose a framework to analyze the impact of compression on LVLMs on multi-modal input driven tasks. |
| Outcome: | The proposed framework analyzes the impact of compression on generative performance of large vision language models on multi-modal input driven tasks. |
Copied to clipboard
| Challenge: | Recent studies have demonstrated that large language models possess robust pattern recognition and semantic understanding capabilities over time series data. |
| Approach: | They propose a time series model that converts time series input into token embeddings and aligns time sequence embeddables with text prompts. |
| Outcome: | The proposed framework achieves the state-of-the-art (SOTA) performance and has potentials for wide industrial usages. |
Copied to clipboard
| Challenge: | Existing methods to pre-train speech and text use unlabeled data to learn universal feature representations. |
| Approach: | They propose a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. |
| Outcome: | The proposed method achieves between 1.7 and 2.3 BLEU improvement above the state of the art on the MuST-C speech translation dataset and comparable WERs to wav2vec 2.0 on the Librispeech speech recognition task. |
Copied to clipboard
| Challenge: | Unsupervised speech representation learning has shown success at finding representations that correlate with phonetic structures and improve downstream speech recognition performance. |
| Approach: | They evaluate unsupervised speech representation learning representations by looking at their robustness to domain shifts and their ability to improve recognition performance in many languages. |
| Outcome: | The proposed representations improve the recognition performance in 25 phonetically diverse languages and are robust to domain shifts. |
Copied to clipboard
| Challenge: | Automatic Speech Recognition (ASR) systems have a substantial number of erroneous recognition due to environmental noise, ambiguity, etc. |
| Approach: | They use a benchmark dataset to analyze ASR errors in the Chinese language . they then apply large language models to correct ASR error correction . |
| Outcome: | The proposed method is based on a dataset of ASR errors in the Chinese language . it shows prompting is not effective for ASR error correction . |
Copied to clipboard
| Challenge: | Sign language processing is gaining interest in the computer vision and natural language processing communities. |
| Approach: | They propose a model that jointly detects fingerspelling and matches it to a text sequence. |
| Outcome: | The proposed model outperforms baseline methods on a large public dataset of ASL fingerspelling in the wild. |
Copied to clipboard
| Challenge: | Existing evaluations of emotional intelligence in large language models (LLMs) focus on basic sentiment analysis tasks, such as emotion recognition, which is not enough to evaluate LLMs’ overall emotional intelligence. |
| Approach: | They propose a framework for evaluating the emotional intelligence of large language models (LLMs) that includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
| Outcome: | The proposed framework includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
Copied to clipboard
| Challenge: | Existing models use graph networks to implicitly model reasoning skills . but it is yet to be seen whether modeling these reasoning skills implicitly is competitive with intuitive reasoning skills between one entity pair in this document. |
| Approach: | They propose a discriminative reasoning framework to explicitly model the paths of reasoning skills between entity pairs in a document. |
| Outcome: | The proposed method outperforms the previous state-of-the-art on the large-scale DocRE dataset. |
Copied to clipboard
| Challenge: | Existing work on the recognition of verbal humour in Portuguese has not been done . humor recognition is a sign of fluency in a language, and is not yet widely used in other languages. |
| Approach: | They propose to create three corpora covering two styles of humour and four sources of non-humorous text that are used for testing computational models. |
| Outcome: | The proposed models can be used to train and test models in Portuguese, and may be used as baselines for future projects. |
Copied to clipboard
| Challenge: | Generally, commonsense knowledge is correlated with culture and geographic locations and is only shared locally. |
| Approach: | They construct a Geo-Diverse Visual Commonsense Reasoning dataset to test vision-and-language models’ ability to understand cultural and geo-location-specific commonsense. |
| Outcome: | The proposed models perform better in non-Western regions including East Asia, South Asia, and Africa than in the Western regions. |
Copied to clipboard
| Challenge: | a new method for generating chart annotations is proposed to improve visual reasoning in multimodal large language models. |
| Approach: | They propose a code-as-intermediary translation method for distilling visual reasoning abilities from LLMs to MLLMs. |
| Outcome: | The proposed method is cost-effective, efficient and scalable. |
Copied to clipboard
| Challenge: | Existing methods to identify police killings from text have not been applied to this problem . et al., 2017: finding names of people killed by police is a critical problem despite public attention . |
| Approach: | They propose a method to deal with multiple appearances of police names in documents . they propose hierarchical LSTMs to model multiple sentences that contain names of interests . |
| Outcome: | The proposed method yields state-of-the-art performance for police killing detection . it relies on hierarchical LSTMs to model the multiple sentences that contain the person names of interests . |
Copied to clipboard
| Challenge: | Using multi-task evaluation, we examine how independent demographic bias mechanisms are from general demographic recognition in language models. |
| Approach: | They compare attribution-based and correlation-based methods for locating bias features in language models to find out which features are independent from general demographic recognition. |
| Outcome: | The proposed method reduces bias without degrading recognition performance. |
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) is essential for dialogue systems to identify the emotions expressed by speakers. |
| Approach: | They propose a method that incorporates both belief and desire to accurately identify emotions by extracting emotion-eliciting events from utterances and construct graphs that represent beliefs and desires in conversations. |
| Outcome: | The proposed model outperforms existing models on four popular ERC datasets and validates its performance with multiple state-of-the-art models. |
Copied to clipboard
| Challenge: | Existing approaches to handwritten mathematical expression recognition are limited by CFGs and pre-generated triplet data. |
| Approach: | They propose an architecture that integrates recognition and language features to output corrected sequences while optimizing with a string decoder recognition model. |
| Outcome: | The proposed architecture outperforms state-of-the-art methods on CROHME datasets. |
Copied to clipboard
| Challenge: | Using available datasets, we compare deep learning and traditional machine learning methods for various NLP tasks in Italian. |
| Approach: | They compare deep learning and traditional machine learning methods for various NLP tasks in Italian. |
| Outcome: | The proposed methods outperform traditional methods in sequence tagging tasks and classification tasks in Italian. |
Copied to clipboard
| Challenge: | kNN-LM and cross-attention techniques are used to extend text based retrieval to other modalities . wide adoption of large language models has driven new application areas leveraging this technology . |
| Approach: | They propose to use kNN-LM and cross-attention techniques to extend text retrieval methods to other modalities. |
| Outcome: | The proposed methods outperform text-based retrieval and improve word error rate on a speech recognition dataset. |
Copied to clipboard
| Challenge: | Existing SOTA methods for normalization rely on expert-designed rules or grammars . current methods are domain sensitive and not sufficient on emerging corpora . |
| Approach: | They propose a method that generates normalization rules from annotated data without expert intervention. |
| Outcome: | The proposed method surpasses existing rule-based methods on the Tweets benchmark and on the TempEval-3 benchmark. |
Copied to clipboard
| Challenge: | Existing methods for named entity recognition assume entities are not nested within other entities, so-called flat NER. |
| Approach: | They propose a layered method for nested named entity recognition . they use a set of hidden states to exclude the influence of the best path . |
| Outcome: | The proposed method performs better on ACE2004, ACE2005, and GENIA datasets. |
Copied to clipboard
| Challenge: | Existing MVQA models ignore multi-level progressive capabilities due to unspecific data and plain architecture. |
| Approach: | They propose a multi-level visual language model for medical visual question answering (MVQA) which covers multi- level questions and answers as well as reasoning processes from visual clues to semantic cognition. |
| Outcome: | The proposed model outperforms existing medical multimodal large language models on a multi-level instruction dataset and a feature alignment module. |
Copied to clipboard
| Challenge: | Figures of speech often deviate from their literal meanings to express deeper semantic implications. |
| Approach: | They propose a concept of figurative unit, which is the carrier of a figure, and build a Chinese corpus for Contextualized Figure Recognition. |
| Outcome: | The proposed model is based on 12 types of figures commonly used in Chinese . it shows that the proposed tasks are challenging for existing models . |
Copied to clipboard
| Challenge: | Pretrained language models do not utilize valuable geospatial information in large databases, e.g., OpenStreetMap. |
| Approach: | They propose a geospatially grounded language model that connects linguistic and geospheric contexts. |
| Outcome: | The proposed model bridges the gap between natural language processing and geospatial sciences. |
Copied to clipboard
| Challenge: | despite progress in machine translation, some form of language understanding may be desirable . current systems rely on pattern recognition, but some form may be useful . |
| Approach: | They use semantic role labeling to annotate a standard parallel corpus with semantic roles . they then train a neural machine translation system using the annotated corpus and original unannotated text . |
| Outcome: | The proposed system improves BLEU scores for English, French, German, Greek and Spanish. |
Copied to clipboard
| Challenge: | Recent research on slot filling has witnessed considerable improvement with considerable data and label shifts. |
| Approach: | They propose an adaptive end-to-end metric learning scheme for zero-shot slot filling that uses context-aware soft label representations and slot-level contrastive representation learning to mitigate the data and label shift problems. |
| Outcome: | The proposed approach outperforms existing methods on public benchmarks and shows that it is simple, efficient and generalizable. |
Copied to clipboard
| Challenge: | Existing data resources to support multimodal affective analysis in dialogues are limited in scale and diversity. |
| Approach: | They propose a multimodal multi-scene multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series. |
| Outcome: | The proposed dataset contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9,082 turns and 24,449 utterances. |
Copied to clipboard
| Challenge: | Existing methods for document parsing often employ multiple models, limiting performance . Existing models often employ discrete tokens, whereas recognition relies on continuous coordinates . |
| Approach: | They propose a Gaussian-Kernel Cross-Entropy Loss (GK-CEL) that unifies detection and recognition by enabling generative frameworks to handle both tasks simultaneously. |
| Outcome: | The proposed model performs competitively across four core document parsing tasks. |
Copied to clipboard
| Challenge: | In this paper, we focus on verbal MWEs, whose accurate recognition is challenging because they could be discontinuous. |
| Approach: | They conduct large-scale annotations of VMWEs on the Wall Street Journal portion of Ontonotes . they first construct a VMwe dictionary based on the english-language Wiktionary . |
| Outcome: | The proposed resource annotates 7,833 VMWE instances belonging to various categories . the authors hope the results will help to develop models for MWE recognition and dependency parsing . |
Copied to clipboard
| Challenge: | Existing models for code-switching between languages are under-resourced and limited by text and acoustic data. |
| Approach: | They propose to construct four separate bilingual automatic speech recognisers corresponding to four different language pairs between which speakers switch frequently. |
| Outcome: | The proposed models are compared with a non-batch-wise approach and show that they perform better when used with sparse training data. |
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task to identify textual spans that correspond to named entities in the given text. |
| Approach: | They propose a model that can generalize to entities unseen during training and handle noisy annotations. |
| Outcome: | The proposed model outperforms existing methods on both MNER and GMNER benchmarks and is robust and accurate. |
Copied to clipboard
| Challenge: | A simile is a figure of speech that compares two different things via shared properties. |
| Approach: | They propose a multilingual simile dialogue dataset that can be used to study similes in real-life scenarios. |
| Outcome: | The proposed dataset is the largest manually annotated simile dataset and contains both English and Chinese data. |
Copied to clipboard
| Challenge: | a parallel "infodemic" has emerged with the COVID-19 pandemic . logical fallacies can be subtly encoded in the structure of a document across multiple sentences . |
| Approach: | They evaluate an annotation schema for labeling logical fallacy types using linguist annotations . they propose to use a machine learning algorithm to train annotators for fallacy detection . |
| Outcome: | The proposed annotation schema is clear and non-overlapping for manual and system assignment. |
Copied to clipboard
| Challenge: | Current sign language recognition methods use spatial graphs and temporal modules to capture spatial and temporal features, but their spatial graph modules are typically built on fixed graph structures. |
| Approach: | They propose a new spatial architecture that captures input-sensitive joint relationships and a temporal module to model multi-scale temporal information to capture complex human dynamics. |
| Outcome: | The proposed method achieves state-of-the-art accuracy on four large-scale SLR benchmarks. |
Copied to clipboard
| Challenge: | Language documentation involves recording the speech of native speakers. |
| Approach: | They propose to use a neural network architecture to model phonemes and tones versus modelling them separately. |
| Outcome: | The proposed method improves efficiency, minimizes typographical errors and maintains transcription faithfulness to acoustic signal while highlighting phonetic and phonemic facts for linguistic consideration. |
Copied to clipboard
| Challenge: | In bilingual or multilingual settings, code-switching ASR has greater challenges and research value. |
| Approach: | They propose a controllable iterative method for improving the performance of mainstream automatic speech recognition systems by using Chinese-English code-switching dialogues. |
| Outcome: | The proposed method achieves the best performance compared with the rule-based, back-translation-based data augmentation methods and large language model ChatGPT. |
Copied to clipboard
| Challenge: | Vision-Language Models (VLMs) perform well on textual equations, but fail on visually grounded counterparts. |
| Approach: | They propose to decompose visual equation solving into symbolic equation solving and visual recognition into two core components to understand this gap. |
| Outcome: | The proposed models perform well on textual equations, but fail on visual grounded ones. |
Copied to clipboard
| Challenge: | a corpus of regionalisms, parts of speech and recognition rates is published in the Dictionnaire des Régionalismes de France. |
| Approach: | They propose to curate and analyze the corpus of regionalisms published in the Dictionnaire des Régionalismes de France. |
| Outcome: | The corpus contains all entries in the DRF for which recognition rates were recorded . the analysis compares with previous work on regionalalisms and atlas . |
Copied to clipboard
| Challenge: | Existing sign language datasets are limited and skewed towards high-income sign languages, mainly those from high-risk countries. |
| Approach: | They propose a large and highly multilingual dataset for sign language translation: JWSign. |
| Outcome: | The proposed dataset consists of 2,530 hours of Bible translations in 98 sign languages, featuring more than 1,500 individual signers. |
Copied to clipboard
| Challenge: | Recognizing classroom dialogue acts has significant promise for yielding insight into teaching, student learning, and classroom dynamics. |
| Approach: | They propose to use a contrastive learning-based self-supervised approach to improve classroom dialogue act recognition from limited labeled data by increasing the accuracy of dialogue act recognization and minimizing embedding distance between the same dialogue acts. |
| Outcome: | The proposed model outperforms baseline models when trained with limited examples per dialogue act and outperformed other few-shot models that require considerably more labeled data. |
Copied to clipboard
| Challenge: | Existing work on predicting relations based on text corpus has focused on analyzing raw texts mentioning two entities. |
| Approach: | They propose a framework that can be used to rationalize medical relation prediction . they recall contexts associated with the target entities and recognize relational interactions between them . |
| Outcome: | The proposed framework can achieve competitive predictive performance against a comprehensive list of neural baseline models, and present rationales to justify its prediction. |
Copied to clipboard
| Challenge: | despite the extensive use of HMMs for sign recognition, determining the HMM structure remains a challenge . despite their success in modeling sequential and multivariate data, establishing the structure remains challenging . |
| Approach: | They propose a continuous HMM framework for modeling and recognizing isolated signs . they propose to optimize the number of states for each sign separately during recognition . |
| Outcome: | The proposed model performs better on three different datasets and is competitive with existing models. |
Copied to clipboard
| Challenge: | Existing resources are largely devoted to English NLP, and there is little support for these studies in under resourced languages. |
| Approach: | They propose to build a corpus in Brazilian Portuguese to support both the recognition of mental health issues and the temporal analysis of these illnesses. |
| Outcome: | The proposed corpus will support both the recognition of mental health issues and the temporal analysis of these illnesses in the Brazilian Portuguese language. |
Copied to clipboard
| Challenge: | Existing benchmarks focus on evaluating MLLMs’ pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. |
| Approach: | They propose a benchmark designed for visual clue-driven reasoning in daily scenarios that combines rigorous grounding in authentic daily activities and challenging query design that necessitates more than surface-level perception. |
| Outcome: | The proposed benchmark identifies visual clues and their ability to provide robust reasoning in daily scenarios. |
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have expanded capabilities beyond text understanding . a novel Chinese financial multimodal evaluation benchmark is used to evaluate LVLM capabilities . |
| Approach: | They propose a Chinese financial multimodal evaluation benchmark to evaluate LVLMs' capabilities . the model has an overall accuracy of 66.11% and an average score of 77.18 . |
| Outcome: | The proposed model achieves an overall accuracy of 66.11% on the question answering task and an average score of 77.18 on detection, recognition, and information extraction tasks. |
Copied to clipboard
| Challenge: | Experimental evaluations conducted on the CMeEE, a benchmark for Chinese nested medical named entity recognition (NER) model outperforms the compared state-of-the-art (SOTA) models. |
| Approach: | They propose a model based on machine reading comprehension that uses a task-adaptive pre-training strategy to improve the model’s capability in the medical field. |
| Outcome: | The proposed model outperforms the compared state-of-the-art models on the CMeEE, a benchmark for Chinese nested medical NER. |
Copied to clipboard
| Challenge: | According to psychological and neuroscientific research, a high-stress environment can restrict attentional resources and intensify negative affect, thereby impairing the ability to understand emotions. |
| Approach: | They constructed a large-vision language model that combines race, gender, and age group and used the Pretend prompt technique to induce LVLMs to interpret others’ emotions. |
| Outcome: | The results suggest that the effects of high-stress and demographic attributes identified in human research may also be reflected in LVLMs. |
Copied to clipboard
| Challenge: | End-to-end (E2E) models are replacing hybrid models for automatic speech recognition tasks. |
| Approach: | They propose a method to optimize E2E models for automatic speech recognition . they propose MED-IT, a multi-turn consultation speech dataset . |
| Outcome: | The proposed method improves on subsets of rare words appearing in training speech. |
Copied to clipboard
| Challenge: | Prior work has shown that a range of speaker and listener attributes affect or correlate with the prevalence of code-switching during conversation. |
| Approach: | They analyze the names of entities and dialogue acts present in a Spanish-English spontaneous speech corpus and build a predictive model of CSW. |
| Outcome: | The proposed model is the first to take a discourse-sensitive approach to understanding pragmatic and referential cues of bilingual speech. |
Copied to clipboard
| Challenge: | Inertial sensors can measure the acceleration and angular velocity of moving objects and are widely used in electronic devices such as smartphones, smartwatches, and fitness bands. |
| Approach: | They propose to use Chinese glyph encoding, forced optimal transport, and semantic relevance alignment to acquire unlimited training samples for Chinese inertial writing recognition. |
| Outcome: | The proposed system improves the performance of six widely used classifiers from 6.7% to 98.4%. |
Copied to clipboard
| Challenge: | Existing models lack accurate modeling of cognitive empathy, especially the ability to understand users’ emotions and their underlying psychological causes. |
| Approach: | They propose a model tailored for the Chinese cultural context that integrates cognitive empathy into LLMs. |
| Outcome: | The proposed model outperforms existing models in key evaluation metrics, particularly in empathy, comprehensibility, and professionalism. |
Copied to clipboard
| Challenge: | Large vision-language models have shown impressive ability in various language tasks, especially with their emergent in-context learning capability. |
| Approach: | They propose a causal reasoning benchmark for multi-modal in-context learning from large vision-language models that incorporates visual inputs. |
| Outcome: | The proposed model outperforms existing models on three visual causal reasoning tasks and demonstrates their strengths and weaknesses. |
Copied to clipboard
| Challenge: | Existing zero-shot (ZS) approaches emphasize human motion while underutilizing contextual information, particularly human–object interactions. |
| Approach: | They propose a framework for ZS recognition and zero-to-few-shot adaptation that leverages instance-level language descriptions. |
| Outcome: | The proposed framework outperforms keypoint-based ZS methods while remaining data-efficient and robust. |
Copied to clipboard
| Challenge: | Existing safety evaluations focus on hazard recognition through disembodied question answering (QA) settings, but lack a critical gap in evaluating an agent. |
| Approach: | They evaluate multimodal large language models with six categories of kitchen hazards . they propose a safety-based approach that prioritizes multi-step corrective actions . |
| Outcome: | The proposed model can recognize hazards in QA settings, but average mitigation success rates are low . the proposed model is based on the embodied agent benchmark ALFRED . |