Papers with identification
Copied to clipboard
| Challenge: | Existing models for fake news detection are limited in their ability to detect it from different aspects. |
| Approach: | They propose a Dual Co-Attention Network (Dual-CAN) for fake news detection that takes news content, social media replies, and external knowledge into consideration. |
| Outcome: | The proposed model outperforms existing models in two benchmark datasets. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are used for depression detection but their application remains unexplored. |
| Approach: | They propose to integrate acoustic speech information into LLMs for depression detection by integrating aural landmarks into the framework. |
| Outcome: | The proposed method adds critical dimensions to speech transcripts and provides insights into the unique speech patterns of individuals. |
Copied to clipboard
| Challenge: | Xu et al., 2019) show that pre-trained language model fine-tuning and prompt tuning are better than manual prompt engineering for clarification identification. |
| Approach: | They propose to use pre-trained language model fine-tuning, prompt tuning and manual prompt engineering to model clarification identification. |
| Outcome: | The proposed model outperforms pre-trained language model fine-tuning, prompt tuning and manual prompt engineering on the task of clarification identification. |
Copied to clipboard
| Challenge: | a new dataset, MuDoCo, is composed of authored dialogs between a fictional user and a system . the dialogs cross domains and users exhibit complex task switching behavior . |
| Approach: | They propose a new dataset, MuDoCo, composed of authored dialogs between a fictional user and a system . they propose two baseline models for the downstream tasks: coreference resolution and referring expression generation. |
| Outcome: | The proposed dataset contains 8,429 dialogs with an average of 5.36 turns per dialog . the users exhibit complex task switching behavior such as re-initiating a previous task . |
Copied to clipboard
| Challenge: | a new named entity extraction system is proposed for biological texts . the system is based on machine learning and deep learning . |
| Approach: | They propose a named entity extraction system based on machine learning and deep learning . they propose to map drug names in Spanish biomedical texts using Snomed . |
| Outcome: | The proposed system achieves 78% in the first sub-track and 72% in the second task. |
Copied to clipboard
| Challenge: | Existing approaches to author obfuscation are largely heuristic, but they can be used to attack author identification. |
| Approach: | They propose a deep learning architecture for constructing adversarial examples against similarity-based learners and explore its application to author obfuscation. |
| Outcome: | The proposed architectures show that they can be used to attack author obfuscation . the proposed architecture shows that it can be applied to obliquacy of text . |
Copied to clipboard
| Challenge: | Existing methods for identifying and resolving persona knowledge gaps are underexplored. |
| Approach: | They propose a framework that dynamically detects and resolves persona knowledge gaps using intrinsic uncertainty quantification and feedback-driven refinement. |
| Outcome: | The proposed framework detects and resolves persona knowledge gaps using intrinsic uncertainty quantification and feedback-driven refinement on two real-world datasets: CCPE-M for preferential movie recommendations and ESConv for mental health support. |
Copied to clipboard
| Challenge: | a pipeline is used to identify, extract and link research infrastructure used in scientific publications. |
| Approach: | They propose a natural language processing pipeline for the identification, extraction and linking of Research Infrastructure (RI) used in scientific publications. |
| Outcome: | The proposed pipeline can be used to identify, extract and link research infrastructure used in scientific publications. |
Copied to clipboard
| Challenge: | Abstractive summarization is a core application in contact centers, where Large Language Models generate millions of summaries of call transcripts daily. |
| Approach: | They propose a framework that uses an LLM as a zero-shot classifier to derive categorical distributions for each bias dimension in a pair of transcripts and its summary. |
| Outcome: | The proposed framework identifies and quantifies 15 operational bias dimensions and measures them using two metrics: Fidelity Gap and Coverage. |
Copied to clipboard
| Challenge: | Large language models have shown promise for generative and knowledge-intensive tasks including question-answering (QA) but the practical deployment still faces challenges, notably the issue of “hallucination”, where models generate plausible-sounding but unfaithful or nonsensical information. |
| Approach: | They propose a self-reflection methodology that incorporates knowledge acquisition and answer generation to address the issue of "hallucination" they use a set of LLMs to generate a more accurate and factually accurate answer. |
| Outcome: | The proposed approach improves factuality, consistency, and entailment of the generated answers. |
Copied to clipboard
| Challenge: | Argument mining has focused on the identification, extraction, and formalization of arguments. |
| Approach: | They propose a framework that relies on a recommender-based architecture to predict stances and argumentative main points on societally controversial topics for a given stakeholder. |
| Outcome: | The proposed framework predicts arguments on a debate topic based on BERTScore and debate.org datasets. |
Copied to clipboard
| Challenge: | Document-level event factuality identification (DEFI) assesses the veracity degree to which an event mentioned in a document has happened. |
| Approach: | They propose a document-level event factuality identification framework with hallucination features . they propose factualusion corpus that integrates both genuine and hallucinous false information . |
| Outcome: | The proposed framework outperforms baselines in document event factuality identification. |
Copied to clipboard
| Challenge: | Visual arguments rely on images to persuade viewers to do or believe something . |
| Approach: | They propose three tasks for evaluating visual argument understanding . they use visual premises, commonsense premises and reasoning trees to analyze visual arguments . |
| Outcome: | The proposed tasks evaluate visual argument understanding using a dataset of 1,611 images annotated with 5,112 visual premises (with regions), 5,574 commonsense premises, and reasoning trees connecting them into structured arguments. |
Copied to clipboard
| Challenge: | We present a corpus of Swiss German speech annotated with Standard German text at the sentence level. |
| Approach: | They present a corpus of Swiss German speech annotated with Standard German sentences . they use a web app to show the speakers standard German sentences and record them . |
| Outcome: | The corpus contains 343 hours of speech from all Swiss German dialect regions . it is the largest public speech corpus for Swiss German to date . |
Copied to clipboard
| Challenge: | Recent studies on fine-grained intent detection have focused on collecting large-scale and high-quality samples via crowdsourcing resulting in data scarcity. |
| Approach: | They propose an iterative differential generation framework with contrastive feedback to generate high-quality pseudo samples and accurately capture the crucial nuances in target class distribution. |
| Outcome: | The proposed framework generates high-quality pseudo samples and captures crucial nuances in target class distribution. |
Copied to clipboard
| Challenge: | a recent study compares the semantic parsing of encyclopedic history texts with the Berkeley FrameNet project. |
| Approach: | They propose to use Berkeley FrameNet to parse encyclopedic history texts . they use a sequence labeling model which optimizes frame identification and role segmentation . |
| Outcome: | The proposed approach leverages the manual annotation of larger corpora than full text parsing. |
Copied to clipboard
| Challenge: | Existing research studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns. |
| Approach: | They propose a framework that leverages the theory of contextual integrity as a bridge to help LLMs understand the complex contexts for judicial assessing privacy violations. |
| Outcome: | The proposed framework bridges the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA). |
Copied to clipboard
| Challenge: | Long-context question answering tasks often require identifying evidence spans (e.g., sentences) prior work showed that jointly training models to perform evidence extraction and question answering is important for achieving high performance. |
| Approach: | They propose a method for equipping long-context QA models with an additional sequence-level objective for better identification of the supporting evidence. |
| Outcome: | The proposed method exhibits consistent improvements on three different strong long-context transformer models, across two challenging question answering benchmarks – HotpotQA and QAsper. |
Copied to clipboard
| Challenge: | Existing studies focus on causality existence, but ignore causal direction. |
| Approach: | They propose a new *identifying while learning* mode for the ECI task that takes care of the causal direction and updates events’ representations for boosting next round of causality identification. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on two public datasets. |
Copied to clipboard
| Challenge: | Prior work has shown that safety behaviors are governed by low-rank structures . Low-Rank Adaptation (LoRA) consistently underperforms full fine-tuning and reinforcement learning on safety benchmarks . |
| Approach: | They propose a safety alignment system that disentangles safety-relevant directions into monosemantic features and constructs an interpretable safety subspace from SAE directions. |
| Outcome: | Empirically, the proposed model achieves 99.6% safety rates across multiple model families and scales . low-rank Adaptation consistently underperforms full fine-tuning and reinforcement learning on safety benchmarks compared with previous methods . |
Copied to clipboard
| Challenge: | Ellipsis is an important challenge for natural language processing systems, says a new paper . previous work on ellipsis focused on news data, but sluicing presents a challenge for dialogue systems . |
| Approach: | They describe a corpus of 4100 sluice occurrences from the NYTimes Gigaword corpus . they build a classifier model to automatically classify slujce . |
| Outcome: | The proposed corpus contains 4100 sluice occurrences, with an accuracy of 67% . the work will support empirical research into slujcing in dialogue systems . |
Copied to clipboard
| Challenge: | Existing methods to detect hallucinated content are limited by their tendency to generate factual errors. |
| Approach: | They propose a black-box sampling-based method that enables fine-grained fact-level detection by representing text as interpretable knowledge graphs consisting of facts in the form of triples. |
| Outcome: | The proposed method improves hallucination correction by 35.5% compared to baseline methods while sentence-level SelfCheckGPT yields only 10.6% improvement. |
Copied to clipboard
| Challenge: | Natural language processing (NLP) text mining can increase productivity and innovation in the sciences by orders of magnitude. |
| Approach: | The Language Applications Grid is an infrastructure for rapid development of natural language processing applications (NLP) it provides an intuitive and easy-to-use platform for users to exploit NLP tools and resources . the Grid integrates the services and resources provided by PubAnnotation to greatly enhance the user's ability to annotate scientific publications . |
| Outcome: | The Language Applications (LAPPS) Grid is an infrastructure for rapid development of natural language processing applications (NLP) it integrates services and resources provided by PubAnnotation to greatly enhance user's ability to annotate scientific publications and share the results. |
Copied to clipboard
| Challenge: | Large neural networks in NLP produce real-valued representations that encode the bit of human language that they were trained on. |
| Approach: | They propose a kernelization of the recently-proposed linear concept-removal objective and propose to remove linear subspaces from the representation space. |
| Outcome: | The proposed kernelization protects against the ability of nonlinear adversaries to recover the concept. |
Copied to clipboard
| Challenge: | Existing metaphor identification datasets can be gamed by completely ignoring the potential metaphorical expression or the context in which it occurs. |
| Approach: | They show that existing metaphor identification datasets can be gamed by fully ignoring the potential metaphorical expression or the context in which it occurs. |
| Outcome: | The proposed system can be gamed by fully ignoring the potential metaphorical expression or the context in which it occurs. |
Copied to clipboard
| Challenge: | Identification and annotation of languages in an unambiguous and standardized way is essential for the description of linguistic data. |
| Approach: | They propose a pattern that extends the BCP 47 sub-tag ‘privateuse’ and is able to overcome the limits of BCP47 and ISO 639. |
| Outcome: | The proposed pattern overcomes the limitations of BCP 47 and ISO 639 for the identification of lesser-known languages, endangered languages, regional varieties or historical stages of a language. |
Copied to clipboard
| Challenge: | Existing methods to control for text-based confounders rely on assumption that there is no treatment leakage . prior literature has assumed that documents only contain information about confounder, but not about treatment assignment. |
| Approach: | They define the treatment leakage problem and propose methods to mitigate it . they remove treatment-related signal from text in a pre-processing step . |
| Outcome: | The proposed method can mitigate the problem of treatment leakage by removing the treatment-related signal from the text. |
Copied to clipboard
| Challenge: | Existing corpora in African languages reveal significant spelling inconsistencies, contributing to poor-quality textual data when encountered in written form. |
| Approach: | They propose a supervised method to identify loanwords in Portuguese . they employ traditional machine learning algorithms incorporating handcrafted features . |
| Outcome: | The proposed method achieves the F1-score of 93% in Emakhuwa, borrowed from Portuguese. |
Copied to clipboard
| Challenge: | Pre-trained systems are able to capture advice better than rule-based systems, but advice identification is challenging. |
| Approach: | They analyze a dataset of advice posts on two reddit forums and annotate whether they contain advice. |
| Outcome: | The proposed models show that pre-trained models capture advice better than rule-based systems, but advice identification is challenging. |
Copied to clipboard
| Challenge: | Existing methods for large language models with extended context lengths face significant computational challenges during the prefill phase. |
| Approach: | They propose a difference-aware, dynamic sparse attention mechanism that efficiently identifies critical attention regions at a finer stripe granularity while adapting to global contextual information. |
| Outcome: | The proposed model achieves a speedup of 1.44 while maintaining higher recall rates. |
Copied to clipboard
| Challenge: | Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP. |
| Approach: | They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens. |
| Outcome: | The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs. |
Copied to clipboard
| Challenge: | Current research on dialect identification is model-centric, focusing on performance. |
| Approach: | They propose a data-centric approach to find the shortest input needed to make a plausible guess. |
| Outcome: | The proposed method generalizes across dialects and datasets with two shortening criteria. |
Copied to clipboard
| Challenge: | Using a corpus of 25 Arabic city dialects and a lexicon of 1,045 concepts, we study 25 cities in a travel domain . focus on cities opens new avenues for research from dialectology to dialect identification and machine translation. |
| Approach: | They present two Arabic language resources that are part of the Multi Arabic Dialect Applications and Resources project. |
| Outcome: | The proposed resources are the first of their kind in terms of their coverage and fine granularity. |
Copied to clipboard
| Challenge: | a recent study shows that natural language models can perform tasks with little to no in-context supervision . a number of tasks are performed using self-supervised pre-training . |
| Approach: | They define and comprehensively evaluate how well natural language taskprompting captures the semantics of four tasks for bias: diagnosis, identification, extraction and rephrasing. |
| Outcome: | The proposed model performs to wide varying degrees across bias dimensions . the model is largely challenged when prompted to perform these tasks . |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models are crucial for academic writing . existing ground truth datasets do not treat fine-grained types like ML model and model architecture as separate entity types . |
| Approach: | They propose to annotate 100 full-text scientific publications and a first baseline model for 10 entity types centered around ML models and datasets. |
| Outcome: | The proposed model can be used to identify 10 entity types in scientific articles . existing models cannot recognize fine-grained models like ML models and model architecture . |
Copied to clipboard
| Challenge: | Existing studies on dialect identification have focused on binary classifications between colloquial Arabic and dialectal Egyptian . |
| Approach: | They propose to use an n-gram based SVM to classify on a fine-grained sub-dialectal level and compare it to methods used in dialect classification such as vocabulary pruning. |
| Outcome: | The proposed method is compared to methods used in dialect classification such as vocabulary pruning of shared items across dialects. |
Copied to clipboard
| Challenge: | Rhetorical figures are used to convey subtle, implicit meanings or to emphasize statements. |
| Approach: | They propose a web application that facilitates the identification and annotation of German rhetorical figures. |
| Outcome: | The proposed application improves the user experience with Retrieval Augmented Generation (RAG). |
Copied to clipboard
| Challenge: | Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples. |
| Approach: | They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. |
| Outcome: | The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks. |
Copied to clipboard
| Challenge: | Recent work on automatic paraphrasing focuses on methods leveraging machine translation as an intermediate step. |
| Approach: | They propose to learn paraphrasing models only from a monolingual corpus . they propose a residual variant of vector-quantized variational auto-encoder . |
| Outcome: | The proposed model outperforms supervised and unsupervised translation methods in paraphrase identification and training set augmentation. |
Copied to clipboard
| Challenge: | Language identification is a crucial component in the automated production of language resources. |
| Approach: | They propose a language identifier that combines fastText and Hunspell to give a second opinion before deciding which language to assign to a text. |
| Outcome: | The proposed language identifier is based on a pre-trained language identifier and a spell checker. |
Copied to clipboard
| Challenge: | Existing Twitter-based paraphrase datasets lack quality definitions for identification and generation tasks. |
| Approach: | They propose to use two separate definitions of paraphrase for identification and generation tasks in existing Twitter-based paraphrase datasets. |
| Outcome: | The proposed model achieves state-of-the-art performance of 84.2 F1 for automatic paraphrase identification compared to other models fine-tuned on other corpora such as Quora, MSCOCO, and ParaNMT. |
Copied to clipboard
| Challenge: | Existing work on argument mining uses context-based methods to identify whether two arguments are interactively related. |
| Approach: | They propose a contrastive learning framework to extract valuable information from the context. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the benchmark dataset and visually displays more compact representations. |
Copied to clipboard
| Challenge: | supervised event trigger identification models can generalize better across domains . prior work focused on annotating specific categories of events or narratives from specific domains. |
| Approach: | They propose to use adversarial domain adaptation framework to build supervised event trigger identification models which can generalize better across domains. |
| Outcome: | The proposed model improves on literature and news domains with no labeled data. |
Copied to clipboard
| Challenge: | Replicability and reproducibility are core ideas of modern scientific methods. |
| Approach: | They describe challenges encountered in reproducing the results of a top performing system in computational linguistics. |
| Outcome: | The proposed system was able to reproduce the results of a task 7 in the domain of natural language processing and computational linguistics. |
Copied to clipboard
| Challenge: | Large language models (LLMs) can modify their internal memory by incorporating the latest external knowledge, but in practical applications, outdated information may be inputted into LLMs. |
| Approach: | They propose a two-stage decoupling framework that separates the identification and computation of time constraints into a symbolic system and propose 'selective update' of internal memory based on time constraints. |
| Outcome: | The proposed framework improves ChatGPT performance by 60% and improves state-of-the-art LLM GPT-4. |
Copied to clipboard
| Challenge: | Recent advances in neural speech synthesis have enabled the development of text to speech systems for all languages. |
| Approach: | They propose to obtain a suitable corpus from unannotated Latvian audio recordings using automated speech recognition and speaker segmentation and identification. |
| Outcome: | The proposed method and software tools are applied and evaluated on a Latvian public radio archive data. |
Copied to clipboard
| Challenge: | Existing language models have limited sensitivity to temporal information and inadequate temporal reasoning capabilities. |
| Approach: | They propose a framework that enhances temporal awareness and reasoning . they propose to use Temporal Information-Aware Embedding and Granular Contrastive Reinforcement Learning . |
| Outcome: | The proposed framework outperforms existing LLMs on time-sensitive question answering tasks. |
Copied to clipboard
| Challenge: | Existing large language models (LLMs) that focus on Standard American English (SAE) often suffer from performance degradation when applied to other dialects. |
| Approach: | They propose a modular approach to imbue SAE-trained models with multi-dialectal robustness . they propose adapters which handle specific linguistic features to imbibe SAe-taught models . |
| Outcome: | The proposed approach improves performance across multiple dialects and dialects. |
Copied to clipboard
| Challenge: | In recent years, large language models (LLMs) have proven effective in generating coherent and contextually appropriate responses. |
| Approach: | They examine the ability of a model to adapt to the interlocutor's profile by masking or disclosing information about interlucutor . |
| Outcome: | The proposed model generalises well across topics, but struggles with unfamiliar interlocutors. |
Copied to clipboard
| Challenge: | Existing studies on the prevalence of mental disorders on the Web are limited to the English language. |
| Approach: | They propose to use user messages posted on Telegram groups to annotate the corpus for natural language processing and to conduct experiments on text classification and regression. |
| Outcome: | The proposed corpus contains over 1,300 subjects with more than 45,000 messages posted in different public Telegram groups. |
Copied to clipboard
| Challenge: | Existing methods for identifying practices within social media are not yet available. |
| Approach: | They propose a methodological workflow for computational identification of such practices within social media texts by using open-source models and OpenAI’s large language models. |
| Outcome: | The proposed method improves accuracy and supports context-sensitive moderation and advancing the understanding of online community dynamics. |
Copied to clipboard
| Challenge: | Prior work evaluating emotion and affective understanding in large language models rely on predetermined label sets or focus on a singular evaluation task. |
| Approach: | They examine the ability of multilingual language models to predict any term used by an author to label their own feelings or emotions. |
| Outcome: | The proposed models perform poorly on three different tasks in English and Spanish. |