Papers with modeling
Unsupervised Learning of Distributional Relation Vectors (P18-1)
Copied to clipboard
| Challenge: | Existing word embedding models rely on co-occurrence statistics to learn vector representations of word meaning. |
| Approach: | They propose a method which directly learns relation vectors from co-occurrence statistics. |
| Outcome: | The proposed method is based on a variant of GloVe, which has an explicit connection between word vectors and PMI weighted co-occurrence vectors. |
A guide to the dataset explosion in QA, NLI, and commonsense reasoning (2020.coling-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide an up-to-date guide to the recent datasets . the target audience is the NLP practitioners who are lost in dozens of the recent data sets. |
| Approach: | This tutorial provides an up-to-date guide to the recent datasets . it surveys old and new methodological issues with dataset construction . |
| Outcome: | This tutorial aims to provide an up-to-date guide to the recent datasets . it surveys the old and new methodological issues with dataset construction . |
Eidos, INDRA, & Delphi: From Free Text to Executable Causal Models (N19-4)
Copied to clipboard
Rebecca Sharp, Adarsh Pyarelal, Benjamin Gyori, Keith Alcock, Egoitz Laparra, Marco A. Valenzuela-Escárcega, Ajay Nagesh, Vikas Yadav, John Bachman, Zheng Tang, Heather Lent, Fan Luo, Mithun Paul, Steven Bethard, Kobus Barnard, Clayton Morrison, Mihai Surdeanu
| Challenge: | a paper proposes a method for building probabilistic models of complex phenomena such as food insecurity . currently, these models are hand-built for each new situation and require months to construct . |
| Approach: | They propose an approach that builds executable probabilistic models from raw, free text. |
| Outcome: | The proposed approach builds executable probabilistic models from raw, free text. |
Multimodal large language models for inclusive collaboration learning tasks (2022.naacl-srw)
Copied to clipboard
| Challenge: | This project leverages advances in multimodal large language models to build an inclusive collaboration feedback loop for participants developing general collaboration skills. |
| Approach: | They propose to integrate advances in multimodal large language models into downstream tasks such as the learning analytics feedback loop. |
| Outcome: | The proposed model will be used to detect, model, and feedback participants developing general collaboration skills. |
SynJax: Structured Probability Distributions for JAX (2023.emnlp-demo)
Copied to clipboard
| Challenge: | a number of deep learning libraries have been developed to account for structured objects . a vectorized implementation of inference algorithms for structured distributions is difficult to implement . |
| Approach: | SynJax provides vectorized implementations of inference algorithms for structured distributions . authors propose to use a vectorized version of the algorithms to model structure in data . similar structures appear in biology and chemistry . |
| Outcome: | SynJax provides an efficient vectorized implementation of inference algorithms for structured distributions. |
FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing models for Word Sense Disambiguation struggle to disambiguate rare senses . current models struggle to learn senses with few training examples . |
| Approach: | They introduce a low-shot WSD dataset automatically extracted from example sentences in Wiktionary. |
| Outcome: | The proposed dataset outperforms baseline models on rare senses in existing datasets. |
MENLI: Robust Evaluation Metrics from Natural Language Inference (2023.tacl-1)
Copied to clipboard
| Challenge: | Recent proposed BERT-based evaluation metrics for text generation are vulnerable to adversarial attacks, e.g., relating to information correctness. |
| Approach: | They propose to use BERT-based evaluation metrics for text generation to evaluate text for semantic similarity but are vulnerable to adversarial attacks using Natural Language Inference. |
| Outcome: | The proposed metrics outperform existing summarization metrics but perform below SOTA MT metrics on standard benchmarks. |
Measuring the Effect of Influential Messages on Varying Personas (2023.acl-short)
Copied to clipboard
| Challenge: | a new task estimates the response a persona might have upon seeing a news message . a first benchmark dataset is used to evaluate the performance of the proposed task . |
| Approach: | They propose a task to estimate the response a persona might have upon seeing a news message. |
| Outcome: | The proposed task estimates the response a persona might have upon seeing a news message. |
Rigid Formats Controlled Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural text generation is a challenging task that requires rigid formats to be controlled . a framework called SongNet is designed to tackle this problem . |
| Approach: | They propose a framework to tackle a task called rigid formats controlled text generation . they propose rhyming schemes and a transformer-based auto-regressive language model to improve the modeling performance . |
| Outcome: | The proposed framework improves the performance on format, rhyme, and sentence integrity. |
A Semi-supervised Scalable Unified Framework for E-commerce Query Classification (2025.acl-industry)
Copied to clipboard
Chunyuan Yuan, Chong Zhang, Zhen Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law
| Challenge: | Existing query classification methods rely on posterior click behavior to construct training samples, resulting in insufficient prior information for modeling. |
| Approach: | They propose a semi-supervised scaleable unified framework that integrates enhanced modules to unify query classification tasks. |
| Outcome: | The proposed framework outperforms the state-of-the-art models in offline and online A/B experiments. |
Time-LlaMA: Adapting Large Language Models for Time Series Modeling via Dynamic Low-rank Adaptation (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that large language models possess robust pattern recognition and semantic understanding capabilities over time series data. |
| Approach: | They propose a time series model that converts time series input into token embeddings and aligns time sequence embeddables with text prompts. |
| Outcome: | The proposed framework achieves the state-of-the-art (SOTA) performance and has potentials for wide industrial usages. |
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail to generate singing voices rich in stylistic nuances for unseen singers due to multifaceted nature of singing styles. |
| Approach: | They propose a zero-shot SVS model for style transfer across cross-lingual speech and singing styles and multi-level style control. |
| Outcome: | Experimental results show that TCSinger outperforms baseline models in synthesis quality, singer similarity, and style controllability. |
BBScoreV2: Learning Time-Evolution and Latent Alignment from Stochastic Representation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive generative models are gaining traction in language tasks such as text generation and machine translation. |
| Approach: | They propose a likelihood-based evaluation metric that fits transformer-based model embeddings into a stochastic process and propose it as a probability-based metric. |
| Outcome: | The proposed model embeddings induce a "clustered-to-temporal ordered" mapping of language model representations in high-dimensional space, and this structure enhances performance on tasks such as temporal consistency evaluation and AI-generated content detection. |
Identifying Self-Disclosures of Use, Misuse and Addiction in Community-based Social Media Posts (2024.findings-naacl)
Copied to clipboard
Chenghao Yang, Tuhin Chakrabarty, Karli Hochstatter, Melissa Slavin, Nabila El-Bassel, Smaranda Muresan
| Challenge: | Experimental results show that identifying the phases of opioid use disorder is highly contextual and challenging. |
| Approach: | They analyze 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use . they annotate span-level extractive explanations and critically evaluate state-of-the-art models in a supervised, few-shot, or zero-shot setting. |
| Outcome: | The proposed models improve classification accuracy and quality of the extracted explanations. |
Building Representative Corpora from Illiterate Communities: A Reviewof Challenges and Mitigation Strategies for Developing Countries (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for collecting data from high-income countries (HICs) make implicit assumptions about literacy and internet access, but in low-income and sub-Saharan Africa (SSA) such assumptions may not hold for LICs where the bulk of the population lives. |
| Approach: | They propose a set of practical mitigation strategies to address the under-representation of illiterate communities in NLP corpora. |
| Outcome: | The proposed methods address the under-representation of illiterate communities in NLP corpora and propose mitigation strategies to help future work. |
Relation Extraction with Type-aware Map Memories of Word Dependencies (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on the dependency connections between words with limited attention paid to exploiting dependency types. |
| Approach: | They propose a neural approach for relation extraction with type-aware map memories . they map all associated words along with dependencies among them to memory slots . |
| Outcome: | The proposed approach achieves state-of-the-art on two English benchmark datasets. |
Semantic Role Labeling with Heterogeneous Syntactic Knowledge (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on incorporating syntactic knowledge into neural semantic role labeling has gained much attention . incorporating heterogeneous syntaktic knowledge brings significant improvements over strong baselines . |
| Approach: | They propose to encode heterogeneous syntactic knowledge for SRL from explicit and implicit representations from heterogenous treebanks. |
| Outcome: | The proposed approaches improve on two widely-used benchmark datasets. |
OLIVE: Object Level In-Context Visual Embeddings (2024.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language models lack fine-grained object-level understanding and grounding . existing models implicitly align text tokens with image patch tokens, which is ineffective for embedding alignment at the same granularity and introduces noisy spurious background features. |
| Approach: | They propose a method to prompt large language models with in-context visual object vectors . this method allows for controllable object-level reasoning . |
| Outcome: | The proposed method achieves competitive referring object classification and captioning performance while offering zero-shot generalization and robustness to visually challenging contexts. |
Speech-to-Speech Translation for a Real-world Unwritten Language (2023.findings-acl)
Copied to clipboard
Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Pino, Wei-Ning Hsu, Ann Lee
| Challenge: | a new study examines speech-to-speech translation (S2ST) that translates speech from one language into another . the research area for unwritten languages remains a research area with little exploration due to the lack of training data. |
| Approach: | They propose a system that translates speech from one language into another . they use Taiwanese Hokkien as an example of an unwritten language . |
| Outcome: | The proposed system can be used to train models in languages without standard writing systems. |
OCNLI: Original Chinese Natural Language Inference (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent efforts to extend natural language understanding to other languages have focused on (automatically) translating existing English datasets. |
| Approach: | They propose to use a Chinese dataset to generate annotated sentences from native speakers specializing in linguistics to elicit annotations. |
| Outcome: | The proposed dataset does not rely on automatic translation or non-expert annotation. instead, it elicits annotations from native speakers specializing in linguistics. |
Depression Detection in Clinical Interviews with LLM-Empowered Structural Element Graph (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for assessing depression only capture part of relevant elements . scarcity of participant data constrains interview modeling due to privacy concerns . |
| Approach: | They propose a structural element graph (SEGA) that transforms clinical interviews into an expertise-inspired directed acyclic graph for comprehensive modeling. |
| Outcome: | The proposed model outperforms baseline methods and powerful LLMs on two real-world clinical datasets. |
Revisiting Character-Based Neural Machine Translation with Capacity and Compression (D18-1)
Copied to clipboard
| Challenge: | Translating characters instead of words or word-fragments can simplify the processing pipeline but results in longer sequences . |
| Approach: | They propose to use sequence-to-sequence architectures of sufficient depth to solve the problem . they also evaluate the performance versus computation time tradeoffs they offer . |
| Outcome: | The proposed models outperform models operating over word fragments in character-level NMT, the authors show . they also show that the proposed models do not match the performance of their deep character baseline model . |
Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on dialect prediction is limited to coarse-grained varieties . a new language model, MARBERT, can predict micro-dialects with 9.9% F1, 76 better than a majority class baseline. |
| Approach: | They propose a new task of Micro-Dialect Identification (MDI) that can predict a fine-grained variety given a single message. |
| Outcome: | The proposed model predicts micro-dialects with 9.9% F1, 76 better than a majority class baseline. |
Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Language models can memorize detailed information and patterns, but raise privacy concerns . ANADP reduces the performance gap between regular and DP fine-tuning while maintaining the privacy constraints. |
| Approach: | They propose an algorithm that allocates additive noise based on the importance of model parameters to reduce the performance gap between regular fine-tuning and traditional DP fine- tuning. |
| Outcome: | The proposed algorithm narrows the performance gap between regular fine-tuning and traditional DP fine- tuning while maintaining privacy constraints. |
Visual Modeling of Turkish Morphology (2020.lrec-1)
Copied to clipboard
| Challenge: | Currently, there are three publicly accessible morphological analyzers for Turkish . |
| Approach: | They propose to make modeling easier and more maintainable by using diagramming tools and automating much of the code generation. |
| Outcome: | The proposed model can be easily maintained and the code generation automated. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows (2026.findings-acl)
Copied to clipboard
Haoyu Dong, Pengkun Zhang, Yan Gao, Xuanyu Dong, Yilin Cheng, Mingzhe Lu, Adina Yakefu, Shuxin Zheng
| Challenge: | FinWorkBench evaluates real-world enterprise-grade finance and accounting workflows . a human evaluation of GPT 5.1 Pro passes only 38.4% of workflows, a study finds . |
| Approach: | They propose a workflow construction process that combines LLM-assisted mining and expert annotation to build 172 composite workflows. |
| Outcome: | The proposed process combines expert annotation with LLM-assisted mining of workflows from authentic enterprise environments. |
CREPE: Open-Domain Question Answering with False Presuppositions (2023.acl-long)
Copied to clipboard
| Challenge: | Existing question answering datasets assume all questions have well defined answers. |
| Approach: | They propose a QA dataset containing a distribution of false presuppositions . they find that 25% of questions contain false presumptions . |
| Outcome: | The proposed model finds that 25% of questions contain false presuppositions . the model can find presuffpositions moderately well, but struggle when predicting correctness . |
Embedding Dynamic Attributed Networks by Modeling the Evolution Processes (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to embed nodes into low-dimensional vectors focus on static networks, but in practice, many networks are evolving over time and hence are dynamic, e.g., social networks. |
| Approach: | They propose to extract high-order neighborhood information at each given timestamp and then use an embedding prediction framework to capture the temporal correlations. |
| Outcome: | Extensive experiments on four real-world datasets show that the proposed method outperforms baseline methods for dynamic link prediction and node classification tasks. |
Multimodal Transformer for Unaligned Multimodal Language Sequences (P19-1)
Copied to clipboard
Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, Ruslan Salakhutdinov
| Challenge: | Human language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. |
| Approach: | They propose a multimodal model that extends the standard Transformer network to learn representations directly from unaligned multimodal streams. |
| Outcome: | The proposed model outperforms state-of-the-art methods on aligned and non-aligned data. |
A Two-Step Approach for Implicit Event Argument Detection (2020.acl-main)
Copied to clipboard
| Challenge: | et al., 2015) only consider local arguments in the same sentence of the event trigger. |
| Approach: | They propose to decompose the implicit event argument detection task into two sub-problems . they propose to use argument head-word detection and head-to-span expansion to reduce the number of candidates. |
| Outcome: | The proposed model achieves better performance than a strong sequence labeling baseline. |
Recognizing Semantic Relations by Combining Transformers and Fully Connected Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Current approaches to recognizing semantic relations between words are limited and require a word-path model. |
| Approach: | They propose a distributional approach that is based on an attention-based transformer and a word path model that combines useful properties of a convolutional network with a fully connected language model. |
| Outcome: | The proposed model outperforms the state-of-the-art in terms of performance and data sources. |
Improving Bengali and Hindi Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Bengali and Hindi are low-resource languages, and the state-of-the-art tokenization methods fail to separate roots from affixes. |
| Approach: | They used BERT and Wordpiece tokenizers to train a wordpiece tokenization system for Bengali and Hindi to model fine-grained character-level information. |
| Outcome: | The proposed tokenizers outperform the state-of-the-art and Wordpiece tokenizer for modeling Bengali and Hindi. |
Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Empathy plays a pivotal role in fostering prosocial behavior, often triggered by the sharing of personal experiences through narratives. |
| Approach: | They propose to use contrastive learning with masked LMs and supervised fine-tuning with large language models to improve empathy understanding in NLP models. |
| Outcome: | The proposed methods show that there is low agreement among annotators and that cultural differences are a factor in their interpretation of empathy. |
ModelCitizens: Representing Community Voices in Online Safety (2025.emnlp-main)
Copied to clipboard
Ashima Suvarna, Christina A Chance, Karolina Naranjo, Hamid Palangi, Sophie Hao, Thomas Hartvigsen, Saadia Gabriel
| Challenge: | Existing toxic language detection models are trained on annotations that collapse diverse perspectives into a single ground truth. |
| Approach: | They propose to augment social media posts with conversational scenarios to reflect the impact of conversational context on toxicity. |
| Outcome: | The proposed model outperforms existing models on social media with conversational scenarios. |
Analyzing and Modeling LLM Response Lengths with Extreme Value Theory: Anchoring Effects and Hybrid Distributions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches treat length as an incidental output property rather than a statistically regular phenomenon worthy of rigorous modeling. |
| Approach: | They propose a statistical framework for modeling and controlling large language model response lengths using extreme value theory and cross-validation on Qwen and DeepSeek architectures. |
| Outcome: | The proposed model improves tail fit and generalizability while maintaining generalizzability. |
Making Revisions Understandable: A Survey of Edit Intentions, Methods, and Applications (2026.findings-acl)
Copied to clipboard
| Challenge: | Text revision is a core process in document creation, capturing how authors iteratively refine, reorganize, and improve written content. |
| Approach: | They synthesize text revision research through the lens of edit intentions . they review prior work across the revision workflow including corpus construction, edit intention taxonomies, edit intentions, and edit intention identification. |
| Outcome: | The proposed approach synthesizes datasets, taxonomies, identification methods, and applications and highlights key open research directions. |
ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Media (2025.emnlp-main)
Copied to clipboard
Aakash Kumar Agarwal, Saprativa Bhattacharjee, Mauli Rastogi, Jemima S. Jacob, Biplab Banerjee, Rashmi Gupta, Pushpak Bhattacharyya
| Challenge: | Almost 50% of depression patients face the risk of going into relapse. |
| Approach: | They propose to validate a social media dataset on depression relapse using cognitive theories of depression. |
| Outcome: | The first clinically validated social media dataset focused on depression relapse comprises 204 Reddit users annotated by mental health professionals. |
FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes (2026.findings-acl)
Copied to clipboard
| Challenge: | Suicide memes are increasingly common on social media, yet remain poorly understood and potentially harmful. |
| Approach: | They propose a dataset designed for fine-grained analysis of suicide memes and benchmark 16 models for figurative language, suicide severity, and content detection. |
| Outcome: | The proposed model outperforms existing models on figurative language, suicide severity, and suicide-related content detection tasks. |