Papers with Semantic Text Processing
A Self-Supervised Integration Method of Pretrained Language Models and Word Definitions (2023.findings-acl)
Copied to clipboard
| Challenge: | DefBERT integrates word definition modeling with word semantics in dictionaries. |
| Approach: | They propose a method that integrates pretrained models with word semantics in dictionaries. |
| Outcome: | The proposed method is effective on word similarity and short text classification tasks. |
A Study on Using Semantic Word Associations to Predict the Success of a Novel (2021.starsem-1)
Copied to clipboard
Syeda Jannatus Saba, Biddut Sarker Bijoy, Henry Gorelick, Sabir Ismail, Md Saiful Islam, Mohammad Ruhul Amin
| Challenge: | Existing methods for book success prediction are not effective. |
| Approach: | They propose to represent a book as a spectrum of concepts based on the association score between its content embedding and a global embeddment for a set of semantically linked word clusters. |
| Outcome: | The proposed method outperforms the previous methods for book success prediction. |
SpeedE: Euclidean Geometric Knowledge Graph Embedding Strikes Back (2024.findings-naacl)
Copied to clipboard
| Challenge: | Geometric knowledge graph embedding models (gKGEs) have shown great potential for knowledge graph completion (KGC) however, contemporary gKges require high embeddable dimensionalities or complex embeddances for good KGC performance, drastically limiting their time and space efficiency. |
| Approach: | They propose a lightweight Euclidean gKGE that provides strong inference capabilities and significantly outperforms state-of-the-art gGKGEs. |
| Outcome: | The proposed model outperforms state-of-the-art gKGEs on YAGO3-10 and WN18RR while significantly increasing their efficiency. |
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods achieve promising performance in in-target stance detection when trained and tested on the same datasets. |
| Approach: | They propose a joint contrastive learning framework to generalize stance features for unseen targets. |
| Outcome: | The proposed framework achieves state-of-the-art on three benchmark datasets. |
Correlations between Word Vector Sets (D19-1)
Copied to clipboard
| Challenge: | Similarity measures based on word embeddings are easily competing with deep learning and expert-engineered systems on unsupervised semantic textual similarity tasks. |
| Approach: | They propose a new approach to measure word embeddings using pooling operations and correlation coefficients instead of pooling . they also propose centered kernel alignment as a natural generalisation of squared cosine similarity for sets of word vectors. |
| Outcome: | The proposed approach outperforms most recent methods while being much faster and trivial to implement. |
Associative Multichannel Autoencoder for Multimodal Word Representation (D18-1)
Copied to clipboard
| Challenge: | Existing models that represent word meanings from word co-occurrences ignore associations between modalities and lack ability to transfer information between . |
| Approach: | They propose a novel associative multichannel autoencoder that integrates textual, visual and auditory inputs to learn multimodal word representations. |
| Outcome: | The proposed model outperforms strong unimodal models and state-of-the-art models on six benchmark concepts similarity tests. |
Language Models as Inductive Reasoners (2024.eacl-long)
Copied to clipboard
| Challenge: | Inductive reasoning is a core component of human intelligence. |
| Approach: | They propose a task to induce natural language rules from natural language facts using natural language as representation for knowledge instead of formal language. |
| Outcome: | The proposed task surpasses baselines in both automatic and human evaluations. |
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing SOTA techniques for semantic matching are mostly based on Siamese networks. |
| Approach: | They propose a novel knowledge distillation algorithm designed for real-time semantic matching . they train low latency accurate student models by leveraging soft labels from a teacher model . |
| Outcome: | The proposed algorithm outperforms teacher and SOTA knowledge distillation benchmarks on e-commerce datasets. |
Cross-lingual Similarity of Multilingual Representations Revisited (2022.aacl-main)
Copied to clipboard
| Challenge: | Similarity indexes like CKA and CCA are not suitable for cross-lingual learning analysis. |
| Approach: | They propose an alternative that is exempt from the difficulties of CKA/CCA and is good specifically in a cross-lingual context. |
| Outcome: | The proposed method is exempt from the difficulties of CKA/CCA and is good specifically in a cross-lingual context. |
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Non-Autoregressive Text Generation with Pre-trained Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Autoregressive generation models generate tokens in a left-to-right, token-by-token fashion, resulting in lag in inference. |
| Approach: | They propose to use BERT as the backbone of a non-autoregressive generation model for greatly improved performance. |
| Outcome: | The proposed model outperforms existing non-autoregressive models and achieves competitive performance with many strong autoregressive model. |
iPrOp: Interactive Prompt Optimization for Large Language Models with a Human in the Loop (2025.acl-srw)
Copied to clipboard
| Challenge: | Prompt engineering has made significant contributions to the era of large language models, yet its effectiveness depends on the skills of a prompt author. |
| Approach: | They propose a novel approach to prompt optimization that bridges manual prompt engineering and automatic prompt optimization by providing task-specific guidance. |
| Outcome: | The proposed approach bridges manual prompt engineering and automatic prompt optimization while offering users the flexibility to assess evolving prompts. |
UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model (2025.findings-naacl)
Copied to clipboard
Zhaowei Li, Wei Wang, YiQing Cai, Qi Xu, Pengyu Wang, Dong Zhang, Hang Song, Botian Jiang, Zhida Huang, Tao Wang
| Challenge: | Representative models like LLaVA and MiniGPT-4 have great capabilities in various tasks. |
| Approach: | They propose a unified model to represent various multi-modal tasks using a single representation. |
| Outcome: | The proposed model outperforms existing models in a variety of tasks while maintaining generality and scalability. |
Sparse, Dense, and Attentional Representations for Text Retrieval (2021.tacl-1)
Copied to clipboard
| Challenge: | Dual encoders perform retrieval by encoding documents and queries into dense low-dimensional vectors, scoring each document by its inner product with the query. |
| Approach: | They propose a dual-encoder-based neural model that combines the efficiency of dual encoders with expressiveness of more costly attentional architectures. |
| Outcome: | The proposed model outperforms strong alternatives in large-scale retrieval. |
Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision (D18-1)
Copied to clipboard
| Challenge: | Existing methods for learning word and entity representations in monolingual settings are limited. |
| Approach: | They propose a method for joint representation learning of cross-lingual words and entities that captures mutually complementary knowledge and enables cross-linguistic inferences. |
| Outcome: | The proposed method captures mutually complementary knowledge and enables cross-lingual inferences among knowledge bases and texts. |
Can LMs Store and Retrieve 1-to-N Relational Knowledge? (2023.acl-srw)
Copied to clipboard
| Challenge: | Pretraining language models on large amounts of text has made it difficult to store and retrieve world knowledge. |
| Approach: | They propose to view pretrained language models as knowledge bases by examining their ability to store and retrieve world knowledge. |
| Outcome: | The proposed model can store and retrieve world knowledge with high accuracy, but it is not clear how accurately it can handle 1-to-N relational knowledge. |
WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models perform well on learning sentence semantics when fine-tuned with supervised data. |
| Approach: | They conduct a thorough examination of pretrained model based unsupervised sentence embeddings. |
| Outcome: | The proposed approach improves on whitening-based vector normalization with less than 10 lines of code. |
Does Character-level Information Always Improve DRS-based Semantic Parsing? (2023.starsem-1)
Copied to clipboard
| Challenge: | incorporating character-level information does not improve the performance in English and German, and is not sensitive to correct character order in Dutch. |
| Approach: | They propose to incorporate character-level representations into a neural semantic parser for Discourse Representation Structures and to test their performance using order of character sequences. |
| Outcome: | The proposed parser improves in English, German, Dutch, and Italian in four languages. |
Enhancing Future Link Prediction in Quantum Computing Semantic Networks through LLM-Initiated Node Features (2025.coling-industry)
Copied to clipboard
| Challenge: | Quantum computing is rapidly evolving in both physics and computer science due to its potential to solve complex quantum physics problems and accelerate computational processes. |
| Approach: | They propose to initialize node features using LLMs to enhance node representations for link prediction tasks in graph neural networks. |
| Outcome: | The proposed method compared to traditional node embedding techniques on a quantum computing semantic network and demonstrated efficacy compared with other methods. |
Probabilistic Embedding of Knowledge Graphs with Box Lattice Measures (P18-1)
Copied to clipboard
| Challenge: | Structured embeddings based on regions, densities, and orderings have gained popularity for their inductive bias towards the essential asymmetries inherent in problems such as image captioning. |
| Approach: | They propose a box lattice and accompanying probability measure to capture negative correlations over arbitrary concepts. |
| Outcome: | The proposed model can capture anti-correlation and even disjoint concepts while learning from and predicting calibrated uncertainty. |
Sentence-State LSTM for Text Representation (P18-1)
Copied to clipboard
| Challenge: | LSTMs have been shown to suffer from various limitations due to their sequential nature. |
| Approach: | They propose to model hidden states of all words simultaneously at each recurrent step rather than one word at a time. |
| Outcome: | The proposed model has strong representation power, giving competitive performances compared to stacked BiLSTM models with similar parameter numbers. |
SEED: Semantic Knowledge Transfer for Language Model Adaptation to Materials Science (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to adapt pre-trained language models to materials science rely on frequency information from limited downstream datasets. |
| Approach: | They propose a vocabulary expansion method to adapt pre-trained language models to materials science by incorporating latent materials knowledge of lightweight embeddings into PLMs. |
| Outcome: | The proposed method mitigates the limitations of existing adaptation methods and can be used in materials science. |
FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference (2025.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Language Modeling (RALM) is a popular approach for large language models. |
| Approach: | They propose a modular RALM that integrates large language models with documents from an external corpus to improve inference efficiency. |
| Outcome: | The proposed method improves inference efficiency with appending context pattern while maintaining decent performance after fine-tuning by Low-Rank Adaption. |
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining (2020.acl-srw)
Copied to clipboard
| Challenge: | Existing models of multilingual sentence embeddings require large parallel data resources which are not available for low-resource languages. |
| Approach: | They propose an unsupervised method to derive multilingual sentence embeddings using monolingual data. |
| Outcome: | The proposed method improves on two parallel corpus mining tasks and for other languages. |
Knowledge Base Question Answering through Recursive Hypergraphs (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for Knowledge Base Question Answering (KBQA) do not explicitly incorporate the recursive relational group structure in the given knowledge base. |
| Approach: | They propose a method to model KBs through recursive hypergraphs using hypergraph data. |
| Outcome: | The proposed method is based on recursive hypergraphs and has been released on multiple benchmarks. |
CaRe: Open Knowledge Graph Embeddings (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating Open Knowledge Graphs have been criticized for not achieving canonicalization of OpenKGs. |
| Approach: | They propose to use Open Information Extraction methods to extract triples from text . they propose to learn embeddings of NPs and RPs present in the graph . |
| Outcome: | The proposed methods improve OpenKG embeddings and bootstrap OpenKGs from text corpus. |
Knowledge Graph Entity Typing with Curriculum Contrastive Learning (2025.coling-main)
Copied to clipboard
| Challenge: | Existing knowledge graphs suffer from incomplete type annotations because they are manually constructed by domain experts. |
| Approach: | They propose a CCLET model using the Curriculum Contrastive Learning strategy for KGET to fuse the entity related semantic and the structural information of the Knowledge Graph (KG) they define the difficulty of the course by controlling the level of added noise and aim to accurately learn with curriculum contrastive learning strategy from easy to difficult. |
| Outcome: | The proposed model outperforms state-of-the-art models and is highly accurate across multiple learning environments. |
LLM-Rec: Personalized Recommendation via Prompting Large Language Models (2024.findings-naacl)
Copied to clipboard
Hanjia Lyu, Song Jiang, Hanqing Zeng, Yinglong Xia, Qifan Wang, Si Zhang, Ren Chen, Chris Leung, Jiajie Tang, Jiebo Luo
| Challenge: | Recent advances in large language models (LLMs) have showcased their remarkable ability to harness commonsense knowledge and reasoning. |
| Approach: | They propose a novel approach which incorporates four distinct prompting strategies of text enrichment for improving personalized text-based recommendations. |
| Outcome: | The proposed approach improves recommendation quality and even basic MLP models achieve comparable or even better results than complex content-based methods. |
Transition-Based Chinese AMR Parsing (N18-2)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation where the meaning of a sentence is encoded as a rooted, directed and acyclic graph. |
| Approach: | They propose a transition-based AMR parsing framework for Chinese to be used in the next generation of AMR. |
| Outcome: | The proposed parser is based on the Chinese AMR bank. |
ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases (2024.eacl-long)
Copied to clipboard
| Challenge: | Reasoning over Commonsense Knowledge Bases (CSKBs) is a way to acquire new commonsense knowledge based on reference knowledge in original CSKB and external prior knowledge. |
| Approach: | They propose a plugin to provide and check explicit relational constraints over prompting techniques. |
| Outcome: | The proposed method improves on existing prompting techniques and CSKB reasoning. |
Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models (2023.acl-short)
Copied to clipboard
| Challenge: | Augmenting language models with a retrieval mechanism has been shown to improve performance while keeping the number of parameters low. |
| Approach: | They propose to augment language models with a retrieval mechanism by replacing semantic retrieval with BM25 . they find that the model's performance is better explained by surface-level similarities, they say . |
| Outcome: | The proposed method reduces perplexity and lowers the number of parameters while keeping the number low. |
Morality is Non-Binary: Building a Pluralist Moral Sentence Embedding Space using Contrastive Learning (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing NLP methods treat morality as binary, ranging from right to wrong. |
| Approach: | They propose to build a pluralist moral sentence embedding space using contrastive learning methods to examine relationships among moral elements. |
| Outcome: | The proposed method shows that pluralism can be captured in an embedding space. |
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism (P18-1)
Copied to clipboard
| Challenge: | Existing methods focus on normal class and fail to extract relational triplets precisely. |
| Approach: | They propose an end-to-end model which can jointly extract relational triplets from sentences . they employ two different strategies in decoding process: employing only one united decoder or applying multiple separated decodeurs. |
| Outcome: | The proposed model outperforms the baseline method significantly in two datasets. |
In-Context Symbolic Regression: Leveraging Large Language Models for Function Discovery (2024.acl-srw)
Copied to clipboard
| Challenge: | State of the art Symbolic Regression (SR) methods build specialized models, while the application of Large Language Models (LLMs) remains largely unexplored. |
| Approach: | They propose a framework which iteratively refines a functional form with an LLM and determines its coefficients with an external optimizer. |
| Outcome: | The proposed method outperforms the best SR methods on four popular benchmarks while yielding simpler equations with better out of distribution generalization. |
Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition are domain specific and require a domain specific architecture. |
| Approach: | They propose a retrieval augmented large language model for Named Entity Recognition . the model uses word-embedding over sentence-level embedding to fine tune . |
| Outcome: | The proposed model outperforms existing models on the CrossNER dataset. |
Memory-Efficient Backpropagation for Fine-Tuning LLMs on Resource-Constrained Mobile Devices (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing work on memory-efficient on-device fine-tuning of large language models with backpropagation has focused on approximating gradients with zeroth-order optimization (ZO). |
| Approach: | They propose a memory-efficient implementation of backpropagation on mobile devices that allows flexible trade-offs between memory usage and compute time while converging faster. |
| Outcome: | The proposed method can fine-tune LLMs with backpropagation using less than 1GB of memory while achieving better performance than the baseline. |
Can Large Language Models Address Open-Target Stance Detection? (2025.findings-acl)
Copied to clipboard
| Challenge: | Stance detection (SD) identifies a text’s position towards a target, typically labeled as favor, against, or none. |
| Approach: | They introduce Open-Target Stance Detection (OTSD) which aims to determine the position of a text towards a target, typically labeled as favor, against, or none. |
| Outcome: | The proposed model outperforms the only existing task, Target-Stance Extraction (TSE), which benefits from predefined targets. |
BIPro: Zero-shot Chinese Poem Generation via Block Inverse Prompting Constrained Generation Framework (2025.acl-long)
Copied to clipboard
| Challenge: | generative pre-trained models face challenges on constrained writing tasks like poem generation . brian mccartney: BIPro improves the zero-shot generation quality on constricted writing tasks . |
| Approach: | They propose a framework that leverages two block inverse prompting methods to improve the quality of constrained writing tasks. |
| Outcome: | BIPro significantly improves the quality of Chinese poem generation without priming or training. |
FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for question answering over knowledge bases (KBQA) suffer from generalization issues due to coarse-grained modeling of the logical expression. |
| Approach: | They propose a fine-to- coarse-grained framework for KBQA to ensure generalization and executability of the logical expression. |
| Outcome: | The proposed framework derives new state-of-the-art performance on GrailQA and WebQSP, and runs 4 times faster than baseline. |
LM-CORE: Language Models with Contextually Relevant External Knowledge (2022.findings-naacl)
Copied to clipboard
| Challenge: | Large pre-trained language models can capture factual knowledge in their parameters but storing large amounts of knowledge in the model parameters is sub-optimal given the ever-growing amounts of information and resource requirements. |
| Approach: | They propose a framework that provides explicit access to contextually relevant structured knowledge to the model and train it to use that knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art knowledge-enhanced language models on knowledge probing tasks and can handle knowledge updates. |
KESA: A Knowledge Enhanced Approach To Sentiment Analysis (2022.aacl-main)
Copied to clipboard
| Challenge: | Recent work on injecting sentiment knowledge into pre-trained language models, but it is difficult to integrate external knowledge into PLMs. |
| Approach: | They propose two sentiment-aware auxiliary tasks to integrate sentiment knowledge into the objective of the downstream task. |
| Outcome: | The proposed tasks outperform baselines and complement existing sentiment-enhanced models. |
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval (2026.findings-acl)
Copied to clipboard
| Challenge: | a new framework casts LLM planning as non-parametric retrieval, but high latency of inference-time search and supervised fine-tuning are limitations. |
| Approach: | They propose a framework that casts LLM planning as non-parametric retrieval . they leverage Monte Carlo Tree Search to explore the solution space . |
| Outcome: | Empirical results show that SGA-MCTS can match the performance of SOTA systems without task-specific fine-tuning. |
Symbol tuning improves in-context learning in language models (2023.emnlp-main)
Copied to clipboard
Jerry Wei, Le Hou, Andrew Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc Le
| Challenge: | Language models are sensitive to the way that prompts are given, indicating that they are not reasoning in a robust manner. |
| Approach: | They propose to fine tune language models on in-context input-label pairs where natural language labels are replaced with arbitrary symbols. |
| Outcome: | The proposed model is much stronger at reasoning tasks and more robust to underspecified prompts than the standard model. |
Autoregressive Speech Synthesis without Vector Quantization (2025.acl-long)
Copied to clipboard
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen M. Meng, Furu Wei
| Challenge: | MELLE is a novel language modeling approach for text-to-speech synthesis that generates continuous tokens from text . authors demonstrate that it reduces the need for vector quantization and improves model robustness . |
| Approach: | They propose to autoregressively generate continuous mel-spectrogram frames directly from text condition, bypassing vector quantization. |
| Outcome: | The proposed model achieves superior performance across multiple metrics and is more streamlined. |
TimeRes: A Turkish Benchmark For Evaluating Temporal Understanding of Large Language Models (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing benchmarks focus on English and underexplore how linguistic structure contributes to temporal meaning. |
| Approach: | They propose a Turkish benchmark to evaluate temporal understanding of Large Language Models (LLMs) their benchmark examines Reichenbach’s temporal points and reported speech through date arithmetic . |
| Outcome: | The proposed model fails to resolve reported speech and fails to generalize across word order variations. |
What Makes AI Research Replicable? Executable Knowledge Graphs as Scientific Knowledge Representations (2026.acl-short)
Copied to clipboard
Yujie Luo, Zhuoyun Yu, Xuehai Wang, Yuqi Zhu, Ningyu Zhang, Lanning Wei, Lun Du, Da Zheng, Huajun Chen
| Challenge: | Existing approaches to replicate AI research are limited by insufficient background knowledge and the limitations of retrieval-augmented generation methods. |
| Approach: | They propose a pluggable, paper-centric knowledge base that integrates code snippets and technical insights extracted from scientific literature into a verifiable, executable representation. |
| Outcome: | The proposed knowledge base shows significant performance gains on paperBench when integrated into three agent frameworks with two different LLMs. |
”Diversity and Uncertainty in Moderation” are the Key to Data Selection for Multilingual Few-shot Transfer (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches for few-shot transfer show significant gain over zero-shot transfers . language resource distribution is skewed across the world's languages . proposed methods use multiple measures such as data entropy and gradient embedding . |
| Approach: | They propose a loss embedding method for sequence labeling tasks that induces diversity and uncertainty sampling similar to gradient embeddment. |
| Outcome: | The proposed methods outperform baseline methods for POS tagging, NER, and NLI tasks for up to 20 languages. |
NL-Debugging: Exploiting Natural Language as an Intermediate Representation for Code Debugging (2025.emnlp-main)
Copied to clipboard
Weiming Zhang, Qingyao Li, Xinyi Dai, Jizheng Chen, Kounianhua Du, Weiwen Liu, Yasheng Wang, Ruiming Tang, Yong Yu, Weinan Zhang
| Challenge: | Early debugging efforts focused on code-level analysis, which often fails when addressing complex programming errors. |
| Approach: | They propose a framework that employs natural language as an intermediate representation to improve code debugging by debuggating at a natural language level. |
| Outcome: | The proposed framework outperforms traditional debugging methods and enables a broader modification space through direct refinement guided by execution feedback. |
To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models (2024.findings-emnlp)
Copied to clipboard
Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qingbin Liu, Mengru Wang, Dianbo Sui, Xi Chen, Huajun Chen, Ningyu Zhang
| Challenge: | Existing unlearning paradigms are mired in vague forgetting boundaries, erasing knowledge indiscriminately. |
| Approach: | They propose a benchmark to evaluate if unlearning erases essential knowledge . they propose 'knowUnDo' which uses copyrighted content and privacy domains . |
| Outcome: | The proposed method is superior to existing methods in both precise knowledge unlearning and general knowledge retaining of LLMs. |
On Prefix-tuning for Lightweight Out-of-distribution Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is a fundamental task vexing real-world applications . fine-tuning based methods require storing fine- tuned models for each scenario . |
| Approach: | They propose an unsupervised prefix-tuning based OOD detection framework called PTO . they propose to take advantage of optional training data labels and targeted OOD data . |
| Outcome: | The proposed framework performs better than existing methods under a wide range of metrics, detection settings, and OOD types. |
LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution (2022.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution is the task of generating meaningful substitutes for a word in a given textual context. |
| Approach: | They propose an end-to-end lexical substitution framework based on contextual embedding models that can identify highly-accurate substitute candidates. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models on LS07 and CoInCo benchmark datasets by at least 2% over existing embeddable models. |
Multi-Task Retrieval for Knowledge-Intensive Tasks (2021.acl-long)
Copied to clipboard
Jean Maillard, Vladimir Karpukhin, Fabio Petroni, Wen-tau Yih, Barlas Oguz, Veselin Stoyanov, Gargi Ghosh
| Challenge: | Knowledge-intensive tasks require large amounts of knowledge about the world . recent neural retrieval models achieve better results by learning directly from task-specific training data. |
| Approach: | They propose a multi-task trained neural retrieval model that can be universally trained on a wide variety of problems. |
| Outcome: | The proposed model outperforms specialised retrievers on a few-shot setting and matches or improves state-of-the-art on multiple benchmarks. |
Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent Discovery (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for finding out-of-domain intents suffer from in-domain overfitting problem . previous methods fail to transfer prior knowledge to downstream clustering . |
| Approach: | They propose a unified K-nearest neighbor contrastive learning framework to discover OOD intents . they propose IND pre-training objective to learn discriminative features while maintaining intra-class diversity . |
| Outcome: | The proposed framework improves on three benchmark datasets. |
UniTRec: A Unified Text-to-Text Transformer and Joint Contrastive Learning Framework for Text-based Recommendation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing text-based recommendation frameworks that use pretrained language models (PLMs) can improve performance on text-related tasks. |
| Approach: | They propose a unified local- and global-attention Transformer encoder to better model two-level contexts of user history. |
| Outcome: | The proposed framework improves on three text-based recommendation tasks. |
Label Anchored Contrastive Learning for Language Understanding (2022.naacl-main)
Copied to clipboard
| Challenge: | a novel approach to contrastive learning for language understanding is not fully explored . contrastive training has been widely applied to self-supervised representation learning . |
| Approach: | They propose a label anchored contrastive learning approach for language understanding using a class label. |
| Outcome: | The proposed approach improves on GLUE and CLUE benchmarks by 4.1% compared to the state-of-the-art approaches . the proposed approach also improves under the few-shot and data imbalance settings . |
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the CHATGPT Era and Beyond (2024.eacl-long)
Copied to clipboard
Abhinav Ramesh Kashyap, Thanh-Tung Nguyen, Viktor Schlegel, Stefan Winkler, See-Kiong Ng, Soujanya Poria
| Challenge: | Sentence representations are a critical component in NLP applications such as retrieval, question answering, and text classification. |
| Approach: | They present a systematic review of the literature on sentence representations focusing mostly on deep learning models. |
| Outcome: | The proposed methods highlight the key contributions and challenges in this area and suggest potential avenues for improving the quality and efficiency of sentence representations. |
Cyclical Contrastive Learning Based on Geodesic for Zero-shot Cross-lingual Spoken Language Understanding (2024.findings-acl)
Copied to clipboard
| Challenge: | zero-shot cross-lingual SLU is a challenging task in low-resource languages . a lack of labeled training data makes it difficult to align representations of similar sentences . |
| Approach: | They propose a framework that uses cyclical contrastive learning to achieve consistency between languages . they propose to use geodesic to measure the similarity to construct positive and negative pairs . |
| Outcome: | The proposed framework achieves state-of-the-art performance on multiATIS++ and MTOP datasets. |
Enhanced Metaphor Detection via Incorporation of External Knowledge Based on Linguistic Theories (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for metaphor detection take little consideration on linguistic theories of metaphor detection. |
| Approach: | They propose two BERT-based models for metaphor detection based on examples and definitions of words from the Oxford Dictionary. |
| Outcome: | The proposed models achieve state-of-the-art performance on two established metaphor datasets and are highly interpretable. |
Zero-Shot Contextual Embeddings via Offline Synthetic Corpus Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Context-aware embedding methods boost retrieval accuracy by conditioning on corpus statistics extracted from neighboring documents. |
| Approach: | They propose a zero-shot contextual adaptation framework that replaces real corpus access with a one-time offline synthesis of a compact proxy. |
| Outcome: | The proposed framework replaces real corpus access with offline synthesis of a compact proxy. |
How Much Do Encoder Models Know About Word Senses? (2025.acl-long)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) is a key task in Natural Language Processing (NLP) however, how well these models inherently disambiguate word senses remains uncertain. |
| Approach: | They evaluate several encoder-only PLMs across WordNet and ODE sense inventories to evaluate their ability to separate word senses without any task-specific fine-tuning. |
| Outcome: | The proposed model outperforms output layer on WordNet and ODE sense inventories by 15 percentage points. |
DEbateNet-mig15:Tracing the 2015 Immigration Debate in Germany Over Time (2020.lrec-1)
Copied to clipboard
Gabriella Lapesa, Andre Blessing, Nico Blokker, Erenay Dayanik, Sebastian Haunss, Jonas Kuhn, Sebastian Padó
| Challenge: | a dataset for germany covering the public debate on immigration is annotated . a political science notion of a claim is used to represent the political discourse . |
| Approach: | They annotate a dataset for german public debate on immigration in 2015 using a political science notion of a claim . they identify claims in newspaper articles, assign them to actors and fine-grained categories and annotize their polarity and date. |
| Outcome: | The dataset is annotated by a political science framework and shows it captures political debate . it shows that political actors can change their positions and take a strong stand against them . |
When the Model Said ‘No Comment’, We Knew Helpfulness Was Dead, Honesty Was Alive, and Safety Was Terrified (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing work uses SFT and MoE to align Large Language Models, but these work face challenges in multi-objective settings. |
| Approach: | They propose a framework that uses prompt-injected fine-tuning to extract axis-specific task features . it deploys a MoCaE module that calibrates expert routing using fractal and natural geometry . |
| Outcome: | The proposed framework achieves significant gains on Alpaca, BeaverTails, TruthfulQA and TruthfulQ with +171.5% win rate and +110.1% truthfulness-informativeness. |
Perform like an Engine: A Closed-Loop Neural-Symbolic Learning Framework for Knowledge Graph Inference (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge graphs are incomplete and therefore lack interpretability. |
| Approach: | They propose a closed-loop neural-symbolic learning framework EngineKG to address the natural incompleteness of knowledge graphs. |
| Outcome: | The proposed model outperforms baselines on link prediction tasks on four real-world datasets. |
SLM: Learning a Discourse Language Representation with Sentence Unshuffling (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent models for learning discourse language representations focus on bottom or top-level representations, but they do not capture intermediate-size structures in natural languages such as sentences and the relationships among them. |
| Approach: | They propose a new objective for learning a discourse language representation in a self-supervised manner by shuffling the sequence of input sentences and training a hierarchical transformer model to reconstruct the original ordering. |
| Outcome: | The proposed model improves the original BERT model on downstream tasks by large margins. |
Model-Agnostic Bias Measurement in Link Prediction (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing work investigating social bias in factual knowledge graphs has focused on knowledge graph embeddings, so more recent classes of models achieving superior results by fine-tuning Transformers have not yet been investigated. |
| Approach: | They propose a model-agnostic approach for bias measurement leveraging fairness metrics to compare bias in knowledge graph embedding-based predictions (KG only) with models that use pre-trained, Transformer-based language models (KG+LM). |
| Outcome: | The proposed model-agnostic approach compares gender bias in occupation predictions with models that use pre-trained, Transformer-based language models (KG+LM). |
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for code retrieval struggle to balance scalability and annotation quality. |
| Approach: | They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context. |
| Outcome: | The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities. |
Incorporating Graph Information in Transformer-based AMR Parsing (2023.findings-acl)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic graph abstraction for text representations. |
| Approach: | They propose a model and method that incorporates graph information into the learned representations of AMR by word-to-node alignment. |
| Outcome: | The proposed model improves AMR parsing performance by embedding graph information into the encoder at training time. |
Representation Collapse in Machine Translation Through the Lens of Angular Dispersion (2026.findings-eacl)
Copied to clipboard
| Challenge: | Effective training of Transformer models for sequential language tasks is difficult due to various forms of collapse of the internal representations learned. |
| Approach: | They propose to use angular dispersion to analyze representation collapse at different levels of discrete and continuous transformers throughout training. |
| Outcome: | The proposed method mitigates collapse and improves translation quality. |
Knowledge Graph Alignment with Entity-Pair Embedding (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for Knowledge Graph (KG) alignment are not satisfactory. |
| Approach: | They propose a method that directly learns embeddings of entity-pairs for KG alignment. |
| Outcome: | The proposed approach can achieve state-of-the-art on five real-world datasets. |
TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action (2026.findings-eacl)
Copied to clipboard
| Challenge: | Humanitarian Mine Action (HMA) authorities publish large amount of life-saving operational knowledge, but much remains locked away in unstructured reports. |
| Approach: | They propose a dataset, evaluation framework and ontology-guided large language model pipeline for knowledge extraction from text in the HMA domain. |
| Outcome: | The proposed framework improves extraction accuracy by 44.2% and reduces hallucinations by 22.5% . the proposed framework can be used to analyze human-annotated triples and an LLM-as-Judge protocol . |
Ethos: Rectifying Language Models in Orthogonal Parameter Space (2024.findings-naacl)
Copied to clipboard
| Challenge: | Language models (LMs) generate toxic, biased content and reveal private training records. |
| Approach: | They propose an efficient approach that rectifies LMs to mitigate toxicity and bias . Ethos distinguishes general beneficial and undesired knowledge when reconstructing task vectors . |
| Outcome: | The proposed approach mitigates toxicity and bias in outputs and avoids privacy leakage. |
A Self-verified Method for Exploring Simile Knowledge from Pre-trained Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have succeeded in natural language processing because they learn generic knowledge from a large corpus. |
| Approach: | They propose a method that allows pre-trained language models to explore simile knowledge from PLMs . they enhance PLM models with a multi-level simile recognition task that evaluates similes aplenty . |
| Outcome: | The proposed method can explore more accurate simile knowledge for PLMs. |
Beyond Divergent Creativity: A Human-Based Evaluation of Creativity in Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models are increasingly used in verbal creative tasks. |
| Approach: | They propose a divergent association task that focuses on novelty, ignoring appropriateness, a core component of creativity. |
| Outcome: | The proposed model scores are lower than baselines with no creative abilities, undermining its validity for model evaluation. |
TeRo: A Time-aware Knowledge Graph Embedding via Temporal Rotation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing knowledge graphs that contain time information for entities and relations have been used for learning and inference. |
| Approach: | They propose a temporal evolution of entity embedding that defines the temporal rotation from the initial time to the current time in the complex vector space. |
| Outcome: | The proposed model outperforms existing state-of-the-art models for link prediction on three different TKGs. |
Char2Subword: Extending the Subword Embedding Space Using Robust Character Compositionality (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Byte-pair encoding (BPE) is a ubiquitous algorithm in the tokenization process of language models but is only based on pre-training data statistics. |
| Approach: | They propose a character-based subword module that learns the subword embedding table in pre-trained language models like BERT. |
| Outcome: | The proposed method significantly improves the performance on the social media linguistic code-switching evaluation (LinCE) benchmark. |
An Information Bottleneck Approach for Controlling Conciseness in Rationale Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to condition models on a concise rationale are less accurate than models that can use the entire context. |
| Approach: | They propose a method to optimize a bound on the Information Bottleneck objective to extract concise rationales from a binary mask and an end-task predictor that uses only the residual sentences. |
| Outcome: | The proposed model outperforms existing norm-minimization techniques in task performance and agreement with human rationales in the ERASER benchmark. |
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders (2023.eacl-main)
Copied to clipboard
| Challenge: | Pretrained multilingual language models (LMs) can be 'rewired' into effective multilingual sentence encoders (SEs) however, it remains unclear how to best leverage them to represent sub-sentence lexical items in cross-lingual lexicals. |
| Approach: | They propose a method for exposing cross-lingual lexical knowledge by additional fine-tuning through inexpensive contrastive learning that requires only a small amount of word translation pairs. |
| Outcome: | The proposed method exposes cross-lingual lexical knowledge by additional fine-tuning through inexpensive contrastive learning that requires only a small amount of word translation pairs. |
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that pre-trained language models have gained rich knowledge during pre-training. |
| Approach: | They propose to tune pre-trained language models with task-specific prompts to improve and stabilize prompttuning. |
| Outcome: | Extensive experiments on zero and few-shot text classification tasks show that prompt-tuning improves and stabilizes prompttun-ing. |
Did You Mean...? Confidence-based Trade-offs in Semantic Parsing (2023.emnlp-main)
Copied to clipboard
| Challenge: | a calibrated model can help balance common trade-offs in task-oriented parsing. |
| Approach: | They propose a model which rephrases low-confidence inputs to improve usability and safety. |
| Outcome: | The proposed system reduces the number of incorrect low-confidence programs executed, but at a cost to usability. |
Weight Distillation: Transferring the Knowledge in Neural Network Parameters (2021.acl-long)
Copied to clipboard
| Challenge: | Knowledge distillation is an effective method for model acceleration and compression. |
| Approach: | They propose to use parameters to distill knowledge from large neural networks to small ones . they propose to do this by using a parameter generator to transfer the knowledge to a small neural network . |
| Outcome: | The proposed method learns a small network 1.88 2.94x faster than the large network but with competitive BLEU points. |
BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biology (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities on a wide range of tasks, such as question answering and the generation of coherent text and code. |
| Approach: | They propose a framework for automatic evaluation of large language models on open-ended planning problems and a dataset of biology protocols with corresponding pseudocode representations. |
| Outcome: | The proposed framework evaluates an LLM on a dataset of biology protocols with corresponding pseudocode representations. |
Snapshot-Guided Domain Adaptation for ELECTRA (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing domain-specific knowledge of domain-related tasks is lacking in pre-trained language models. |
| Approach: | They propose a domain-adaptation method which can dynamically select domain-specific tokens and guide the discriminator to emphasize them, without introducing new training parameters. |
| Outcome: | The proposed method can capture domain-specific knowledge of domain-related tasks without introducing new training parameters. |
A Psycholinguistic Analysis of BERT’s Representations of Compounds (2023.eacl-main)
Copied to clipboard
| Challenge: | 'compound' semantic representations are based on the semantics of constituent words, and are lexical items like any other word. |
| Approach: | They leverage a dataset that includes human judgments on two psycholinguistic measures of compound semantic analysis: lexeme meaning dominance (LMD) and semantic transparency (ST). |
| Outcome: | The proposed representations are based on a dataset that includes human judgments on two psycholinguistic measures of compound semantic analysis: lexeme meaning dominance (LMD) and semantic transparency (ST). |
Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing methods to adapt pretrained embeddings to a large corpus are limited and do not provide sufficient quality. |
| Approach: | They propose to use a small corpus D_T to pretrain embeddings that accurately capture the sense of words in a limited set of focused topics. |
| Outcome: | The proposed embeddings capture the sense of words in a topic in spite of the limited size of the corpus D_T. |
TABi: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for entity retrieval use mention boundaries but unstructured text . state-of-the-art methods struggle to retrieve rare entities for ambiguous mentions . |
| Approach: | They propose a method to jointly train bi-encoders on knowledge graph types and unstructured text for entity retrieval for open-domain tasks. |
| Outcome: | The proposed method improves retrieval of rare entities on Ambiguous Entity Retrieval sets while maintaining strong overall retrieval performance on open-domain tasks. |
AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languages (2026.eacl-long)
Copied to clipboard
| Challenge: | Text embeddings are an essential building component of several NLP tasks. |
| Approach: | They propose a regional expansion of MTEB covering 59 languages, 14 tasks, and 38 datasets, including six newly added datasets. |
| Outcome: | The proposed model outperforms baselines and mE5 in hate speech detection, intent detection, and emotion classification tasks. |
Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation (2022.lrec-1)
Copied to clipboard
Samhita Honnavalli, Aesha Parekh, Lily Ou, Sophie Groenwold, Sharon Levy, Vicente Ordonez, William Yang Wang
| Challenge: | Existing studies have not investigated how gender biases in natural language processing (NLP) are compounded with other societal biase. |
| Approach: | They propose a framework for probing compound bias by examining seniority in pre-trained neural generation models. |
| Outcome: | The proposed framework amplifies bias by considering women as junior and men as senior more often than ground truth in both domains. |
When Shallow is Good Enough: Automatic Assessment of Conceptual Text Complexity using Shallow Semantic Features (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to automatic assessment of text complexity focus on syntactic and lexical complexity. |
| Approach: | They propose to use graph-based deep semantic features to automatically assess conceptual text complexity by using DBpedia as a proxy to human knowledge. |
| Outcome: | The proposed features outperform the state-of-the-art features on pairwise comparison of two versions of the same text and five-level classification task. |
Large Language Models are Limited in Out-of-Context Knowledge Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) possess extensive knowledge and strong capabilities in performing in-context reasoning. |
| Approach: | They evaluated a dataset with seven representative OCKR tasks to assess their OCKr capabilities. |
| Outcome: | The model's OCKR abilities are limited regardless of whether the knowledge is trained in a separate or adjacent training setting. |
DMHM: Density-aware Manifold Learning and Hybrid Mahalanobis Energy for LLMs-generated Text Detection (2026.acl-long)
Copied to clipboard
Tianle Liu, Zhiliang Tian, Zhen Huang, Tianlun Liu, Jingyuan Huang, Zhaoning Zhang, Chengcheng Shao, Dongsheng Li
| Challenge: | Existing methods for LGT detection assume that it is a single homogeneous distribution. |
| Approach: | They propose a framework for LGT detection based on density-aware manifold learning and hybrid Mahalanobis energy. |
| Outcome: | The proposed framework outperforms baselines in detecting LLM-generated text (LGT) it is based on density-aware manifold learning and hybrid Mahalanobis energy . |
Syntax-guided Contrastive Learning for Pre-trained Language Model (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies rely on additional syntax-driven attention components to enhance the transformer, which require more parameters and additional syntactic parsing in downstream tasks. |
| Approach: | They propose a syntax-guided contrastive learning method which does not change the transformer architecture and does not alter the transformer structure. |
| Outcome: | The proposed method achieves consistent improvements in a variety of tasks including grammatical error detection, entity tasks, structural probing and GLUE. |
Transductive Learning for Unsupervised Text Style Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for style transfer are based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases. |
| Approach: | They propose a retrieval-based context-aware style representation that involves top-K relevant sentences in the target style in the transfer process. |
| Outcome: | The proposed method outperforms several strong baselines and is general and effective to the task of unsupervised style transfer. |
Effective and Efficient Query-aware Snippet Extraction for Web Search (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract webpage snippets ignore contextual information of webpages, which may be sub-optimal. |
| Approach: | They propose a query-aware webpage snippet extraction method called DeepQSE that captures contextual information of webpages. |
| Outcome: | The proposed method can significantly improve the performance of DeepQSE without affecting its performance. |
Do dialogue representations align with perception? An empirical study (2023.eacl-main)
Copied to clipboard
| Challenge: | masked language models produce stronger correlations than auto-regressive models, but humans and models make different response selection mistakes. |
| Approach: | They propose to use spoken conversation as a model to measure human comprehension behaviour. |
| Outcome: | The proposed model outperforms the model which produces the strongest correlation with human responses. |
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources (2024.acl-long)
Copied to clipboard
Xiaochen Wang, Junyu Luo, Jiaqi Wang, Yuan Zhong, Xiaokun Zhang, Yaqing Wang, Parminder Bhatia, Cao Xiao, Fenglong Ma
| Challenge: | Current pre-training techniques rely on a limited scope of medical data, limiting the range of downstream tasks. |
| Approach: | They propose a pre-training strategy that unifies patient data within individual sources and captures explicit and implicit correlations between patients across different sources. |
| Outcome: | The proposed strategy bridges the gap between multimodal medical sources by aggregating patient data within individual sources and capturing explicit and implicit correlations between patients across sources. |
Lifelong Learning of Topics and Domain-Specific Word Embeddings (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing lifelong topic models focus on indomain text streams in which each chunk only contains documents from a single domain. |
| Approach: | They develop a lifelong collaborative model that uses non-negative matrix factorization to learn topics and domain-specific word embeddings. |
| Outcome: | The proposed model can learn topics and domain-specific word embeddings from a lifelong collaborative model. |
Tree-Based Representation and Generation of Natural and Mathematical Language (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models for generating and modeling mathematical language are limited . existing models for modeling and generating mathematical language simply treat mathematical expressions as text . |
| Approach: | They propose to combine mathematical expressions and text-based models to generate mathematically valid expressions. |
| Outcome: | The proposed model outperforms baselines on mathematical expression generation tasks. |
AdaEdit: Advancing Continuous Knowledge Editing For Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing methods that can efficiently update knowledge in LLMs are limited due to budget constraints. |
| Approach: | They propose a method that can enhance the performance of edited LLMs in large-size continuous editing regimes. |
| Outcome: | Extensive empirical evaluations on multiple LLMs show that the proposed method outperforms existing methods without compromising the general abilities of these models. |
Graph Reasoning for Question Answering with Triplet Retrieval (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to answer complex questions require reasoning over knowledge graphs (KGs) state-of-the-art methods constrain retrieved knowledge in local subgraphs and discard more diverse triplets that are disconnected but useful for question answering. |
| Approach: | They propose a method to retrieve the most relevant triplets from KGs and then rerank them, which are then concatenated with questions to be fed into language models. |
| Outcome: | The proposed method outperforms state-of-the-art methods on commonsenseQA and OpenbookQA datasets with 4.6% absolute accuracy. |
Assessing Multilingual Fairness in Pre-trained Multimodal Representations (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent pre-trained multimodal models have shown exceptional capabilities towards connecting images and natural language. |
| Approach: | They propose two new fairness notions for pre-trained multimodal models that consider language as the fairness recipient. |
| Outcome: | The proposed models can be generalized to multilingualism by cross-lingual alignment . the results show that the models are individually fair across languages . |
Integrating Multimodal Information in Large Pretrained Transformers (2020.acl-main)
Copied to clipboard
Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, AmirAli Bagher Zadeh, Chengfeng Mao, Louis-Philippe Morency, Ehsan Hoque
| Challenge: | Recent Transformer-based contextual word representations have shown state-of-the-art performance in multiple disciplines within NLP. |
| Approach: | They propose an attachment to BERT and XLNet that allows them to accept multimodal nonverbal data during fine-tuning. |
| Outcome: | The proposed attachment allows BERT and XLNet to accept multimodal nonverbal data during fine-tuning. |
Unsupervised Improvement of Factual Knowledge in Language Models (2023.eacl-main)
Copied to clipboard
| Challenge: | Masked language modeling (MLM) is often dominated by high-frequency words that are sub-optimal for learning factual knowledge. |
| Approach: | They propose an approach that forces the model to prioritize informative words in a fully unsupervised way. |
| Outcome: | The proposed approach significantly improves the performance of pretrained language models on factual recall, question answering, sentiment analysis, and natural language inference in a closed-book setting. |
Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak Decoder (2021.emnlp-main)
Copied to clipboard
Shuqi Lu, Di He, Chenyan Xiong, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tie-Yan Liu, Arnold Overwijk
| Challenge: | Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space. |
| Approach: | They propose a self-learning method that pre-trains the autoencoder using a weak decoder to push the encoder to provide better sequence representations. |
| Outcome: | The proposed model significantly boosts the effectiveness and few-shot ability of dense retrieval models on web search, news recommendation, and open domain question answering. |
Factorising AMR generation through syntax (N19-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic annotation framework which abstracts away from the surface form of text to capture the core 'who did what to whom' structure. |
| Approach: | They propose to decompose the generation process into two steps: first generate a syntactic structure, and then generate the surface form. |
| Outcome: | The proposed approach generates meaning-preserving syntactic paraphrases of the same graph, as judged by humans. |
Domain Adaptation for Arabic Cross-Domain and Cross-Dialect Sentiment Analysis from Contextualized Word Embedding (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies have classified dialectal Arabic into more fine-grained levels, including countries and cities. |
| Approach: | They propose to use Arabic domains to transfer knowledge from labeled source domains into unlabeled target domains by transferring the learned knowledge from a labele . |
| Outcome: | The proposed method outperforms other domain adaptation methods and improves performance by 20.8% over the zero-shot transfer learning from BERT. |
A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization (N19-1)
Copied to clipboard
| Challenge: | Existing knowledge graphs with billions of triples are incomplete, i.e., missing a lot of valid triples. |
| Approach: | They propose to embed relationship triples into a capsule network using a convolution layer and multiple filters to generate feature maps. |
| Outcome: | The proposed model outperforms strong search personalization baselines on two benchmark datasets and outperformed previous state-of-the-art models on WN18RR and FB15k-237. |
Adapting Language Models to Compress Contexts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Transformer-based language models have a finite context window and expensive computational cost of processing long text documents. |
| Approach: | They propose to adapt pre-trained LMs into AutoCompressors to compress text into summary vectors . authors propose to use summary vector to speed up inference over long contexts based on a finite context window . |
| Outcome: | The proposed model can compress long contexts into summary vectors, which are accessible as soft prompts. |
Automatic Table Union Search with Tabular Representation Learning (2023.findings-acl)
Copied to clipboard
Xuming Hu, Shen Wang, Xiao Qin, Chuan Lei, Zhengyuan Shen, Christos Faloutsos, Asterios Katsifodimos, George Karypis, Lijie Wen, Philip S. Yu
| Challenge: | Existing methods to identify uniability based on column representations are insufficient to reveal latent relational features to describe column relation between pair of columns. |
| Approach: | They propose a self-supervised table union search framework called AutoTUS to learn column relational representations in a multi-stage manner. |
| Outcome: | The proposed framework improves on the SOTA baseline and on real-world datasets. |
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models that use self-attention and position embedding have anomalous behavior that hinder long context window extrapolation. |
| Approach: | They propose a collinear constraint between Q and K to integrate RoPE and self-attention. |
| Outcome: | The proposed model integrates self-attention and position embedding into LLMs without fine-tuning. |
Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphs (2020.emnlp-main)
Copied to clipboard
| Challenge: | Few/zero-shot learning is a big challenge of many classification tasks, where a classifier is required to recognise instances of classes that have very few or even no training samples. |
| Approach: | They propose a multi-graph aggregation model that fuses knowledge from multiple label graphs encoding different semantic label relationships to improve multi-label zero/few-shot document classification. |
| Outcome: | The proposed model improves on two large clinical datasets and the EU legislation dataset on few/zero-shot labels. |
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog (2021.naacl-main)
Copied to clipboard
| Challenge: | Semantic parsing using sequence-to-sequence models is stymied by higher compute requirements and higher latency. |
| Approach: | They propose a non-autoregressive approach to predict semantic parse trees with an efficient seq2seq model architecture. |
| Outcome: | The proposed architecture achieves an 81% reduction in latency on TOP dataset and retains competitive performance over non-pretrained models on three different semantic parsing datasets. |
Multilingual AMR Parsing with Noisy Knowledge Distillation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) parsing is a broad-coverage semantic formalism that encodes the meaning of a sentence as a rooted, directed, and labeled graph. |
| Approach: | They propose to use existing English parser to learn and improve multilingual AMR parsers . their results show that noisy input and precise output are key to successful distillation . |
| Outcome: | The proposed model outperforms the current state-of-the-art English-only parser on four different languages. |
RobustSentEmbed: Robust Sentence Embeddings Using Adversarial Self-Supervised Contrastive Learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing pre-trained language models exhibit poor generalization and robustness in adversarial settings. |
| Approach: | They propose a self-supervised sentence embedding framework that improves generalization and robustness against adversarial attacks. |
| Outcome: | The proposed framework reduces the success rate of adversarial attacks by almost half . it also improves semantic text similarity tasks and various transfer tasks . |
SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning (2024.emnlp-main)
Copied to clipboard
Jinghan Jia, Yihua Zhang, Yimeng Zhang, Jiancheng Liu, Bharat Runwal, James Diffenderfer, Bhavya Kailkhura, Sijia Liu
| Challenge: | Large Language Models (LLMs) have highlighted the need for effective unlearning mechanisms to comply with data regulations and ethical AI practices. |
| Approach: | They propose a second-order optimization-based LLM unlearning framework which extends the static, one-shot model update using influence unlearning to a dynamic, iterative unlearning process. |
| Outcome: | The proposed framework outperforms first-order methods across unlearning tasks, models, and metrics. |
The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing work does not critically analyze the scientific language models to the best of our knowledge. |
| Approach: | They evaluate scientific language models in handling short-query texts and textual neighbors by leveraging perturbations to generate textual neighbor classes. |
| Outcome: | The proposed model is ineffective for retrieving documents for short-query texts under the most relaxed conditions. |
Revisiting Document Representations for Large-Scale Zero-Shot Learning (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for visual recognition use visual attributes carefully annotated by humans. |
| Approach: | They propose a semi-automatic mechanism for visual sentence extraction that leverages document section headers and clustering structure of visual sentences. |
| Outcome: | The proposed method improves on the ImageNet dataset with 10,000 unseen classes. |
Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing graph neural networks (GNNs) teach message passing on a graph from text, resulting in a semantic gap between graph knowledge and text. |
| Approach: | They propose a framework to integrate external graph knowledge into chatbots by coagulating representations of both text and graph knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art (SOTA) baselines on dialogue generation. |
Enhancing Language Representation with Constructional Information for Natural Language Understanding (2023.acl-long)
Copied to clipboard
| Challenge: | Recent advances in natural language processing focus on acquiring lexico-semantic information. |
| Approach: | They propose a construction grammar which highlights the pairings of form and meaning to enrich language representation. |
| Outcome: | The proposed model is superior to existing models on a variety of NLU tasks. |
LLM-VA: Resolving the Jailbreak-Overrefusal Trade-off via Vector Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Existing vector steering methods adjust the magnitude of answer vectors, but this creates a fundamental trade-off—reducing jailbreak increases over-refusal. |
| Approach: | They propose a method which aligns va with vb through closed-form weight updates, making the model’s willingness to respond causally dependent on its safety assessment. |
| Outcome: | Experiments on 12 LLMs show that the proposed method achieves 11.45% higher F1 than the best baseline while preserving 95.92% utility. |
Consistent Representation Learning for Continual Relation Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to train relation extraction models overfit memory samples and perform poorly on imbalanced datasets. |
| Approach: | They propose a method which uses contrastive learning and knowledge distillation to train a model on data with new relations while avoiding forgetting old ones. |
| Outcome: | The proposed method significantly outperforms state-of-the-art baselines and yields strong robustness on the imbalanced datasets. |
Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Intervention (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to address performance gaps in LLMs rely on pretraining or fine-tuning, which are resource-intensive. |
| Approach: | They propose a framework that aligns LLMs' internal representations with those of high-performing languages during inference. |
| Outcome: | The proposed framework improves performance on low-performing (source) languages by aligning their internal representations with those of high-performing languages during inference. |
Towards Alleviating the Object Bias in Prompt Tuning-based Factual Knowledge Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to optimize prompts for factual knowledge extraction are undesirable object bias. |
| Approach: | They propose a prompt tuning method that reduces object bias and improves factual knowledge extraction. |
| Outcome: | The proposed method reduces object bias and improves accuracy of factual knowledge extraction. |
ChatEL: Entity Linking with Chatbots (2024.lrec-main)
Copied to clipboard
| Challenge: | Entity Linking (EL) is a challenging task in natural language processing . existing approaches focus on creating elaborate contextual models that are unwieldy and difficult to train . |
| Approach: | They propose a framework to prompt LLMs to return accurate results for Entity Linking . they use a three-step framework to generate a set of EL models that can be open-source . |
| Outcome: | The proposed framework improves the average F1 performance across 10 datasets by more than 2%. |
Improving Segmentation for Technical Support Problems (2020.acl-main)
Copied to clipboard
| Challenge: | Technical support problems are long and complex and cannot be correctly parsed by tools designed for natural language. |
| Approach: | They propose a sequence labelling task and a supervised text segmentation approach to solve this problem. |
| Outcome: | The proposed approach improves on the downstream task of answer retrieval. |
EASE: Entity-Aware Contrastive Learning of Sentence Embedding (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for learning sentence embeddings are fine-tuning general-purpose pretrained models with a particular training supervision. |
| Approach: | They propose a method for learning sentence embeddings via contrastive learning between sentences and related entities. |
| Outcome: | The proposed method outperforms baseline methods in multilingual settings on a variety of tasks. |
All-in-one: Multi-task Learning for Rumour Verification (C18-1)
Copied to clipboard
| Challenge: | Automatic resolution of rumours is a challenging task that can be broken down into smaller components that make up a pipeline . previous work focused on rumor detection, rumou tracking and stance classification as separate components . |
| Approach: | They propose a multi-task learning approach that allows joint training of main and auxiliary tasks, improving the performance of rumour verification. |
| Outcome: | The proposed approach improves the performance of rumour verification by combining main and auxiliary tasks into one pipeline. |
Sentence Matching with Syntax- and Semantics-Aware BERT (2020.coling-main)
Copied to clipboard
| Challenge: | Sentence matching aims to determine the special relationship between two sentences. |
| Approach: | They propose to integrate syntactic and semantic information into BERT with sentence matching by using an implicit integration method that is less sensitive to the output structure information. |
| Outcome: | The proposed method achieves state-of-the-art or competitive performance on several sentence matching datasets. |
Leveraging Local and Global Patterns for Self-Attention Networks (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to integrate local and global information into self-attention networks have been criticized for overlooking neighboring information. |
| Approach: | They propose a hybrid attention mechanism to leverage local and global information . they use a gating scalar to integrate both sources of information based on local contexts . |
| Outcome: | The proposed approach improves on translation tasks and shows that the two types of contexts are complementary. |
CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing benchmark datasets for Korean cultural and linguistic knowledge are derived from the English counterparts through translation, so they overlook cultural contexts. |
| Approach: | They propose to use Korean cultural and linguistic intelligence to assess Korean model performance by providing fine-grained annotations of cultural and cultural knowledge. |
| Outcome: | The proposed dataset includes 1,995 QA pairs and is based on 1,992 Korean exams and textbooks. |
Lattice-Based Transformer Encoder for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) takes deterministic sequences for source representations. However, word-level or subword-level segmentation has multiple choices to split a source sequence with different word segmentors or different subword vocabulary sizes. |
| Approach: | They propose lattice-based encoders to explore effective word or subword representations in an automatic way during training. |
| Outcome: | The proposed encoders can explore effective word or subword representation in an automatic way during training. |
Rethinking Word Similarity: Semantic Similarity through Classification Confusion (2025.naacl-long)
Copied to clipboard
| Challenge: | Word similarity measures cannot capture context-dependent, asymmetrical, polysemous nature of semantic similarity. |
| Approach: | They propose a new measure of similarity that reframes semantic similarity in terms of feature-based classification confusion. |
| Outcome: | The proposed model is comparable to cosine similarity in matching human similarity judgments across several datasets and can measure similarity using predetermined features of interest. |
A Neural Pairwise Ranking Model for Readability Assessment (2022.findings-acl)
Copied to clipboard
| Challenge: | Automatic Readability Assessment (ARA) is traditionally treated as a classification problem in NLP research. |
| Approach: | They propose a neural ranking approach to automatic readability assessment (ARA) they propose 'neural' ranking methods that can be used to rank texts by reading level . |
| Outcome: | The proposed approach performs well in monolingual single/cross corpus testing scenarios and achieves a zero-shot cross-lingual ranking accuracy of over 80% for both French and Spanish when trained on English data. |
LLatrieval: LLM-Verified Retrieval for Verifiable Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models struggle with factual errors and often produce non-factual and fabricated content. |
| Approach: | They propose to use large language models to generate text with supporting documents to enable the user to flexibly verify the answer. |
| Outcome: | Experiments on ALCE show that LLatrieval significantly outperforms extensive baselines and achieves state-of-the-art results. |
Enconter: Entity Constrained Progressive Sequence Generation via Insertion-based Transformer (2021.eacl-main)
Copied to clipboard
| Challenge: | Autoregressive language models do not perform well under hard lexical constraints as they lack fine control of content generation process. |
| Approach: | They propose a new insertion transformer that considers hard lexical constraints and imposes rules over objects in the generated text. |
| Outcome: | The proposed model outperforms baseline models in several performance metrics rendering it more suitable in practical applications. |
A Few-Shot Semantic Parser for Wizard-of-Oz Dialogues with the Precise ThingTalk Representation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to build effective semantic parsers for Wizard-of-Oz are insufficient. |
| Approach: | They propose a new dialogue representation and a sample-efficient methodology that can predict precise dialogue states in WOZ conversations. |
| Outcome: | The proposed model can predict precise dialogue states in WOZ conversations. |
Exploring the Capacity of a Large-scale Masked Language Model to Recognize Grammatical Errors (2022.findings-acl)
Copied to clipboard
| Challenge: | a language model-based error detection method can learn errors with a small training sample. |
| Approach: | They propose a language model-based method for grammatical error detection with feedback comments. |
| Outcome: | The proposed method can learn errors with a little training data and improve recall faster than non-language models. |
Parameter-Efficient Domain Knowledge Integration from Multiple Sources for Biomedical Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing domain-specific pre-trained language models (PLMs) rely on self-supervised learning over large amounts of domain text, without explicitly integrating domain- specific knowledge. |
| Approach: | They propose to integrate domain knowledge from diverse sources into PLMs by using adapters that are pre-trained for individual domain knowledge sources and integrated via an attention-based knowledge controller. |
| Outcome: | The proposed architecture integrates domain knowledge from diverse sources into PLMs in a parameter-efficient way. |
QUDeval: The Evaluation of Questions Under Discussion Discourse Parsing (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics poorly approximate parser quality, says a new study . questions under discussion is a linguistic framework that views discourse as asking questions and answering them . |
| Approach: | They propose a framework for automatic evaluation of QUD parsing . they use a dataset of fine-grained evaluation of 2,190 QUD questions . |
| Outcome: | The proposed framework shows that satisfying constraints of QUD is still challenging for modern LLMs. |
How are Prompts Different in Terms of Sensitivity? (2024.naacl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) has become one of the most popular learning paradigms due to the rapid development of large language models (LLMs). |
| Approach: | They propose a prompt analysis based on sensitivity and introduce sensitivity-aware decoding which incorporates sensitivity estimation as a penalty term in the standard greedy decoding. |
| Outcome: | The proposed approach is particularly useful when information in the input is scarce. |
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating scientific document representations fail to capture the diversity of relevant tasks. |
| Approach: | They propose a benchmark for training and evaluating scientific document representations that includes 24 challenging and realistic tasks across four formats: classification, regression, ranking and search. |
| Outcome: | The proposed model outperforms existing models by over 2 points absolute. |
Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent supervised neural models have greatly promoted the development of topic segmentation, but the deeper relationship between coherence and topic segmenting is underexplored. |
| Approach: | They propose to use topic-aware Sentence Structure Prediction and Contrastive Semantic Similarity Learning to capture coherence from logical structure and semantic similarity perspectives to further improve topic segmentation performance. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on WIKI-727K and achieves an average relative reduction of 4.3% on Pk on WikiSection. |
Delta-training: Simple Semi-Supervised Text Classification using Pretrained Word Embeddings (D19-1)
Copied to clipboard
| Challenge: | Pretrained word embeddings outperforms classifiers with randomly initialized word embeds, a new method is proposed for semi-supervised text classification. |
| Approach: | They propose a method that uses pretrained word embeddings to predict text classification . they use unlabeled data to build a classifier, and use early-stopping to improve performance . |
| Outcome: | The proposed method outperforms self-training and co-training frameworks on unlabeled data. |
Exploring Large Language Models for Multi-Modal Out-of-Distribution Detection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. |
| Approach: | They propose to apply world knowledge to enhance OOD detection performance through selective generation from large language models (LLMs) they propose to extract visual objects from each image to fully capitalize on the aforementioned world knowledge. |
| Outcome: | The proposed method outperforms the state-of-the-art on visual OOD detection on in-distribution (ID) samples. |
When Evolution Strategy Meets Language Models Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Autoregressive language models with pretraining often display limited capability in effectively following instructions. |
| Approach: | They propose an on-policy approach to optimize models by harnessing the principle of biological evolution, namely survival of the fittest. |
| Outcome: | The proposed method can achieve superior performance in various tasks and comparable performance in the human alignment task. |
HEAL: Hybrid Enhancement with LLM-based Agents for Text-attributed Hypergraph Self-supervised Representation Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to enhance text-attributed hypergraph self-supervised learning are limited by label scarcity. |
| Approach: | They propose a data-centric approach that leverages large language models to enhance hypergraph self-supervised learning by integrating hyperedges into a self-representation framework. |
| Outcome: | The proposed approach generates informative nodes and hyperedges through multi-round interaction with LLM-based agents. |
Construct a Sense-Frame Aligned Predicate Lexicon for Chinese AMR Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing lexicons blur senses and frames of predicates, which needs to be refined to meet word sense disambiguation and event extraction tasks. |
| Approach: | They propose to construct a predicate lexicon for Chinese AMR corpus with 14,389 senses and 10,800 frames of 8,470 words. |
| Outcome: | The proposed lexicon includes 14,389 senses and 10,800 frames of 8,470 words. |
Compositionality of Complex Graphemes in the Undeciphered Proto-Elamite Script using Image and Text Embedding Models (2021.findings-acl)
Copied to clipboard
| Challenge: | a language model over sign images produces more interpretable results than a model over text . a new language model is developed to abstract from human annotators . |
| Approach: | They propose a language modeling architecture which operates over sequences of images or over multimodal sequences with associated labels. |
| Outcome: | The proposed language model can interpret signs in the undeciphered proto-Elamite script . it also provides a novel way to abstract away from biases introduced by human annotators. |
SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing safety mechanisms for large language models (LLMs) are inadequate to fully leverage their internal cognitive processes. |
| Approach: | They propose a framework that regulates unsafe outputs by utilizing the prober-based internal state monitor that actively detects harmful intentions. |
| Outcome: | The proposed framework reduces harmful outputs by approximately 80% while maintaining strong utility. |
Building Semantic Grams of Human Knowledge (2020.lrec-1)
Copied to clipboard
| Challenge: | Word senses are typically defined with textual definitions and put in context via lexical-semantic relations such as synonymy, antonymy, hypernymy, etc. |
| Approach: | They propose a slot-filler structure to define the meaning of words in terms of their prototypical semantic information. |
| Outcome: | The proposed model improves on a semantic similarity task and shows significant improvements over state-of-the-art embeddings. |
Commonsense Knowledge Transfer for Pre-trained Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in pre-trained language models have transformed the landscape of natural language processing. |
| Approach: | They propose a framework to transfer commonsense knowledge stored in a neural commonsensing model to a general-purpose pre-trained language model. |
| Outcome: | Empirical results show that the proposed framework improves the model’s performance on downstream tasks that require commonsense reasoning. |
From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment (2026.findings-acl)
Copied to clipboard
Ivo Bueno, Babette Bühler, Philipp Stark, Tim Fütterer, Ulrich Trautwein, Dorottya Demszky, Heather Hill, Enkelejda Kasneci
| Challenge: | a framework for sentence-level interpretability of rubric-based scoring is proposed . aaron e. smith: automated scoring models provide little insight into why scores are produced . |
| Approach: | They propose a framework for sentence-level interpretability of rubric-based scoring that combines Shapley-value attributions with rationales generated by large language models. |
| Outcome: | The proposed framework compares fine-tuned pretrained language models with large language models . it shows that fine- tuned models outperform LLMs in prediction accuracy but exhibit label compression toward mid-scale scores . |
Knowledge Enhanced Masked Language Model for Stance Detection (2021.naacl-main)
Copied to clipboard
| Challenge: | Detecting stance on Twitter is difficult because of the short length of each tweet . Twitter content is dynamic, constantly coining new terminology and hashtags . |
| Approach: | They propose a BERT-based fine-tuning method that enhances stance detection models . they use weighted log-odds-ratio to identify words with high stance distinguishability . |
| Outcome: | The proposed method outperforms the state-of-the-art for stance detection on Twitter data about the 2020 US presidential election. |
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models encode implicit representations of knowledge in their parameters, but localizing these representations and disentangling them from each other remains an open problem. |
| Approach: | They propose a masking scheme that can be applied to weights and neurons to discover such subnetworks. |
| Outcome: | The proposed method can remove specific knowledge from models while minimizing adverse effects on the original model. |
Vocabulary Adaptation for Domain Adaptation in Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Neural network methods exhibit strong performance only in a few resource-rich domains. |
| Approach: | They propose a method that fine-tunes embedding layers of a pre-trained NMT model to the target domain. |
| Outcome: | The proposed method improves fine-tuning performance in En-Ja and De-En translation by 3.86 and 3.28 BLEU points. |
Cosine Similarity as Logits?: A Scalable Knowledge Probe Using Embedding Vectors from Generative Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing knowledge probes for pre-trained language models exhibit quadratic time complexity, limiting the size of knowledge graphs used for probing. |
| Approach: | They propose an embedding-based relational probe that evaluates pre-trained language models' factual knowledge retrieval capabilities. |
| Outcome: | The proposed probe achieves effective time complexity of linear order O(n), supports rank-based evaluation metrics including Hit@k, handles multi-token entity names and enables probing whilst disambiguating homographic tail-entity names. |
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT (2021.emnlp-main)
Copied to clipboard
| Challenge: | Infusing factual knowledge into pre-trained models is fundamental for many knowledge-intensive tasks. |
| Approach: | They propose an infusion approach that partitions a large knowledge graph into smaller sub-graphs and infuses their specific knowledge into various BERT models using lightweight adapters. |
| Outcome: | The proposed approach improves the underlying BERTs and achieves new SOTA performance on six downstream tasks. |
Multi-Relational Probabilistic Event Representation Learning via Projected Gaussian Embedding (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event representation learning ignore relations and uncertainty of events . Experimental results show that the proposed approach outperforms other state-of-the-art baselines on both existing and newly constructed datasets. |
| Approach: | They propose a novel approach to learning multi-relational probabilistic event embeddings based on contrastive learning. |
| Outcome: | The proposed method outperforms existing benchmarks on existing and newly constructed datasets. |
On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing decoder-based pre-trained language models demonstrate excellent multilingual capabilities, but it is unclear how they handle multilingualism. |
| Approach: | They propose to examine the neuron-level internal behavior of decoder-based PLMs by finding neurons that fire “uniquely for each language” within decoded PLM models. |
| Outcome: | The proposed models fire “uniquely for each language” and show that language-specific neurons are unique, with a slight overlap (5%) between languages. |
BERT for Monolingual and Cross-Lingual Reverse Dictionary (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to find the proper word for a word are based on the surface form of words, but they cannot extract the semantic meaning. |
| Approach: | They propose a method to make BERT generate the target word for this task . cross-lingual reverse dictionary is the task to find the proper target word . |
| Outcome: | The proposed method can generate the target word for cross-lingual reverse dictionary task even without the parallel corpus. |
DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | a few benchmarking datasets have been released to evaluate the factual knowledge of pretrained language models. |
| Approach: | They propose a framework for curating factual triples from Wikidata that are culturally diverse. |
| Outcome: | The proposed framework is built of factual triples from three pairs of contrasting cultures with 78,259 triples. |
Combining Discourse Markers and Cross-lingual Embeddings for Synonym–Antonym Classification (N19-1)
Copied to clipboard
| Challenge: | Recent work shows that distributional semantic approaches have difficulty distinguishing between synonyms and antonyms. |
| Approach: | They propose to use monolingual distributional information available in a target language to transfer supervision to other languages using cross-lingual word embeddings. |
| Outcome: | The proposed method improves the transfer of monolingual distributional information to other languages using co-occurrences with discourse markers indicative of antonymy. |
Learning grounded word meaning representations on similarity graphs (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to learn semantic representations from text are limited to words in context and words in isolation. |
| Approach: | They propose a method to learn meaning representations of words as low-dimensional node embeddings on an underlying graph hierarchy. |
| Outcome: | The proposed model outperforms the state-of-the-art in terms of similarity judgments and concept categorization. |
DDxGym: Online Transformer Policies in a Knowledge Graph Based Natural Language Environment (2024.lrec-main)
Copied to clipboard
Benjamin Winter, Alexei Gustavo Figueroa Rosero, Alexander Loeser, Felix Alexander Gers, Nancy Katerina Figueroa Rosero, Ralf Krestel
| Challenge: | specialized OpenAI Gym environment for clinical differential diagnosis is limited by data access due to privacy concerns. |
| Approach: | They propose a specialized OpenAI Gym environment for clinical differential diagnosis . they frame the task as a natural-language-based reinforcement learning problem . |
| Outcome: | The proposed model improves over baselines and improves on existing models. |
AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing defense agencies fail to adaptively and effectively mitigate these risks. |
| Approach: | They propose a lifelong agent guardrail that enhances LLM agent safety by enabling adaptive safety check generation, effective safety check optimization, and tool compatibility & flexibility. |
| Outcome: | The proposed agent guardrail achieves strong performance against task-specific and systemic risks and is transferable across different LLM agents’ tasks. |
A Label-Aware BERT Attention Network for Zero-Shot Multi-Intent Detection in Spoken Language Understanding (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems for speech-based dialogs have found the inadequacy of relying on simple classification techniques to accomplish the automation task. |
| Approach: | They propose a Label-Aware BERT Attention Network (LABAN) for zero-shot multi-intent detection by encoding input utterances with BERT and building a label embedded space by considering embedded semantics in intent labels. |
| Outcome: | The proposed approach can detect many unseen intent labels correctly on a few/zero-shot setting, and achieves state-of-the-art performance on five multi-intent datasets in normal cases. |
Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification (D19-1)
Copied to clipboard
| Challenge: | supervised learning models perform poorly at low-shot tasks for which little labeled data is available for training. |
| Approach: | They propose to combine a bag-of-words embedding approach and a context-aware method to improve low-shot text classification. |
| Outcome: | The proposed method improves low-shot text classification with pre-training and rationales . the simple bag-of-words approach is the clear top performer when there are few training instances or less . |
From Text Segmentation to Enhanced Representation Learning: A Novel Approach to Multi-Label Classification for Long Texts (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models rely on pre-trained language models, which have a maximum input sequence length of 512 tokens, and therefore have 'input length limitation'. |
| Approach: | They propose a text segmentation algorithm which guarantees to produce the optimal segmentation to address the issue of input length limitation caused by PLMs. |
| Outcome: | The proposed method improves both text and label representations on MLTC datasets, unraveling the intricate correlations between texts and labels. |
ETAS: Zero-Shot Transformer Architecture Search via Network Trainability and Expressivity (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing Transformer Architecture Search methods are limited to computer vision and natural language processing tasks. |
| Approach: | They propose a Transformer Architecture Search proxy that measures trainability and expressivity of Transformer networks separately and integrates it into an effective regularized evolution framework to demonstrate its efficacy. |
| Outcome: | The proposed proxy can achieve higher correlation with the true performance of Transformer networks on computer vision and natural language processing tasks. |
TIGS: An Inference Algorithm for Text Infilling with Gradient Search (P19-1)
Copied to clipboard
| Challenge: | Text infilling is an under-explored challenge in the field of text generation. |
| Approach: | They propose an iterative inference algorithm based on gradient search that can be broadly applied to any sequence generative model for text infilling tasks. |
| Outcome: | The proposed method performs well on three different text infilling tasks with different mask ratios and mask strategies compared with five state-of-the-art methods. |
Meta-Cultural Competence: Climbing the Right Hill of Cultural Awareness (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent studies show that Large Language Models are biased towards a Western and Anglo-centric worldview. |
| Approach: | They propose to extend the Octopus test to measure "cultural awareness" they argue that cultural awareness is needed for AI systems to be useful across cultures . |
| Outcome: | The proposed method argues that cultural awareness is not cultural knowledge, but meta-cultural competence . the proposed method is based on the octopus test, which shows it is impossible to learn meaning from real-world concepts without knowing intent and meaning . |
Identifying Semantic Induction Heads to Understand In-Context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance, but lack of transparency in their inference logic raises concerns about their trustworthiness. |
| Approach: | They conduct a detailed analysis of the operations of attention heads to understand their in-context learning of LLMs. |
| Outcome: | The proposed analysis of attention heads reveals that they increase the output logits of object tokens and recall objects . the proposed model is a novel approach to understand the in-context learning of large language models. |
Uncertainty Quantification for Clinical Outcome Predictions with (Large) Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Language models (LMs) have significant potential for clinical prediction tasks . however, unreliable decisions can result in significant costs due to compromised patient safety and ethical concerns . |
| Approach: | They propose to combine ensembling and multi-tasking approaches to reduce uncertainty in EHRs by using multi-tapping methods. |
| Outcome: | The proposed framework reduces model uncertainty in white-box and black-box settings, and improves model transparency in both settings. |
DET: A Dual-Encoding Transformer for Relational Graph Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to graph representation only consider the local neighbors, sacrificing the Transformer’s ability to attend to elements at any distance. |
| Approach: | They propose a dual-encoding Transformer architecture that uses a structural encoder and a semantic encoder to seek for semantically relevant nodes. |
| Outcome: | The proposed architecture achieves superior performance compared to state-of-the-art attention-based methods on complex relational graphs like KGs and citation networks. |
Text Embedding Inversion Security for Multilingual Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | storing sensitive information as embeddings is susceptible to security breaches, as text can be reconstructed from embeddables . study explores multilingual inversion attacks using a masking defense . |
| Approach: | They propose a simple masking defense that can be used to decode embedded text . they define the problem of black-box multilingual and crosslingual inversion attacks . |
| Outcome: | The proposed defense is effective for both monolingual and multilingual models. |
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that pre-trained text encoders can perform many NLP tasks with less resource. |
| Approach: | They propose a BERT-based Chinese text encoder enhanced by n-gram representations . they show reasonable performance when ZEN is trained on a small corpus . |
| Outcome: | The proposed encoder incorporates the comprehensive information of both the character sequence and words or phrases it contains. |
GRhOOT: Ontology of Rhetorical Figures in German (2022.lrec-1)
Copied to clipboard
| Challenge: | GRhOOT is a domain ontology of rhetorical figures in the German language . the goal is to allow for easier detection of non-literal language based tasks . |
| Approach: | GRhOOT is a domain ontology of 110 rhetorical figures in the german language . the goal is to allow for easier detection and sentiment analysis . |
| Outcome: | The ontology of rhetorical figures in the German language is based on 110 rhetorical figure domains . the goal is to make the ontologies more accurate and to allow for easier detection . |
Evaluation of LLMs-based Hidden States as Author Representations for Psychological Human-Centered NLP Tasks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Many human-centered NLP tasks focus on assessing human-attributes of a user based on their language. |
| Approach: | They evaluate different ways of representing documents and users using different LM and HuLM architectures to predict task outcomes as dynamically changing states and averaged trait-like user-level attributes. |
| Outcome: | The proposed representations predict valence, arousal, empathy, and distress as well as trait-like user-level attributes. |
LLMEmbed: Rethinking Lightweight LLM’s Genuine Function in Text Classification (2024.acl-long)
Copied to clipboard
| Challenge: | Recent attempts to improve text classification performance are based on heuristic Chain-of-Thought (CoT) LLMEmbed is a simple and effective transfer learning strategy that can be used to improve the performance of large language models. |
| Approach: | They propose a simple transfer learning strategy to improve text classification using heuristic Chain-of-Thought. |
| Outcome: | The proposed method achieves strong performance on publicly available datasets while using low training overhead. |
RotateCT: Knowledge Graph Embedding by Rotation and Coordinate Transformation in Complex Space (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods fail to model non-commutative composition patterns . Existing methods are limited to complex space, resulting in a large number of parameters. |
| Approach: | They propose a knowledge graph embedding method that transforms the coordinates of each entity and then represents each relation as a rotation from head entity to tail entity in complex space. |
| Outcome: | The proposed method outperforms state-of-the-art methods on link prediction and path query answering. |
REALM: A Dataset of Real-World LLM Use Cases (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on LLM adoption and their social implications lack empirical grounding, weakening their validity. |
| Approach: | They propose to integrate a dataset of over 94,000 LLM use cases collected from Reddit and news articles to provide insights into LLM adoption across different domains. |
| Outcome: | The proposed dataset includes over 94,000 LLM use cases collected from Reddit and news articles. |
From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work in this field has looked most commonly into gender bias, racial bias, and religious bias. |
| Approach: | They propose an algorithm that uses a neural network to perform ‘soft debiasing’ and build on the seminal work of (CITATION) and (CitATION). |
| Outcome: | The proposed algorithm outperforms current methods on gender, race, and religion metrics on a wide range of metrics. |
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding (2022.emnlp-main)
Copied to clipboard
| Challenge: | Prompt Tuning has been successful as a parameter-efficient method of conditioning large-scale pre-trained language models to perform downstream tasks. |
| Approach: | They propose to use a vector-quantized input-contextualized prompt as an extension to the soft prompt tuning framework to learn contextualization of soft prompt tokens. |
| Outcome: | The proposed prompt outperforms soft prompt tuning by an average margin of 1.19% on various language understanding tasks like SuperGLUE, QA, Relation classification, NER and NLI. |
Transformers in the loop: Polarity in neural models of language (2022.acl-long)
Copied to clipboard
| Challenge: | Recent Transformer-based language representation models (LRMs) show impressive results on practical text analysis tasks, but do they have access to complex linguistic notions? |
| Approach: | They propose to use polarity as a case study to compare metrics derived from language models to human judgments obtained in psycholinguistic experiments. |
| Outcome: | The proposed model is more accurate than linguistic theory predictions for polarity, and allows us to use language models to discover new insights into natural language grammar beyond existing linguistic theories. |
DOC-RAG: ASR Language Model Personalization with Domain-Distributed Co-occurrence Retrieval Augmentation (2024.lrec-main)
Copied to clipboard
| Challenge: | Extensive experiments on three user-specific speech-to-text tasks show that DOC-RAG significantly outperforms strong baselines with an 8-15% improvement in terms of perplexity and a 4-7% reduction in terms in terms . of Word Error Rates. |
| Approach: | They propose a domain-distributed co-occurrence augmentation approach to improve automatic speech recognition of rare word patterns in unseen domains by using n-gram co-existence distributions. |
| Outcome: | Experiments on three user-specific speech-to-text tasks show that DOC-RAG outperforms baselines with an 8-15% improvement in terms of perplexity and a 4-7% reduction in terms in terms . of Word Error Rates. |
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on pushing weight-only quantization to extremely low-bit due to numerical representation limitations. |
| Approach: | They propose a vector-based quantization approach that pushes LLMs to extremely low-bit . they propose scalar-based weight quantization that reduces memory requirements and optimizes storage costs . |
| Outcome: | The proposed method reduces model quantization perplexity by 0.01-0.34 on LLaMA-2, 0.38-0.68 on mistral-7B, 4.41-7.34, on llaMA-3 on QA tasks on average. |
Measuring memorization in language models via probabilistic extraction (2025.naacl-long)
Copied to clipboard
Jamie Hayes, Marika Swanberg, Harsh Chaudhari, Itay Yona, Ilia Shumailov, Milad Nasr, Christopher A. Choquette-Choo, Katherine Lee, A. Feder Cooper
| Challenge: | Large language models (LLMs) are susceptible to memorizing training data, raising concerns about the potential extraction of sensitive information at generation time. |
| Approach: | They propose a method that splits training example into prefix and suffix, prompts LLM with suffix and deems it extractable if it generates the suffix using greedy sampling. |
| Outcome: | The proposed method is unreliable because it does not account for non-determinism in more realistic sampling schemes. |
BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languages (L18-1)
Copied to clipboard
| Challenge: | In an evaluation using fine-grained entity typing as testbed, BPEmb performs competitively . pre-trained subword embeddings for BPE units are commonly available . |
| Approach: | They present a collection of pre-trained subword embeddings in 275 languages . they use fine-grained entity typing as testbed to evaluate BPEmb . |
| Outcome: | The proposed method performs better than other methods, but requires less resources and no tokenization. |
Improving the Throughput of Diffusion-based Large Language Models via a Training-Free Confidence-Aware Calibration (2026.findings-acl)
Copied to clipboard
Jucheng Shen, Gaurav Sarkar, Yeonju Ro, Sharath Nittur Sridhar, Zhangyang Wang, Aditya Akella, Souvik Kundu
| Challenge: | CadLLM is a plug-and-play model-agnostic with KV caching based dLLMs. |
| Approach: | They propose a lightweight adaptive method that can control the generation block size, step size, and threshold based on the average confidence score of unmasked tokens. |
| Outcome: | The proposed method can increase throughput by up to 1.1-2.28x over the state-of-the-art model with competitive accuracy. |
Pre-trained Language Models for Entity Blocking: A Reproducibility Study (2024.naacl-long)
Copied to clipboard
| Challenge: | Entity Resolution (ER) is an essential task in data integration . state-of-the-art neural IR models that are based on large language models have not been evaluated on the ER task. |
| Approach: | They evaluate state-of-the-art neural IR models that are based on large language models on a wide range of real-world datasets and evaluate their generalization abilities. |
| Outcome: | The proposed methods have been evaluated on a wide range of datasets and their generalization abilities. |
HTML: Hierarchical Topology Multi-task Learning for Semantic Parsing in Knowledge Base Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches struggle with mapping questions to precise logical forms . Existing frameworks struggle with complex mapping of questions to logical form . |
| Approach: | They propose a framework that leverages a hierarchical multi-task learning paradigm to enhance the performance of logical form generation. |
| Outcome: | The proposed framework outperforms supervised fine-tuning methods and training-free ones on large language models. |
Facts Fade Fast: Evaluating Memorization of Outdated Medical Knowledge in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLMs encode extensive knowledge within their parameters, but the knowledge in LLM models can become outdated over time. |
| Approach: | They propose two new LLMs that provide outdated medical advice . they compare the models with a set of QA pairs whose verdict changed through time . |
| Outcome: | The proposed models exhibit memorization of outdated knowledge to some extent. |
MEANT: Multimodal Encoder for Antecedent Information (2024.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal data is an ideal candidate for multimodal evaluation, but information can exist across time. |
| Approach: | They propose a multimodal encoder for anticedent information and a dataset that consists of price, Tweets, and graphical data. |
| Outcome: | The MEANT model improves performance on baselines by 15% and the textual information affects performance far more than visual information on time-dependent tasks. |
Crossing Variational Autoencoders for Answer Retrieval (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods learned semantic representations with dual encoders or dual variational auto-encoders failed to capture the aligned semantics between question and answer. |
| Approach: | They propose to use two variational auto-encoders to generate questions with aligned answers and generating answers with align questions. |
| Outcome: | The proposed method outperforms the state-of-the-art answer retrieval method on SQuAD. |
Characterizing and Measuring Linguistic Dataset Drift (2023.acl-long)
Copied to clipboard
Tyler Chang, Kishaloy Halder, Neha Anna John, Yogarshi Vyas, Yassine Benajiba, Miguel Ballesteros, Dan Roth
| Challenge: | Existing metrics for dataset drift have not considered specific dimensions of linguistic drift that affect model performance. |
| Approach: | They propose three dimensions of linguistic dataset drift: vocabulary, structural, and semantic drift. |
| Outcome: | The proposed metrics are more effective than previous metrics at predicting out-of-domain model accuracies compared to popular fine-tuned embedding distances . |
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current temporal knowledge graph question answering methods focus on implicit temporal constraints and lack the capability to handle complex temporal queries. |
| Approach: | They propose a temporal knowledge graph question answering framework that recursively decomposes questions into sub-problems and employs multi-path answer aggregation to improve fault tolerance. |
| Outcome: | The proposed framework outperforms existing methods on multiTQ and TimelineKGQA benchmarks. |
UniSent: Universal Adaptable Sentiment Lexica for 1000+ Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Sentiment lexica are vital for sentiment analysis in absence of document-level annotations . linguistic resources are limited for at least a few hundred languages, putting them at risk of extinction . |
| Approach: | They introduce UniSent universal sentiment lexica for 1000+ languages . they use a Bible corpus to project sentiment information from English to other languages based on Twitter data . |
| Outcome: | The proposed method mitigates domain mismatch between Bible and Twitter by using embeddings . it compares to other sentiment seeding methods in a subset of languages with ground truth available . |
PORTS: Preference-Optimized Retrievers for Tool Selection with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing retrieval-based methods to pre-select tools are often misaligned with tool-calling LLMs due to separate training processes. |
| Approach: | They propose a method to fine-tune retrievers to find useful tools by using a frozen LLM. |
| Outcome: | The proposed method fine-tunes retrievers to find useful tools using a frozen LLM . it improves tool selection accuracy and can be generalized to new queries and tools . |
On the Relationship between Truth and Political Bias in Language Models (2024.emnlp-main)
Copied to clipboard
Suyash Fulay, William Brannon, Shrestha Mohanty, Cassandra Overney, Elinor Poole-Dayan, Deb Roy, Jad Kabbara
| Challenge: | Language model alignment research often attempts to ensure that models are helpful and harmless, but can obscure how improving one aspect might impact the other. |
| Approach: | They analyze the relationship between truthfulness and political bias in language models. |
| Outcome: | The results show that optimizing models for truthfulness results in a left-leaning political bias. |
Introducing Graph Context into Language Models through Parameter-Efficient Fine-Tuning for Lexical Relation Mining (2025.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models can effectively mine lexical relations between word pairs . however, graph features and semantic knowledge of pre-tried models are lacking in the task. |
| Approach: | They propose a parameter-efficient fine-tuning method which integrates graph features and semantic representations for lexical relation classification and lexic entailment tasks. |
| Outcome: | The proposed method integrates graph features and semantic representations for lexical relation mining tasks. |
ABC: Attention with Bounded-memory Control (2022.acl-long)
Copied to clipboard
Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith
| Challenge: | Existing approaches to attention with bounded-memory control (ABC) have a quadratic complexity in sequence lengths, making it prohibitive for long sequences. |
| Approach: | They propose a new abstraction that bounds memory size to improve efficiency . they propose bounded-memory control, which connects several efficient attention variants . |
| Outcome: | The proposed approach outperforms existing approaches on language modeling, machine translation, and masked language model finetuning. |
Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment (2023.findings-emnlp)
Copied to clipboard
Boyang Xue, Weichao Wang, Hongru Wang, Fei Mi, Rui Wang, Yasheng Wang, Lifeng Shang, Xin Jiang, Qun Liu, Kam-Fai Wong
| Challenge: | Experimental results show that pretrained language models generate inconsistent factual knowledge in many conversational tasks. |
| Approach: | They propose a method which explicitly introduces extended feedforward networks (FFNs) in Transformers to enhance factual knowledge expressions given the specific patterns of knowledge-grounded dialogue inputs. |
| Outcome: | The proposed methods improve the factual expression capability of feedforward networks (FFNs) in knowledge-grounded dialogue systems by knowledge enhancement and alignment respectively. |
MulCode: A Multiplicative Multi-way Model for Compressing Neural Language Model (D19-1)
Copied to clipboard
| Challenge: | a large number of parameters dominate the memory usage of deep neural nets . compression of embedding layers is the key to reducing memory usage . |
| Approach: | They propose a multi-way multiplicative neural compressor to compress embedding layers . they use an adaptively created matrix and multiplicativative compositions to learn them . |
| Outcome: | a new multi-way multiplicative neural compressor can achieve 41.38 times compression rate with little loss in performance. |
SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascading (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) demonstrate remarkable performance across diverse tasks, yet their effectiveness often depends on costly commercial APIs or cloud services. |
| Approach: | They propose a dual-mode compatible approach that fine-tunes models through shortest-response preference optimization and a confidence-aware rejection mechanism. |
| Outcome: | The proposed approach reduces redundant outputs and response times while reducing computational costs by over 50% and cascade latency by over 80%. |
Guiding Neural Machine Translation with Semantic Kernels (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical studies show that our approach gains approximately an improvement of 1 BLEU score on most benchmarks over the Transformer baseline. |
| Approach: | They propose to extract several semantic kernels from a source sentence to capture global semantic information. |
| Outcome: | Empirical results show that the proposed approach improves 1 BLEU score on benchmarks . it is also 1.7 times faster than previous works on average at inference time . |
Dynamic Contextualized Word Embeddings (2021.acl-long)
Copied to clipboard
| Challenge: | Static word embeddings that represent words by a single vector cannot capture word meaning in different linguistic and extralinguistic contexts. |
| Approach: | They propose dynamic contextualized word embeddings that represent words as a function of linguistic and extralinguistic contexts. |
| Outcome: | The proposed model models time and social space jointly, making them attractive for NLP tasks involving semantic variability. |
Can Pre-trained Language Models Interpret Similes as Smart as Human? (2022.acl-long)
Copied to clipboard
| Challenge: | Simile interpretation is a crucial task in natural language processing. |
| Approach: | They propose a task to let PLMs infer the shared properties of similes by probing textual corpora and human-designed questions. |
| Outcome: | The proposed task outperforms pre-trained language models on simile interpretation tasks while still underperforming humans. |
When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models struggle with tasks requiring rich world knowledge, implying the difficulty of encoding a wealth of world knowledge in their parameters. |
| Approach: | They propose a retrieval-augmentation method that improves performance and reduces inference costs by only retrieving non-parametric memories when necessary. |
| Outcome: | The proposed method improves performance and reduces inference costs by only retrieving non-parametric memories when necessary. |
Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been studied for their ability to store and utilize positive knowledge. |
| Approach: | They propose to use a constrained keywords-to-sentence generation task and a Boolean question answering task to probe large language models on negative commonsense knowledge. |
| Outcome: | The proposed tasks show that LLMs fail to generate valid sentences grounded in negative commonsense knowledge, yet they can correctly answer yes-or-no questions. |
EsCoLA: Spanish Corpus of Linguistic Acceptability (2024.lrec-main)
Copied to clipboard
| Challenge: | Acceptability is one of the general language understanding evaluation benchmarks (GLUE) probing tasks . EsCoLA consists of 11,174 sentences and their acceptability judgements as found in well-known Spanish reference grammars. |
| Approach: | They propose to use a corpus of linguistic acceptability (ESCoLA) EsCoLA consists of 11,174 sentences and their acceptability judgements . |
| Outcome: | The proposed task is based on 11,174 sentences and their acceptability judgements as found in well-known Spanish reference grammars. |
Feature Interactions Reveal Linguistic Structure in Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing features attribution methods for post-hoc interpretability ignore the existence of interactions between the effects of features on the prediction. |
| Approach: | They propose a grey box method to train models to perfection on a formal language classification task using PCFGs. |
| Outcome: | The proposed methods are able to uncover the grammatical rules acquired by the model under specific configurations and provide novel insights into the linguistic structure of the target models. |
PUNR: Pre-training with User Behavior Modeling for News Recommendation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing news recommendation methods use pre-trained language models to produce news vectors and user vectors. |
| Approach: | They propose an unsupervised pre-training paradigm with two tasks for user behavior modeling. |
| Outcome: | The proposed model improves on the real-world news benchmark. |
From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods encode the triples of entities as embeddings and learn to align the embeddables, which prevents the direct interaction between the original information of the cross-KG entities. |
| Approach: | They propose to transform the triples into unified textual sequences and model the EA task as a bi-directional textual entailment task between the sequences of cross-KG entities. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five cross-lingual datasets and allows the mutual enhancement of the heterogeneous information. |
It is a Bird Therefore it is a Robin: On BERT’s Internal Consistency Between Hypernym Knowledge and Logical Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for lexical knowledge of NLP systems only use collocational cues for questions . lexicon of these systems is limited to content words and logical words. |
| Approach: | They propose a method to test the understanding of the hypernymy relationship by measuring its antisymmetry according to the models. |
| Outcome: | The proposed model shows that it is weak on the semantic tasks of the Masked Language Modeling task. |
Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies of the computational power of recurrent neural networks reveal a hierarchy of RNN architectures, given finite-precision assumptions. |
| Approach: | They propose to use auto-regressive Transformers with linearised attention to build RNNs . they show that many well-known results for the standard Transformer directly transfer to LTs - a new approach is proposed . |
| Outcome: | The proposed extensions overcome limitations of the LT and self-referential weight matrices. |
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages (2024.acl-long)
Copied to clipboard
Shih-Cheng Huang, Pin-Zu Li, Yu-chi Hsu, Kuang-Ming Chen, Yu Tung Lin, Shih-Kai Hsiao, Richard Tsai, Hung-yi Lee
| Challenge: | Despite the rapid development of large language models, the language capabilities of most open-source LLMs are primarily focused on English due to data constraints. |
| Approach: | They propose a chat vector to equip pre-trained language models with instruction following and human value alignment via simple model arithmetic. |
| Outcome: | The proposed method can be extended to include various languages, base models, and chat vectors. |
Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification using Graph Neural Networks? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Graph Neural Networks have been used for text classification, but only in domains with limited data characteristics. |
| Approach: | They compare graph representation methods for text classification using different architectures and setups. |
| Outcome: | The proposed graph representation methods outperform other models in document comprehension tasks. |
Model Composition for Multimodal Large Language Models (2024.acl-long)
Copied to clipboard
Chi Chen, Yiyang Du, Zheng Fang, Ziyue Wang, Fuwen Luo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Maosong Sun, Yang Liu
| Challenge: | Existing methods for creating versatile MLLMs rely on joint training with paired instruction data, which is resource-intensive and challenging to extend to new modalities. |
| Approach: | They propose a new paradigm for multimodal large language models by reusing modality encoders and merging LLM parameters. |
| Outcome: | The proposed model retains the modal understanding capabilities of each original model. |
IUQ: Interrogative Uncertainty Quantification for Long-Form Large Language Model Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantify uncertainty in LLMs produce short or constrained answer sets, but many real-world applications require long-form and free-form text generation. |
| Approach: | They propose a framework that leverages inter-sample consistency and intra-sampled faithfulness to quantify the uncertainty in long-form LLM outputs. |
| Outcome: | The proposed framework provides reliable measures of claim-level uncertainty and the model’s faithfulness over two widely used long-form generation datasets. |
Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing supervised models struggle to make correct predictions on rare word senses due to limited training data. |
| Approach: | They propose a gloss alignment algorithm that can align definition sentences with the same meaning from different sense inventories to collect rich lexical knowledge. |
| Outcome: | The proposed method outperforms previous methods on both frequent and rare word senses. |
Language-agnostic Representation from Multilingual Sentence Encoders for Cross-lingual Similarity Estimation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract language-specific information from multilingual sentence embeddings are remarkably successful in cross-lingual and multilingual NLU tasks. |
| Approach: | They propose to extract language-specific information from the original embedding and use it to retrieve an embeddable that fully represents the sentence’s meaning. |
| Outcome: | The proposed method outperforms baselines on cross-lingual sentences even in low-resource language pairs where only tens of thousands of parallel sentence pairs are available. |
Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs (2024.acl-long)
Copied to clipboard
| Challenge: | Currently, language models struggle to generate commonsense inferences for complex tasks due to data scarcity and the difficulty of reasoning over multiple pieces of information. |
| Approach: | They propose a dataset to generate commonsense inferences from commonsensible data . they use a commonsence knowledge graph to extract and form questions from existing commonseense knowledge graphs. |
| Outcome: | The proposed dataset improves the ability of language models to reason about complex events without expensive human annotations. |
CACL: Community-Aware Heterogeneous Graph Contrastive Learning for Social Media Bot Detection (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for social media bot detection neglect community structure and poor model generalization due to the relatively small scale of the dataset. |
| Approach: | They propose a framework that constructs social networks as heterogeneous graphs and uses community-aware modules to mine hard positive and hard negative samples for supervised graph contrastive learning. |
| Outcome: | The proposed framework outperforms baselines on three social media bot benchmarks. |
SCIURus: Shared Circuits for Interpretable Uncertainty Representations in Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for uncertainty quantification in large language models provide little insight into factors responsible for an uncertainty estimate, limiting their usefulness as practical tools for improving trustworthiness and understanding uncertainty reasoning. |
| Approach: | They adapt causal tracing and zero-ablation techniques to study the effect of different circuits on LLM generation to identify whether factuality of generated responses and uncertainty originate in separate or shared circuits. |
| Outcome: | The proposed methods use the well-established methods of causal tracing and zero-ablation to study the effect of different circuits on LLM generation. |
Text Rendering Strategies for Pixel Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to rendering text use a large set of almost-equivalent input patches, which may prove sub-optimal for downstream tasks due to redundancy in the input representations. |
| Approach: | They propose four approaches to rendering text in a PIXEL model using character bigrams and patch frequency biases. |
| Outcome: | The proposed models perform better on sentence-level tasks without compromising performance on token-level or multilingual tasks. |
Exploring Graph Representations of Logical Forms for Language Modeling (2025.findings-acl)
Copied to clipboard
| Challenge: | Graph-based formal-logical distributional semantics models are more data-efficient than textual counterparts. |
| Approach: | They propose a pretrained language model over graph representations of logical forms as a proof-of-concept. |
| Outcome: | The proposed model outperforms textual, transformer LMs on downstream tasks . the model is likely to scale with additional parameters and pretraining data . |
CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new benchmark is designed to evaluate LLMs on Chinese legal knowledge and its application in reasoning . general pre-training that ingests legal texts without specialized focus compromises reliability of LLM responses . achieving trustworthy legal reasoning in LLM requires a robust synergy of accurate knowledge retrieval and strong general reasoning capabilities. |
| Approach: | They propose a benchmark specifically engineered to evaluate LLMs on Chinese legal knowledge and its application in reasoning. |
| Outcome: | The proposed benchmark evaluates LLMs on Chinese legal knowledge and its application in reasoning. |
Platform-Invariant Topic Modeling via Contrastive Learning to Mitigate Platform-Induced Bias (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing topic models that analyze documents from multiple platforms are not able to capture the authentic topics due to platform-induced biases. |
| Approach: | They propose to use a platform-invariant contrastive learning algorithm to reduce platform influence in topic models by removing platform-specific jargon word sets. |
| Outcome: | The proposed model reduces platform influence in topic models by developing a platform-invariant contrastive learning algorithm and removing platform-specific jargon word sets. |
AMIA: Automatic Masking and Joint Intention Analysis Makes LVLMs Robust Jailbreak Defenders (2025.findings-emnlp)
Copied to clipboard
| Challenge: | AMIA is a lightweight, inference-only defense for Large Vision–Language Models . it automatically masks text-irrelevant image patches and conducts joint Intention Analysis . |
| Approach: | AMIA is a lightweight, inference-only defense for large vision–language models . it automatically masks a small set of text-irrelevant image patches to disrupt adversarial perturbations . |
| Outcome: | AMIA improves defense success rates across diverse LVLMs and jailbreak benchmarks . it preserves general utility with only 2% accuracy drop, incurs only modest inference overhead . |
CoVE: Compressed Vocabulary Expansion Makes Better LLM-based Recommender Systems (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to align LLMs with recommendation tasks do not fully leverage their sequential information processing capabilities. |
| Approach: | They propose a system that allows users to expand their vocabulary by assigning a unique ID to each item within the expanded vocabulary. |
| Outcome: | The proposed system maximizes the sequence understanding abilities of large language models, significantly enhancing their performance on recommendation tasks. |
Interview: Large-scale Modeling of Media Dialog with Discourse Patterns and Knowledge Grounding (2020.emnlp-main)
Copied to clipboard
| Challenge: | Discourse analysis has been limited to small news corpora, but this study is expanding to tens of thousands of interviews. |
| Approach: | They propose a large-scale analysis of discourse in media dialog and its impact on dialog modeling with a focus on interrogative patterns and use of external knowledge. |
| Outcome: | The proposed model outperforms strong discourse-agnostic baselines for dialog modeling, generating more specific and topical responses in interview-style conversations. |
CE-DA: Custom Embedding and Dynamic Aggregation for Zero-Shot Relation Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to predict relationships with given entity pairs are lacking in supervised methods. |
| Approach: | They propose a framework for zero-shot Relation Extraction that includes two modules: Custom Embedding and Dynamic Aggregation. |
| Outcome: | The proposed framework shows competitive performance on two ZSRE datasets. |
BiQUE: Biquaternionic Embeddings of Knowledge Graphs (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge graph embeddings rely on geometric operations to model relational patterns such as symmetry and hierarchical semantics. |
| Approach: | They propose a new knowledge graph embedding model that integrates multiple geometric transformations to model multi-relational knowledge graphs. |
| Outcome: | Experiments on five datasets show that BiQUE can model symmetry, inversion, and composition. |
Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are gaining popularity due to their lack of knowledge hallucination and lack of a coherent model. |
| Approach: | They propose a self-supervised quantized representation method to compress KG structural and semantic knowledge into discrete codes that align the format of language sentences. |
| Outcome: | The proposed framework outperforms existing unsupervised methods producing more distinguishable codes on KG link prediction and triple classification tasks. |
WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings (2023.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on seven semantic textual similarity tasks show our method achieves consistent improvement over the contrastive learning baseline and sets new states of the art. |
| Approach: | They propose a whitening-based contrastive learning method for sentence embedding learning which combines contrastive and shuffled group whitening. |
| Outcome: | The proposed method achieves better alignment and uniformity on seven semantic textual similarity tasks. |
SwiftPrune: Hessian-Free Weight Pruning for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a novel post-training pruning method relies on the Hessian matrix to perform pruning . current pruning methods are computationally intensive and lack performance due to second-order derivative calculations. |
| Approach: | They propose a Hessian-free weight pruning method that reduces computational burden . they use an Exponentially Weighted Moving Average technique to bypass weight sorting . |
| Outcome: | The proposed method achieves hardware-efficient model compression by eliminating computational intensive calculations. |
Anchoring Fine-tuning of Sentence Transformer with Semantic Label Information for Efficient Truly Few-shot Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fewshot text classification require substantial computing power and data. |
| Approach: | They propose an efficient method to add task and label information to a sentence transformer model by contrastive learning and a triplet loss to enforce training instances to be closest to their own textual semantic label information. |
| Outcome: | The proposed method achieves strong performance in data-sparse scenarios compared to existing methods across SST-5, Emotion detection, and AG News data even with just two examples per class. |
A Short Survey on Sense-Annotated Corpora (2020.lrec-1)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) is a key task in Natural Language Understanding. |
| Approach: | They propose to use sense-annotated corpora for supervised Word Sense Disambiguation. |
| Outcome: | The proposed methods have been compared with knowledge-based approaches and have shown to be more efficient when they are available. |
Enhancing the Context Representation in Similarity-based Word Sense Disambiguation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing similarity-based systems focus on learning sense embeddings using only the sentence where the word appears, neglecting its global context. |
| Approach: | They propose a contextoriented embedding technique that takes better advantage of both word-level and sense-level global context of an ambiguous word for disambiguation. |
| Outcome: | The proposed method improves on all-words WSD benchmarks in knowledge-based category by large margins. |
VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on VLM bias focus on portrait-style images and gender-occupation associations . existing studies ignore broader and more complex social stereotypes and their implied harm . |
| Approach: | They propose a large-scale VQA benchmark for evaluating bias in vision-language models . they use a question-answering framework that spans factuality, perception, stereotyping, and decision making . |
| Outcome: | The proposed framework examines bias in vision-language models using 30M+ images . findings reveal subtle, multifaceted, and surprising stereotypical patterns . |
Creation of a Balanced State-of-the-Art Multilayer Corpus for NLU (L18-1)
Copied to clipboard
Normunds Gruzitis, Lauma Pretkalnina, Baiba Saulite, Laura Rituma, Gunta Nespore-Berzkalne, Arturs Znotins, Peteris Paikens
| Challenge: | Using full stack of language resources, we are creating a balanced text corpus for Latvian. |
| Approach: | They propose to create a syntactically and semantically annotated multilayered corpus for Latvian . they use widely acknowledged and cross-lingual representations for the corpus . |
| Outcome: | The proposed corpus adopts widely recognized and cross-lingual representations for natural language understanding and generation in Latvian. |
Dual Prompt Tuning based Contrastive Learning for Hierarchical Text Classification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on hierarchy-aware text feature by exploiting explicit parent-child relationships, resulting in label confusion within each layer. |
| Approach: | They propose a dual-prompt tuning method which emphasizes discrimination among peer labels by performing contrastive learning on each hierarchical layer. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and is available on github. |
Efficient Long Context Language Model Retrieval with Compression (2025.acl-long)
Copied to clipboard
| Challenge: | Long Context Language Models (LCLMs) are a new paradigm for Information Retrieval . however, processing large number of passages within in-context for retrieval is computationally expensive . a proposed compression approach for LCLM retrieval maximizes retrieval performance while minimizing the length of the compressed passages. |
| Approach: | They propose a new compression approach tailored to maximize retrieval performance while minimizing the length of compressed passages. |
| Outcome: | The proposed approach maximizes retrieval performance while minimizing the length of compressed passages while reducing the in-context size by 1.91. |
Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on entity vector matching, but the purpose of the question is abstract and difficult to match with specific entities. Existing approaches rely only on entity-vector matching, and there is a problem with multi-hop reasoning. |
| Approach: | They propose a framework that constructs reasoning paths from purposes back to conditions using the KG ontology. |
| Outcome: | Experiments on the WebQSP and CWQ datasets show that ORT significantly improves the capability of large language models in knowledge graph question answering tasks (KGQA). |
Representation Learning with Conditional Information Flow Maximization (2024.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge-theoretic representation learning frameworks are based on the information bottleneck principle, which preserves redundant features irrelevant to the given task. |
| Approach: | They propose a conditional information flow maximization framework to learn sufficient representations for the input data and target task by maximizing both input-representation and representation-label mutual information. |
| Outcome: | The proposed framework can extract noise-invariant sufficient representations for the input data and target task. |
Set Generation Networks for End-to-End Knowledge Base Population (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge base population systems require a machine translation task to generate multiple facts, but the fact order is not considered. |
| Approach: | They propose a knowledge base population task that aims to discover facts about entities from texts and expand a KB with these facts. |
| Outcome: | The proposed networks achieve state-of-the-art (SoTA) performance on two benchmark datasets. |
ChuLo: Chunk-Level Key Information Representation for Long Document Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional approaches to truncate inputs, sparse self-attention, and chunking often lead to information loss and hinder the model’s ability to capture long-range dependencies. |
| Approach: | They propose a novel chunk representation method that uses unsupervised keyphrase extraction to group input tokens to retain core document content while reducing input length. |
| Outcome: | The proposed method minimizes information loss and improves the efficiency of Transformer-based models. |
Human-Inspired Obfuscation for Model Unlearning: Local and Global Strategies with Hyperbolic Representations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for unlearning large language models struggle to balance effective forgetting with maintaining model utility. |
| Approach: | They propose a human-inspired unlearning framework that simulates forgetting on fuzzy data and represents them in hyperbolic and Euclidean spaces. |
| Outcome: | The proposed framework is able to forget sensitive content while maintaining the model’s language understanding, fluency, and benchmark performance. |
On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Incorporating contrastive learning objectives in sentence representation learning has yielded significant improvements on many sentence-level NLP tasks. |
| Approach: | They aim to examine why contrastive learning works for learning sentence-level semantics . they interpret successes through the geometry of the representation shifts based on isotropy . |
| Outcome: | The proposed model improves on many sentence-level NLP tasks, but it is not well understood why it works. |
Unified Representation for Non-compositional and Compositional Expressions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing representations of non-compositional language are based on BART, but they are not as accurate as the state-of-the-art IE representation model, GIEA. |
| Approach: | They propose a language model, PIER+, that builds on BART and can generate semantically meaningful and contextually appropriate representations for English potentially idiomatic expressions. |
| Outcome: | The proposed model achieves 33% higher homogeneity score on embedding clustering than BART, while sacrificing performance on NLU tasks (+/- 1% accuracy) |
Nunchi-Bench: Benchmarking Language Models on Cultural Reasoning with a Focus on Korean Superstition (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing research has evaluated large language models' cultural knowledge and contextual understanding, reducing their effectiveness in multicultural settings. |
| Approach: | They propose a benchmark to evaluate LLMs' cultural understanding with a focus on Korean superstitions. |
| Outcome: | The proposed benchmark assesses multilingual LLMs in Korean and English to analyze their ability to reason about Korean cultural contexts and how language variations affect performance. |
Updating Large Language Models’ Memories with Time Constraints (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) can modify their internal memory by incorporating the latest external knowledge, but in practical applications, outdated information may be inputted into LLMs. |
| Approach: | They propose a two-stage decoupling framework that separates the identification and computation of time constraints into a symbolic system and propose 'selective update' of internal memory based on time constraints. |
| Outcome: | The proposed framework improves ChatGPT performance by 60% and improves state-of-the-art LLM GPT-4. |
RaDA: Retrieval-augmented Web Agent Planning with LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Agents powered by large language models inherit important limitations such as the restricted context length, dependency on human-engineered exemplars, and insufficient generalization. |
| Approach: | They propose a novel planning method for Web agents that disentangles planning into two stages: for a new given task, it decomposes tasks into high-level subtasks; and then iteratively synthesizes actions based on dynamically retrieved exemplars. |
| Outcome: | The proposed method decomposes tasks into high-level subtasks and iteratively synthesizes actions based on dynamically retrieved exemplars. |
Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem? (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal large language models have shown remarkable performance for cross-modal understanding and generation, yet suffer from severe inference costs. |
| Approach: | They propose to prune redundant tokens in MLLMs to reduce computation and storage costs. |
| Outcome: | The proposed method reduces the computational and storage costs of MLLMs by identifying redundant tokens and pruning them. |
OOP: Object-Oriented Programming Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | None Large language models (LLMs) are emerging as a key tool for automated programming. |
| Approach: | They compare performance of None Large language models with language understanding models on functional programming and object-oriented programming benchmarks. |
| Outcome: | The models perform relatively well on functional programming (FP) and object-oriented programming (OOP) benchmarks, while exhibiting poor performance on OOP benchmarks. |
Compositional Generalization without Trees using Multiset Tagging and Latent Permutations (2023.acl-long)
Copied to clipboard
| Challenge: | Seq2seq models struggle with compositional generalization in semantic parsing, i.e. generalizing to unseen compositions or deeper recursion of phenomena that the model handles correctly in isolation. |
| Approach: | They propose a new way of parameterizing and predicting permutations by combining input tokens with multisets of output tokens and a method to backpropagate through the solver. |
| Outcome: | The proposed model outperforms pretrained models and prior work on realistic semantic parsing tasks that require generalization to longer examples. |
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) have shown effectiveness in literature understanding tasks, especially when tuned via contrastive learning. |
| Approach: | They propose a multi-task contrastive learning framework that enables common knowledge sharing across different scientific literature understanding tasks while preventing task-specific skills from interfering with each other. |
| Outcome: | The proposed framework outperforms state-of-the-art pre-trained language models on a comprehensive dataset. |
How Do Multilingual Language Models Remember Facts? (2025.findings-acl)
Copied to clipboard
| Challenge: | Prior research has focused on English monolingual models, but how these mechanisms generalize to non-English languages remains unexplored. |
| Approach: | They analyze three multilingual LLMs to find out how they can generalize recall mechanisms . they find that subject enrichment is language-independent, object extraction is language dependent . |
| Outcome: | The proposed model performs better in multilingual contexts than in English models . the model is more efficient in multi-lingual context, but it is more complex in multilinguistic models compared to English models. |
FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual models have been released, but many of the world's languages are not covered. |
| Approach: | They propose a method that initializes the embedding matrix for a new tokenizer based on information in the source model's embeddable matrix. |
| Outcome: | The proposed method outperforms random initialization and previous work on language modeling and on a range of downstream tasks (NLI, QA, and NER). |
Semantic Aware Linear Transfer by Recycling Pre-trained Language Models for Cross-lingual Transfer (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly incorporating multilingual capabilities, fueling the demand to transfer them into target language-specific models. |
| Approach: | They propose a novel cross-lingual transfer technique that recycles embeddings from target language Pre-trained Language Models to transmit deep representational strengths to LLMs. |
| Outcome: | The proposed technique outperforms existing methods in cross-lingual understanding setups and achieves faster convergence and lower loss during language adaptation. |
Ling-CL: Understanding NLP Models through Linguistic Curricula (2023.emnlp-main)
Copied to clipboard
| Challenge: | linguistic complexity is a key component of learning in NLP, according to a new study . linguistic complex is based on lexical diversity, word sophistication, and readability . |
| Approach: | They employ a characterization of linguistic complexity from psycholinguistic and language acquisition research to develop data-driven curricula. |
| Outcome: | The proposed approach will inform future research in all NLP areas . it uses linguistic metrics (indices) that inform the challenges and reasoning required to address each task . |
A Large and Balanced Corpus for Fine-grained Arabic Readability Assessment (2025.findings-acl)
Copied to clipboard
| Challenge: | Texts above a student's readability level can lead to disengagement and disengagement . Developing readability models is crucial for improving literacy, language learning, and academic performance. |
| Approach: | They introduce the Balanced Arabic Readability Evaluation Corpus (BAREC) a large-scale, fine-grained dataset for Arabic readability assessment. |
| Outcome: | The proposed model outperforms existing methods in Arabic readability assessment. |
HyperMixer: An MLP-based Low Cost Alternative to Transformers (2023.acl-long)
Copied to clipboard
Florian Mai, Arnaud Pannatier, Fabio Fehr, Haolin Chen, Francois Marelli, Francois Fleuret, James Henderson
| Challenge: | Existing MLP-based architectures that combine multiple features are expensive and require a lot of training data. |
| Approach: | They propose a simple MLP-based model which allows token mixing by dynamically applying hypernetworks to each feature independently. |
| Outcome: | The proposed model performs better than Transformers and lowers costs in terms of processing time, training data, and hyperparameter tuning. |
DP-BART for Privatized Text Rewriting under Local Differential Privacy (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems that guarantee privacy protection to individuals face several problems, such as formal mathematical flaws, unrealistic privacy guarantees, and privatization of only individual words. |
| Approach: | They propose a system that enables sharing of sensitive textual documents while formally guaranteeing privacy protection to individuals. |
| Outcome: | The proposed system outperforms existing LDP systems in terms of noise and privacy guarantees. |
IEKG: A Commonsense Knowledge Graph for Idiomatic Expressions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on IE comprehension has focused on detecting idiomaticity, but this fails to account for IEs' non-compositionality. |
| Approach: | They construct a commonsense knowledge graph for figurative interpretations of IEs that can be used to convert PTLMs into knowledge models that encode and infer commonsensical knowledge related to IE use. |
| Outcome: | The proposed model can generalize to IEs unseen during training. |
Talking the Talk Does Not Entail Walking the Walk: On the Limits of Large Language Models in Lexical Entailment Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Verbs are crucial for expressing actions and relationships between entities, making it essential to properly capture their nuances. |
| Approach: | They propose to use prompting strategies and zero-shot prompting to recognize entailment relations among verbs from two lexical databases, WordNet and HyperLex. |
| Outcome: | The proposed models can tackle the lexical entailment recognition task with moderately good performance, although at varying degree of effectiveness and under different conditions. |
Systematic Assessment of Factual Knowledge in Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question-answering benchmarks for large language models have limitations regarding factual knowledge coverage, as they focus on generic domains and overlap with pretraining data. |
| Approach: | They propose a framework to assess the factual knowledge of large language models by leveraging knowledge graphs. |
| Outcome: | The proposed framework generates questions and expected answers from the facts stored in a given knowledge graph and evaluates them with KGs in generic and specific domains. |
Lemmatisation of Medieval Greek: Against the Limits of Transformer’s Capabilities? (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing lemmatisation algorithms display an accuracy drop of around 30pp when tested on unedited, Byzantine Greek epigrams. |
| Approach: | They propose to use transformer-based embeddings and a dictionary look-up to lemmatise unedited, Byzantine Greek epigrams. |
| Outcome: | The proposed method outperforms existing methods and provides detailed error analysis revealing why unedited, Byzantine Greek is so challenging for lemmatisation. |
Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are proficient in natural language processing tasks, but their deployment is limited by extensive parameter sizes and computational demands. |
| Approach: | They propose a method to enhance computational efficiency in large language models by 4-bit weight and 8-bit activation quantization. |
| Outcome: | The proposed techniques significantly boost task accuracies to levels comparable with full-precision models. |
Failures are Treasures: Constructing a Pedagogical Bridge for Agentic Strategy Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods focus on imitating successful trajectories, whereas small language models are fragile and often collapsing after encountering errors. |
| Approach: | They propose a Pedagogical Bridge for Reflective Insight and Distillation of Guiding Errors that combines reflection-in-action and reflection-on-action to enable agents to diagnose and correct critical errors while abstracting transferable strategies from contrastive student–teacher trajectories. |
| Outcome: | Experiments show that the proposed model significantly elevates performance in large language models (SLMs) . |
ToolGrad: Efficient Tool-use Dataset Generation with Textual “Gradients” (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work synthesizes tool-use LLM datasets by first generating a user query, then complex tool-using annotations like DFS. |
| Approach: | They propose an agentic framework that synthesizes user queries and generates valid tool-use chains . they propose a dataset with more complex tool use, lower cost, and almost 100% pass rate . |
| Outcome: | Experiments show that tools trained on ToolGrad outperform expensive baseline datasets and proprietary LLMs. |
USB: A COMPREHENSIVE AND UNIFIED SAFETY EVALUATION BENCHMARK FOR MULTIMODAL LARGE LANGUAGE MODELS (2026.acl-long)
Copied to clipboard
Baolin Zheng, Guanlin Chen, Qingyang Teng, Hongqiong Zhong, Yingshui Tan, Zhendong Liu, Weixun Wang, Jiaheng Liu, Jian Yang, Huiyun Jing, Jincheng Wei, Wenbo Su, Xiaoyong Zhu, Bo Zheng, Kaifu Zhang
| Challenge: | Existing safety benchmarks fail to provide reliable assessments due to limited risk coverage, insufficient scale and the oversight of complex modality combinations. |
| Approach: | They propose a framework that covers 61 risk categories across four modality interactions to address this gap. |
| Outcome: | The proposed framework covers 61 risk categories across four distinct modality interactions. |
Generation-Augmented Retrieval: Rethinking the Role of Large Language Models in Zero-Shot Relation Extraction (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in Relation Extraction (RE) emphasize Zero-Shot methodologies, aiming to recognize unseen relations between entities with no annotated data. |
| Approach: | They propose a plug-in retrieval adjuster that allows rapid fine-tuning without accessing LLMs’ parameters. |
| Outcome: | The proposed model demonstrates comparable performance on multiple benchmarks. |
MASS: Deep Research for Social Sciences with Memory-Augmented Social Simulation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems rely heavily on literature retrieval and synthesis, resulting research lacking insight and creativity in social science. |
| Approach: | They propose a method that leverages highly realistic social simulations to the creativity of LLMs-generated research. |
| Outcome: | The proposed model shows a 6.81% improvement in quality over foundation LLMs and 17.19% gain in Insight over strong baselines. |
MAGIC: Deep Geometric Evolution with Structural Consensus for Temporal Knowledge Graph Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multi-geometry approaches face two key bottlenecks: Riemannian depth barrier and gate collapse. |
| Approach: | They propose a framework for Temporal Knowledge Graph reasoning that integrates a Tangent-Residual Engine into multi-geometric spaces to regulate gradient flow and prevent collapse. |
| Outcome: | The proposed framework improves state-of-the-art in TKG reasoning by up to 2.9 points. |
Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale language models with millions, billions, or trillions of trainable parameters are becoming increasingly popular. |
| Approach: | They compare performance of financial BERT-like models to their fully fine-tuned counterparts by using parameter-efficient tuning methods. |
| Outcome: | The proposed approaches match full fine-tuning performance on common NLP tasks, but are less studied in finance. |
Assessing French Readability for Adults with Low Literacy: A Global and Local Perspective (2025.emnlp-main)
Copied to clipboard
| Challenge: | illiterate individuals are persons aged 15 years and above who cannot read and write with understanding a short simple statement on their everyday life. |
| Approach: | They propose a novel approach to assess french text readability for adults with low literacy skills using a global and segment-level difficulty scale. |
| Outcome: | The proposed approach addresses both global (full-text) and local (segment-level) difficulty scales. |
Multimodal Language Models Show Evidence of Embodied Simulation (2024.lrec-main)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) are gaining popularity as partial solutions to the “symbol grounding problem” faced by language models trained on text alone. |
| Approach: | They propose to use multimodal large language models to integrate linguistic representations with data from other modalities to investigate whether they are integrated into a model. |
| Outcome: | The proposed models are sensitive to visual features like object shape when it is implied by a verbal description of an event. |
Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for zero-shot learning are sparse, but have been used for dense retrieval (DR) . |
| Approach: | They propose a novel Universal Document Linking algorithm which links similar documents to enhance synthetic query generation across multiple datasets with different characteristics. |
| Outcome: | The proposed algorithm surpasses state-of-the-art methods in zero-shot cases. |
Out-of-Context Reasoning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a lightweight technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
| Approach: | They propose a lightweight technique that trains only new token embeddings on axioms . they train only new embeddables and evaluate them on unseen tasks . |
| Outcome: | The proposed technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
A Mutual Information Perspective on Knowledge Graph Embedding (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding techniques suffer from high intra-group similarity, loss of semantic information, and insufficient inference capability, particularly in complex relation patterns such as 1-N and N-1 relations. |
| Approach: | They propose a knowledge graph embedding framework that leverages mutual information maximization to improve the semantic representation of entities and relations. |
| Outcome: | Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed method, with consistent performance improvements across various baseline models. |
WhiSPA: Semantically and Psychologically Aligned Whisper with Self-Supervised Contrastive and Student-Teacher Learning (2025.acl-long)
Copied to clipboard
Rajath Rao, Adithya V Ganesan, Oscar Kjell, Jonah Luby, Akshay Raghavan, Scott M. Feltman, Whitney Ringwald, Ryan L. Boyd, Benjamin J. Luft, Camilo J. Ruggero, Neville Ryant, Roman Kotov, H. Schwartz
| Challenge: | Current speech encoding pipelines rely on an additional text-based LM to get robust representations of human communication, even though speech-to-text models often have a LM within. |
| Approach: | They propose to align Whisper's latent space with semantic representations from a text autoencoder and lexically derived embeddings of basic psychological dimensions: emotion and personality. |
| Outcome: | The proposed approach surpasses current speech encoders over self-supervised affective tasks and downstream psychological tasks, achieving an error reduction of 73.4% and 83.8%, respectively. |
Beyond Function-Level Search: Repository-Aware Dual-Encoder Code Retrieval with Adversarial Verification (2025.findings-emnlp)
Copied to clipboard
| Challenge: | escalating complexity of modern codebases has intensified the need for code retrieval systems capable of interpreting cross-component change intents. |
| Approach: | RepoAlignBench is a benchmark designed to evaluate repository-level code retrieval . the benchmark proposes an adversarial reflection-augmented dual-tower architecture . |
| Outcome: | The proposed framework achieves 12.2% Top-5 Accuracy and 7.1% Recall improvements over state-of-the-art benchmarks. |
Prediction Hubs are Context-Informed Frequent Tokens in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Hubness is a tendency for a few points to be among the nearest neighbours of a disproportionate number of other points. |
| Approach: | They show that only large-scale representation comparisons are not characterized by hubness . they show that hubs are the result of context-modulated frequent tokens . |
| Outcome: | The results show that the comparison between context and unembedding vectors does not result in hubness . the findings suggest that hubness is not a negative property that needs to be mitigated when LLMs are being used for next token prediction. |
Capability Salience Vector: Fine-grained Alignment of Loss and Capabilities for Downstream Task Scaling Law (2025.acl-long)
Copied to clipboard
Qiming Ge, Shuhao Xing, Songyang Gao, Yunhua Zhou, Yicheng Zou, Songyang Zhang, Zhi Chen, Hang Yan, Qi Zhang, Qipeng Guo, Kai Chen
| Challenge: | Large language models have demonstrated impressive performance across a wide range of tasks, but this achievement comes with the trade-off of significant computational demands. |
| Approach: | They propose a scaling law that decomposes the overall validation loss and assigns different importance weights to tokens to assess a specific meta-capability. |
| Outcome: | The proposed model can predict the loss trending of models across different levels of computation without a gap between validation loss and model's downstream capabilities. |
DIESEL: A Lightweight Inference-Time Safety Enhancement for Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models generate outputs that are not aligned with human values, such as toxic content, malicious use cases, and vulnerabilities to adversarial jailbreak attacks. |
| Approach: | They propose a lightweight inference-guidance technique that can be seamlessly integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
| Outcome: | The proposed technique can be integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
Do We Know What LLMs Don’t Know? A Study of Consistency in Knowledge Probing (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for probing knowledge gaps in large language models are inconsistent and inconsistent. |
| Approach: | They propose a process based on input variations and quantitative metrics to evaluate probing methods that are inconsistent on knowledge gaps. |
| Outcome: | The proposed process exposes two dimensions of inconsistency in knowledge gap probing. |
ICL CIPHERS: Quantifying ”Learning” in In-Context Learning via Substitution Ciphers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies suggest that In-Context Learning operates in dual modes . however, disentangling these modes remains a challenging goal . |
| Approach: | They propose a class of task reformulations based on substitution ciphers borrowed from classic cryptography. |
| Outcome: | The proposed model can solve tasks with a BIJECTIVE mapping, but it requires 'deciphering' the latent cipher. |
Speech Analysis of Language Varieties in Italy (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in self-supervised learning provide new opportunities to analyze Italy’s linguistic varieties using speech data alone. |
| Approach: | They propose to automatically identify the geographic region of origin of speech samples drawn from Italy's diverse language varieties. |
| Outcome: | The proposed model can identify regions from speech recording and improve classification accuracy and yields embeddings that distinctly separate regional varieties. |
Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work showed limited success in probing numeric values from models’ representations, indicating that these errors can be attributed to the inherent unreliability of distributionally learned embeddings in representing exact quantities. |
| Approach: | They propose a probing technique that decodes numeric values from input embeddings with near-perfect accuracy across a range of open-source LMs. |
| Outcome: | The proposed probing technique decodes numeric values from input embeddings with near-perfect accuracy across a range of open-source LMs. |
DraDDP: A Multimodal Multi-Party Dialogue Discourse Parsing Dataset (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on multi-party dialogue discourse parsing focus on textual modality and two-party dialog . et al., 2016) focused on text-based discourse parses, ignoring the complexity and richness of multimodal interactions in real-world scenarios. |
| Approach: | They construct the first publicly available English multimodal dataset for multi-party dialogue discourse parsing based on American TV dramas. |
| Outcome: | The proposed dataset contains 495 dialogue segments with 6,374 utterances and 9.1 hours of parallel video content, covering rich multi-party interaction scenarios. |
Temporal Knowledge Graph Reasoning with Dynamic Hypergraph Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models that model temporal dynamics with knowledge graphs and graph convolution networks lack high-order interactions between objects in TKG, which is an important factor to predict future facts. |
| Approach: | They propose to embed temporal knowledge graph reasoning by constructing hypergraphs based on temporal information graphs at different timestamps and then adapt dynamic meta-embedding to fit TKG. |
| Outcome: | The proposed method outperforms baseline models on public TKG datasets and provides good interpretation for the predicted results. |
Length-Induced Embedding Collapse in PLM-based Models (2025.acl-long)
Copied to clipboard
| Challenge: | In text embeddings from PLMs are essential for many NLP applications, but performance degrades on longer texts. |
| Approach: | They propose a method which mitigates the phenomenon of Length Collapse . they propose TempScale to ensure more consistent embeddings across different text lengths . |
| Outcome: | The proposed method improves performance on MTEB and LongEmbed by 0.94% on short and 1.10% on long texts. |
Towards Algorithmic Fidelity: Mental Health Representation across Demographics in Synthetic vs. Human-generated Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Synthetic data generation has the potential to impact domains with scarce data, but we need to understand how different demographics are represented in it. |
| Approach: | They develop a procedure to generate depression data using GPT-3 and analyze it to uncover the types of stressors it assigns to demographic groups. |
| Outcome: | The proposed procedure produces depression data using GPT-3, and compares it to a human-generated dataset. |
LinguaLens: Towards Interpreting Linguistic Mechanisms of Large Language Models via Sparse Auto-Encoder (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior research on linguistic mechanisms of large language models is limited by coarse granularity, limited analysis scale, and narrow focus. |
| Approach: | They propose a framework for analyzing the linguistic mechanisms of large language models based on Sparse Auto-Encoders. |
| Outcome: | The proposed framework extracts Chinese and English linguistic features across four dimensions . it uncovers intrinsic representations of linguistic knowledge in LLMs and can control outputs . |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
L2Dir: Integrating L_2-Norm and Directional Alignment for Unsupervised Contrastive Representation Learning in Multimodal Retrieval (2026.acl-long)
Copied to clipboard
Tianyu Zong, Rui Dai, Hongzhu Yi, Yuanxiang Wang, Zhenghao Zhang, Zhenyu Guan, Yujia Yang, Bingkang Shi, Yueyang Ding, Xiangxiang Chu, Kaikui Liu, Jungang Xu
| Challenge: | Existing approaches to multimodal representation learning focus on directional alignment and embedding magnitudes (L2-norm) however, these methods often fail to account for the intrinsic role of L2-norm in the contrastive process. |
| Approach: | They propose a plug-and-play framework that optimizes L2-norm alignment and Directional consistency jointly. |
| Outcome: | The proposed framework achieves consistent and significant performance gains over established baselines across 95 tasks using UniIR and VLM2Vec-V2 frameworks. |
All Roads Lead to Rome: Graph-Based Confidence Estimation for Large Language Model Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for confidence estimation are primarily designed for factual QA tasks and fail to generalize to reasoning tasks. |
| Approach: | They propose a set of training-free, graph-based confidence estimation methods tailored to reasoning tasks that exploit graph properties such as centrality, path convergence, and path weighting. |
| Outcome: | The proposed methods improve confidence estimation and performance on two downstream tasks. |
SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical prompts. |
| Approach: | They propose a lightweight framework that restores safety while maintaining downstream performance. |
| Outcome: | The proposed framework reduces harmful outputs compared to other defenses, with negligible impact on utility. |
Evolving Beyond Snapshots: Harmonizing Structure and Sequence via Entity State Tuning for Temporal Knowledge Graph Forecasting (2026.acl-long)
Copied to clipboard
| Challenge: | Temporal knowledge graphs (TKGs) require predicting future facts by modeling structural dependencies within each snapshot and temporal evolution across snapshots. |
| Approach: | They propose an encoder-agnostic framework that provides persistent entity states . EST maintains a global state buffer and aligns structural evidence with sequential signals . |
| Outcome: | Experiments show that EST improves diverse backbones and achieves state-of-the-art performance. |
Evaluating Large Language Models for Detecting Antisemitism (2025.emnlp-main)
Copied to clipboard
| Challenge: | Detecting hateful content is a challenging and important problem, but it requires continuous training to adapt to the ever-changing landscape of social media. |
| Approach: | They evaluate eight open-source LLMs’ capability to detect antisemitic content . they use in-context definition as a policy guideline to explore different prompts . |
| Outcome: | The proposed model outperforms the fine-tuned model with Guided-CoT . |