Papers with LLM-based
Formal Semantic Controls over Language Models (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | Text embeddings provide a concise representation of the semantics of sentences and larger spans of text, rather than individual words, capturing a wide range of linguistic features. |
| Approach: | They propose to shorten the gap between latent semantics and formal symbolics by comparing distributional models to symbolic models grounded on formal linguistics and well-defined mathematical properties. |
| Outcome: | This paper examines the analysis and control of text representations, covering methods from pooling to LLM-based. |
JuStRank: Benchmarking LLM Judges for System Ranking (2025.acl-long)
Copied to clipboard
| Challenge: | Recent work has focused on instance-based evaluation of LLM judges, where a judge is evaluated over a set of responses, or response pairs, while being agnostic to their source systems. |
| Approach: | They propose to validate the quality of the LLM judge itself by comparing system scores to a human-based ranking. |
| Outcome: | The proposed model fails to validate the quality of the judge itself, ignoring critical factors affecting system-level ranking, such as a judge’s positive or negative bias towards certain systems. |
MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing (2026.acl-demo)
Copied to clipboard
| Challenge: | Large language model-based multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration. |
| Approach: | They propose a graph-centric framework for orchestrating large language model-based multi-agent systems . they compile a user's natural-language intent into an editable workflow specification and then into an executable graph . |
| Outcome: | The proposed framework compiles natural-language intent into an executable graph and then compile and executes it at runtime. |
Thesis Proposal: A Multi-Agent System for Ontology-Based Perspective-Aware Knowledge Extraction (2026.eacl-srw)
Copied to clipboard
| Challenge: | Current AI systems consolidate multiple perspectives into singular, decontextualized schemas, introducing representational bias and information loss. |
| Approach: | They propose a framework to operationalize perspective-aware knowledge extraction using ontologies and Large Language Models. |
| Outcome: | The proposed framework can operationalize perspective-aware knowledge extraction without representational bias and information loss. |
Leveraging the Power of Large Language Models in Entity Linking via Adaptive Routing and Targeted Reasoning (2025.emnlp-industry)
Copied to clipboard
Yajie Li, Albert Galimov, Mitra Datta Ganapaneni, Pujitha Thejaswi, De Meng, Priyanshu Kumar, Saloni Potdar
| Challenge: | Entity Linking (EL) relies on large labeled datasets and extensive fine-tuning . lexical ambiguity, knowledge-intensive cases and low-context mentions are some of the challenges. |
| Approach: | Entity Linking (EL) relies on large annotated datasets and extensive fine-tuning . authors propose a pipeline that integrates candidate generation, context-based scoring, adaptive routing, and selective reasoning . |
| Outcome: | ARTER outperforms ReFinED and LLM-based pipelines on standard benchmarks . it performs twice as efficiently on 5 out of 6 datasets and doubles the number of tokens compared to pipelines using LLM . |
A Large-Scale Real-World Evaluation of an LLM-Based Virtual Teaching Assistant (2025.acl-industry)
Copied to clipboard
| Challenge: | Empirical studies on their effectiveness and acceptance in real-world classrooms are limited, leaving their practical impact uncertain. |
| Approach: | They develop an LLM-based virtual teaching assistant and deploy it in an introductory AI programming course with 477 graduate students. |
| Outcome: | The proposed system is tested in an introductory AI programming course with 477 graduate students. |
MathBuddy: A Multimodal System for Affective Math Tutoring (2025.emnlp-demos)
Copied to clipboard
Debanjana Kar, Leopold Böss, Dacia Braca, Sebastian Maximilian Dennerlein, Nina Christine Hubig, Philipp Wintersberger, Yufang Hou
| Challenge: | Existing LLM-based conversational systems do not take into account the student’s affective states. |
| Approach: | They propose an emotionally aware LLM-powered math tutor that models student emotions and maps them to relevant pedagogical strategies. |
| Outcome: | The proposed model improves student engagement and learning effectiveness by 23 points using win rate and 3 points at an overall level using DAMR scores. |
LIP-NER: Literal Patterns Benefit LLM-Based NER (2025.acl-srw)
Copied to clipboard
| Challenge: | Existing methods for Named Entity Recognition (NER) use semantic information, but it is non-trivial to obtain literal patterns written in natural language. |
| Approach: | They propose an LLM-based NER framework that utilizes Literal Patterns to acquire literal patterns in natural language. |
| Outcome: | The proposed framework reduces human labor and provides a more efficient way to acquire literal patterns. |
LLM-based Conversational Recommendation Agents with Collaborative Verbalized Experience (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive zero-shot capabilities in conversational recommender systems (CRS). |
| Approach: | They propose LLM-based CRS-based LLMs with Collaborative Verbalized Experience to enhance historical conversations by sampling trajectories of LLM agents on historical queries and establishing verbalized experience banks . |
| Outcome: | The proposed system improves on existing approaches to enhancing historical conversations by leveraging trajectories and verbalized experiences from LLMs on historical queries and user feedback. |
AMAS: Adaptively Determining Communication Topology for LLM-based Multi-agent System (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized natural language processing, but their practical implementation as autonomous multi-agent systems remains fraught with unresolved challenges. |
| Approach: | They propose a dynamic graph selector that redefines LLM-based MAS by exploiting the intrinsic properties of individual inputs to intelligently direct query trajectories. |
| Outcome: | The proposed framework exceeds state-of-the-art approaches in question answering, mathematical deduction, and code generation benchmarks. |
An Efficient Gloss-Free Sign Language Translation Using Spatial Configurations and Motion Dynamics with LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for sign language translation rely on glosses, which are written representations of signs. |
| Approach: | They propose a new LLM-based SLT framework that uses off-the-shelf visual encoders to extract spatial and motion features from sign videos. |
| Outcome: | The proposed framework captures spatial configurations and motion dynamics in sign language without domain-specific tuning. |
MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown the effectiveness of knowledge distillation in DPR, but there is a performance gap between the teacher and the distilled student. |
| Approach: | They propose an iterative knowledge distillation method which transfers knowledge from teacher to student with help of multiple assistants in an iterated manner. |
| Outcome: | The proposed method achieves state-of-the-art performance among models with same parameters on multiple datasets and is competitive when compared with larger models. |
SyllabusQA: A Course Logistics Question Answering Dataset (2024.acl-long)
Copied to clipboard
| Challenge: | We introduce Fact-QA, an LLM-based evaluation metric to evaluate the factuality of predicted answers. |
| Approach: | They propose to use an open-source dataset to analyze logistics-related question-answer pairs in a logistics-based course. |
| Outcome: | The proposed approach performs close to humans on traditional metrics of textual similarity, but there is a significant gap between them and humans in terms of fact precision. |
Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as powerful tools for a wide range of tasks, from * Equal Contribution. |
| Approach: | They propose a framework that enhances communication efficiency and task effectiveness in LLM-based multi-agent systems through training. |
| Outcome: | The proposed framework improves communication efficiency and task effectiveness on multi-agent tasks with 2.8x performance gain with less than 10% tokens on tasks requiring heavy information exchange. |
Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies (2026.findings-acl)
Copied to clipboard
| Challenge: | Simultaneous machine translation requires high-quality translations under strict real-time constraints. |
| Approach: | They extend the action space of simultaneous machine translation with four adaptive actions . they adapt these actions in a large language model framework and construct training references . |
| Outcome: | The proposed framework improves semantic metrics and achieves lower delay compared to reference translations and salami-based baselines. |
IL-TUR: Benchmark for Indian Legal Text Understanding and Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Legal systems worldwide struggle with exponentially growing legal cases in various courts. |
| Approach: | They propose a benchmark for Indian legal text understanding and reasoning task that includes domain-specific tasks that address different aspects of the legal system. |
| Outcome: | The proposed benchmark for Indian legal text understanding and reasoning aims to address the gap between models and the ground truth. |
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)
Copied to clipboard
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley
| Challenge: | Large Language Models (LLMs) have been used for selection and training of data for active learning. |
| Approach: | They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop. |
| Outcome: | The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances. |
Toward In-Context Teaching: Adapting Examples to Students’ Misconceptions (2024.acl-long)
Copied to clipboard
| Challenge: | Using computational models as pedagogical tools is becoming increasingly popular, but how effective can these models adapt as teachers to students of different types? |
| Approach: | They propose a suite of models and evaluation methods that combine Bayesian student models and AToM to evaluate adaptive teaching methods. |
| Outcome: | The proposed models outperform LLM-based and standard Bayesian teaching methods in the evaluation of simulated students across three learning domains. |
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning (2023.findings-emnlp)
Copied to clipboard
Duarte Alves, Nuno Guerreiro, João Alves, José Pombal, Ricardo Rei, José de Souza, Pierre Colombo, Andre Martins
| Challenge: | Large language models (LLMs) are a promising avenue for machine translation (MT) however, their effectiveness depends on the choice of few-shot examples and they often require extra post-processing due to overgeneration. |
| Approach: | They propose a method that incorporates few-shot examples during finetuning to improve performance on MT tasks. |
| Outcome: | The proposed method outperforms few-shot prompting while eliminating the need for in-context examples. |
DeMAC: Enhancing Multi-Agent Coordination with Dynamic DAG and Manager-Player Feedback (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) powered by large language models struggle to adapt to evolving task dependencies and to handle uncertainties. |
| Approach: | They propose a Dynamic Environment-Aware Manager-Player Agents Coordination framework that enhances multi-agent coordination through long-term strategic planning. |
| Outcome: | The proposed framework outperforms traditional reinforcement learning and human-agent collaboration in the Overcooked simulation. |
The Hidden Strength of Disagreement: Unraveling the Consensus-Diversity Tradeoff in Adaptive Multi-Agent Systems (2025.emnlp-main)
Copied to clipboard
| Challenge: | Conventional LLM-based MAS rely on explicit coordination, e.g., prompts or voting, risking premature homogenization. |
| Approach: | They propose to preserve partial diversity by combining in-context learning with explicit coordination to form consensus in dynamic environments. |
| Outcome: | The proposed model outperforms explicit consensus models on three scenarios showing that partial deviation from group norms boosts exploration, robustness, and performance. |
Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Social media has become a fertile ground for nurturing rumors and misinformation due to its lack of systematic moderation. |
| Approach: | They propose a framework to enhance the joint predictive capabilities of LLMs for stance detection and rumor verification tasks. |
| Outcome: | The proposed framework outperforms state-of-the-art methods and generalizes to non-LLMs accommodated as task models. |
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)
Copied to clipboard
Hanjun Luo, Yingbin Jin, Yiran Wang, Xinfeng Li, Tong Shang, Xuecheng Liu, Ruizhe Chen, Kun Wang, Hanan Salam, Qingsong Wen, Zuozhu Liu
| Challenge: | Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs. |
| Approach: | They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods. |
| Outcome: | The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains. |
In the LLM era, Word Sense Induction remains unsolved (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing word sense induction methods rely on predefined sense inventories of arbitrary granularity and require labor intensive sense-annotated data. |
| Approach: | They propose to evaluate an LLM-based word sense induction method for English . they use data augmentation sources, corpus and lexicon, and semi-supervised scenarios to augment the data. |
| Outcome: | The proposed method surpasses the previous SOTA system on a English set by 3.3%. |
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models (2024.emnlp-main)
Copied to clipboard
Haiquan Zhao, Lingyu Li, Shisong Chen, Shuqi Kong, Jiaan Wang, Kexin Huang, Tianle Gu, Yixu Wang, Jian Wang, Liang Dandan, Zhixu Li, Yan Teng, Yanghua Xiao, Yingchun Wang
| Challenge: | Emotion Support Conversation (ESC) is a crucial application for reducing stress and providing emotional guidance. |
| Approach: | They re-organize 2,801 role-playing cards to define roles of role-players . they train a specific role- playing model called ESC-Role which behaves more like a confused person than GPT-4 . |
| Outcome: | The proposed model behaves more like a confused person than GPT-4, and the model performs better than GPLs. |
Semantic Component Analysis: Introducing Multi-Topic Distributions to Clustering-Based Topic Modeling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for topic modeling fail to scale to large datasets or assume one topic per document. |
| Approach: | They propose a topic modeling technique that discovers multiple topics per sample . they evaluate SCA on Twitter datasets in English, Hausa and Chinese . |
| Outcome: | The proposed technique outperforms the LLM-based TopicGPT on Twitter datasets with similar compute budgets. |
Generation-Augmented Retrieval: Rethinking the Role of Large Language Models in Zero-Shot Relation Extraction (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in Relation Extraction (RE) emphasize Zero-Shot methodologies, aiming to recognize unseen relations between entities with no annotated data. |
| Approach: | They propose a plug-in retrieval adjuster that allows rapid fine-tuning without accessing LLMs’ parameters. |
| Outcome: | The proposed model demonstrates comparable performance on multiple benchmarks. |
LinguaGame: A Linguistically Grounded Game-Theoretic Paradigm for Multi-Agent Dialogue Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have enabled Multi-Agent Systems (MASs) where agents interact through natural language to solve complex tasks or simulate multi-party dialogues. |
| Approach: | They propose a linguistically-grounded game-theoretic paradigm for multi-agent dialogue generation that uses a training-free equilibrium approximation algorithm to model dialogue over communicative intents and strategies. |
| Outcome: | The proposed framework improves agents’ communication efficiency by helping them convey their intended meaning more effectively through language. |
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers (2026.acl-long)
Copied to clipboard
| Challenge: | External Human-Machine Interfaces (eHMIs) are emerging as promising solutions to address this communication gap. |
| Approach: | They propose a framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. |
| Outcome: | The proposed framework outperforms prompt-only LLM designers and manually specified baselines in three eHMI modalities and multiple LLM model sizes. |
Comparing Human and Large Language Model Interpretation of Implicit Information (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a popular approach for generating text indistinguishable from human-generated language. |
| Approach: | They propose an LLM-based pipeline that builds a structured knowledge graph from a context sentence by extracting relational triplets, validating implicit inferences, and analyzing temporal relations. |
| Outcome: | The proposed pipeline builds a structured knowledge graph from a context sentence by extracting relational triplets, validating implicit inferences, and analyzing temporal relations. |
From Benchmark to Better Embeddings: Leveraging Synonym Substitution to Enhance Multimodal Models in Ukrainian (2025.findings-emnlp)
Copied to clipboard
| Challenge: | SSA for Ukrainian degrades more than English in multimodal retrieval . we propose synonym-augmented fine-tuning to mitigate this problem . |
| Approach: | They evaluate dictionary-based and LLM-based methods for Ukrainian multimodal retrieval . they propose a Hybrid method that filters dictionary candidates with an LLM to preserve sense and grammar . |
| Outcome: | The proposed method boosts robustness without harming original performance. |
Agent Newsroom: Efficient Chronological Report Generation via Dynamic Multi-Agent Collaboration (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) improve event synthesis, but most are monolithic and often process overlapping evidence with bursty reporting patterns. |
| Approach: | They propose a multi-agent framework that casts TLS as a *newsroom-like* collaboration. |
| Outcome: | Experiments on three benchmarks show that MAS-TLS improves semantic coverage and temporal grounding while substantially reducing token usage and latency. |
Selective Knowledge Distillation: Fusing LLM Semantic Strengths with DNN Efficiency for Binary Code Similarity Detection (2026.acl-long)
Copied to clipboard
| Challenge: | BinSKD is a binary code similarity detection technique that can be used in bug detection, patch analysis, and malware detection. |
| Approach: | They propose to leverage an LLM-based BCSD method as the teacher model and transfer its knowledge of high-level program semantics to various DNN-based student models. |
| Outcome: | The proposed method yields Recall@1 improvements of 14.5%–91.2% for DNN-based BCSD methods and enables HermesSim to match the teacher’s performance with orders-of-magnitude efficiency. |
CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Entity matching (EM) requires fine-grained contextual understanding and domain knowledge. |
| Approach: | They propose a reinforcement learning controller that manages LLM operations by combining multiple operators and a set of model capacities. |
| Outcome: | The proposed controller can be reused with different LLM backends at inference time without retraining. |
Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive Decoding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to apply large language models to BioEL have revealed difficulties . |
| Approach: | They propose a framework that enables large language models to adapt well to BioEL . they employ restrictive decoding to ensure the generation of valid entities . |
| Outcome: | Extensive experiments show that the framework outperforms existing LLMs. |
Argument Summarization and its Evaluation in the Era of Large Language Models (2025.emnlp-main)
Copied to clipboard
Moritz Altemeyer, Steffen Eger, Johannes Daxenberger, Yanran Chen, Tim Altendorf, Philipp Cimiano, Benjamin Schiller
| Challenge: | Large Language Models (LLMs) have revolutionized various Natural Language Generation tasks, including Argument Summarization (ArgSum). |
| Approach: | They propose a prompt-based evaluation scheme and validate it through a human benchmark dataset. |
| Outcome: | The proposed evaluation scheme outperforms existing methods and is validated by a human benchmark dataset. |
JoPR: Joint Emotion Perception and Reasoning for Conversational Emotion Recognition (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for ERC lack human-like emotion reasoning and discrimination between similar emotions. |
| Approach: | They propose a multi-dimension curriculum with long CoT fine-tuning to clone human-like emotion reasoning for conversational emotion recognition. |
| Outcome: | The proposed model outperforms existing methods on three widely used datasets and shows that it is more intuitive and more accurate. |
Emotion Trajectory-aware Retrieval for Markov-driven Emotion Anticipation in LLM-based Emotional Support Conversation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing strategies focus on planning the next-turn dialogue strategies, while external strategy planners focus on generating empathetic responses. |
| Approach: | They propose a Markov-driven emotion anticipation framework with emotion trajectory-aware retrieval for LLM-based ESC, which anticipates future emotion states to guide strategy planning and achieve sustained emotional support. |
| Outcome: | The proposed framework can anticipate future emotions and achieve sustained emotional support on two datasets with two models. |