Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Copied to clipboard
| Challenge: | Existing media intelligence tools rely on descriptive analytics with limited transparency. |
| Approach: | They propose a framework for mapping actors, topics, and arguments within public debates . it combines actor detection, topic modeling, argument extraction and stance classification . the framework is tested on multiple energy infrastructure projects as a case study . |
| Outcome: | The proposed framework delivers fine-grained, source-grounded insights while remaining adaptable to diverse domains. |
Copied to clipboard
| Challenge: | a new version of an open-source library for natural language processing (NLP) is released . the library is easy to use, flexible, and works with many languages. |
| Approach: | They introduce a new version of an open-source library for natural language processing (NLP) it supports both traditional NLP tasks and new tasks needed to enhance LLMs truthfulness and reliability. |
| Outcome: | The new version of DeepPavlov supports both traditional and new tasks . it is easy to use, flexible, and works with many languages . |
Copied to clipboard
| Challenge: | PropGenie is a multi-agent framework based on large language models (LLMs) it provides comprehensive real estate assistance in real-world scenarios . |
| Approach: | They propose a multi-agent framework based on large language models to deliver comprehensive real estate assistance in real-world scenarios. |
| Outcome: | The proposed framework outperforms a general-purpose LLM and a domain-specific chatbot in real-world scenarios. |
Copied to clipboard
| Challenge: | Specialized benchmarks can be leveraged to create quizzes that can effectively train engineering and marketing personnel on novel product offerings in a continually growing Cisco product space. |
| Approach: | They propose to generate multiple-choice questions using domain-specific prompts using a set of professional certification textbooks and a range of latest open-source and proprietary LLMs. |
| Outcome: | The proposed quiz engine generates multiple-choice questions using domain-specific prompts and a range of latest open-source, and proprietary LLMs. |
Copied to clipboard
| Challenge: | elfen is a Python library for efficient linguistic feature extraction for text datasets. |
| Approach: | They propose a Python library for efficient linguistic feature extraction for text datasets. |
| Outcome: | The proposed library enables linguistic feature extraction on thousands of items even on limited computing resources. |
Copied to clipboard
| Challenge: | Existing tools for measuring diversity of specific linguistic phenomena are limited . we present an open-source framework for measuring linguistic diversity . |
| Approach: | They propose an open-source framework that integrates dependency tree querying with diversity computation. |
| Outcome: | The proposed framework can measure diversity across multiple linguistic levels and dimensions. |
Copied to clipboard
| Challenge: | Sustainability reports contain rich Environmental, Social and Governance information, but their heterogeneous layouts and complex multi-table structures pose major challenges for LLMs, especially for unit normalization, cross-document reasoning, and precise numerical computation. |
| Approach: | They propose an end-to-end system that couples robust table extraction with a structured prompting framework for multi-table filtering, normalization, and program-of-thought reasoning. |
| Outcome: | The proposed system outperforms standard prompting on multi-table benchmarks and provides transparent, auditable reasoning. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have demonstrated their proficiency in answering natural language queries. |
| Approach: | They propose a system that augments Large Language Models with domain-specific knowledge graphs . they evaluate a medical KG and use a KG-based retrieval approach to enhance factual correctness . |
| Outcome: | The proposed system surpasses a standalone LLM in accuracy and completeness on a medical KG dataset. |
Copied to clipboard
| Challenge: | ELIA is an interactive web application that simplifies the outputs of various language model component analyses for a broader audience. |
| Approach: | They propose to use a vision-language model to automatically generate natural language explanations for the complex visualizations produced by these methods. |
| Outcome: | The proposed system integrates three key techniques and generates natural language explanations for complex visualizations. |
Copied to clipboard
| Challenge: | Existing LLM tutors lack persistent representations of learner knowledge . current systems provide inconsistent hints, overlook dependencies between concepts . |
| Approach: | They propose a multi-agent LLM tutoring system that integrates mastery estimates, misconceptions, review schedules, and engagement signals. |
| Outcome: | The proposed system integrates skill assessment, learner profiling, graduated hinting, curriculum selection, spaced repetition, and engagement monitoring over a shared state under a single-writer policy. |
Copied to clipboard
| Challenge: | Membership Inference attacks aim to determine whether a specific data point was included in the training set of a target model. |
| Approach: | They propose to train a neural network to analyze the target model’s behavior on perturbed inputs, capturing interactions between semantic domains and loss values on members and non-members in the local neighborhood of each sample. |
| Outcome: | The proposed methods can detect distribution shifts in existing datasets and release a baseline pipeline to detect them. |
Copied to clipboard
| Challenge: | Disinformation and advanced generative AI content pose a significant challenge for journalists and fact-checkers who must rapidly verify digital media. |
| Approach: | They propose to integrate a browser-based tool that automatically extracts content from a suite of backend NLP classifiers and presents actionable credibility signals and AI-generation likelihood in an easy-to-digest format. |
| Outcome: | The Verification Assistant is a browser-based tool that extracts content and routes it to a suite of backend NLP classifiers, presenting actionable credibility signals, AI-generation likelihood, and other verification advice in an easy-to-digest format. |
Copied to clipboard
| Challenge: | HL7 FHIR format is a desirable format for clinical data integration and healthcare services. |
| Approach: | They propose an end-to-end framework that adheres to the HL7 FHIR document schema . it uses LLM agents, code execution, and healthcare terminology database tools . |
| Outcome: | The proposed framework adheres to the HL7 FHIR document schema and competes well with a human baseline in predicting FHIr resources from unstructured text. |
Copied to clipboard
| Challenge: | a multimodal multilingual lecture companion is needed to preserve lecture content in its entirety . globalization of education and rapid growth of online learning have made localizing educational content a challenge . |
| Approach: | They propose a multimodal multilingual lecture companion that translates lecture audio and slides to produce synchronized outputs across three modalities. |
| Outcome: | The proposed solution preserves the original content in its entirety while preserving translations across three modalities. |
Copied to clipboard
| Challenge: | Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). |
| Approach: | They propose a framework for efficient fine-tuning Large Language Models (LLMs) they aim to train only a small percentage of the full model's parameters . |
| Outcome: | Xu et al., 2023; Ding e t al, 2024; Lialin e al. 2023) show that using PEFT methods can improve performance. |
Copied to clipboard
| Challenge: | XPLAINSIM is a Python package that explains textual similarity in an easy-to-use way. |
| Approach: | They propose a Python package that unifies three approaches to explain text similarity . they demonstrate the value of the package through intuitive examples and empirical research . |
| Outcome: | XPLAINSIM is a Python package that unifies three approaches to explain text similarity . the authors show that the package is useful for explaining text similarities in a simple way . |
Copied to clipboard
| Challenge: | High-quality datasets are crucial for training effective state of the art machine translation systems, but they can be noisy and degrade performance. |
| Approach: | They propose an open-source tool for augmenting data, identifying and correcting errors in parallel corpora. |
| Outcome: | The tool extracts consistent phrase pairs, enabling targeted replacements that can improve the dataset quality. |
Copied to clipboard
| Challenge: | PromptLab is a web-based prompt engineering platform for collaborative prompt development across diverse natural language processing tasks and datasets. |
| Approach: | They propose to integrate prompt generation via OpenRouter and provide real-time validation with multiple Large Language Models. |
| Outcome: | The platform addresses primary challenges in prompt development, including template creation, collaborative review, and quality assurance through a comprehensive workflow that supports both individual researchers and team-based projects. |
Copied to clipboard
| Challenge: | Existing work on bias evaluation includes benchmark datasets and automated detection methods. |
| Approach: | They propose an open-source web application for side-by-side comparison of LLM outputs with real-time bias analysis. |
| Outcome: | The open-source application compares LLM outputs with real-time bias analysis. |
Copied to clipboard
| Challenge: | Large-scale scientific research on medieval Arabic manuscripts remains challenging due to the need for advanced paleographic and linguistic training and the lack of assisting software. |
| Approach: | They propose an end-to-end Arabic manuscript analysis tool for manuscript-based analytics and research hypothesis testing. |
| Outcome: | The proposed tool overcomes the limitations of existing tools and can be used in large-scale scientific research. |
Copied to clipboard
| Challenge: | Existing implementations of prompt optimization are tied to unmaintained, isolated codebases or require invasive integration into application frameworks. |
| Approach: | They propose a unified, modular open-source framework that integrates multiple contemporary discrete prompt optimizers within a single extensible system for both practitioners and researchers. |
| Outcome: | The proposed framework integrates multiple discrete prompt optimizers, supports systematic and reproducible benchmarking, and returns framework-agnostic prompt strings, enabling seamless integration into existing LLM pipelines while remaining agnosite to the underlying model implementation. |
Copied to clipboard
| Challenge: | Recent foundation models show that reasoningoriented training and improved decoding methods can substantially boost both accuracy and speed. |
| Approach: | They propose an open-weight Russian LLM for hybrid reasoning and efficient inference. |
| Outcome: | The proposed model supports direct answering and reasoning-trace generation . the model and inference pipeline can be extended or modified to suit Russian-language reasoning . |
Copied to clipboard
| Challenge: | SDialog is an open-source Python toolkit for end-to-end development, simulation, evaluation and analysis of LLM-based conversational agents. |
| Approach: | They present an open-source Python toolkit for end-to-end development, simulation, evaluation and analysis of LLM-based conversational agents. |
| Outcome: | SDialog enables more controlled, transparent, and systematic research on conversational systems. |
Copied to clipboard
| Challenge: | Current systems rely on keyword matching and shallow keyword-based screening, leading to missed opportunities and inconsistent evaluations. |
| Approach: | They propose a framework that uses Large Language Models to automate candidate assessment in recruitment. |
| Outcome: | The proposed framework outputs detailed assessment reports, candidate comparisons, and ranked recommendations that are transparent, auditable, and suitable for real-world hiring workflows. |
Copied to clipboard
| Challenge: | Existing retrieval tools require considerable engineering effort for many tasks like efficient data management or model customization. |
| Approach: | They propose a novel open-source retrieval toolkit that simplifies research experiments without sacrificing flexibility or speed. |
| Outcome: | The proposed tool reduces memory consumption by 2.6 and allows for arbitrary customizations. |
Copied to clipboard
| Challenge: | ClinicalTrialsHub consolidates clinical trial data from ClinicalTrial.gov and augments it by extracting and structuring trial-relevant information from PubMed. |
| Approach: | They propose a search-focused platform that consolidates PubMed data and extracts structured trial information. |
| Outcome: | ClinicalTrialsHub increases access to structured clinical trial data by 83.8% compared to ClinicalTrial.gov alone. |
Copied to clipboard
| Challenge: | Existing systems often exhibit unverifiable attributions, shallow evidence mapping, and hallucinated citations. |
| Approach: | They propose a claim verification system that provides source-level accountability and evidence traceability. |
| Outcome: | SciTrue outperforms RAG-based baselines in summary traceability, attribution accuracy, and context alignment in a human evaluation of 300 attributions. |
Copied to clipboard
| Challenge: | Existing tools for linguistic analysis of Spanish texts lack linguistic features for interpretability and tasks that involve style, structure, and readability. |
| Approach: | They propose to use PUCP-Metrix to analyze Spanish texts in a language repository. |
| Outcome: | The proposed toolkit performs better on automated readability assessments and machine-generated text detection tasks than existing repositories and strong neural baselines. |
Copied to clipboard
| Challenge: | Existing methods for detecting authorship and short answers are ineffective when students query proprietary black-box systems using instructor-provided documents. |
| Approach: | They propose a document-layer watermarking system that embeds schema-aware, item-level watermarks into assessment PDFs while keeping their human-visible appearance unchanged. |
| Outcome: | The proposed system achieves high prevention and detection reliability across 30 question papers spanning STEM, humanities, and medical reasoning. |
Copied to clipboard
| Challenge: | rapid growth of scientific literature has made manual extraction of structured knowledge increasingly impractical. |
| Approach: | They propose a system for creating datasets from scientific literature that integrates human-AI teaming principles and iterative workflows. |
| Outcome: | The proposed system improves extraction fidelity and facilitates efficient dataset creation. |
Copied to clipboard
| Challenge: | Autoregressive language models generate text sequentially from left to right by adding one token at a time. |
| Approach: | They propose a python package that provides a suite of small non-autoregressive language models that can be used by researchers. |
| Outcome: | The proposed package makes implementing small non-autoregressive language models faster and provides a suite of pre-trained models that can be used by the research community. |
Copied to clipboard
| Challenge: | Personalized one-on-one tutoring is an effective educational approach, yet its widespread adoption is constrained by the limited availability of qualified tutors and the high costs associated with tutor training. |
| Approach: | They propose an evaluation tool that uses language technology to evaluate the pedagogical quality of AI tutors. |
| Outcome: | The proposed evaluation tool is aimed at education stakeholders as well as the *ACL community at large, as it supports learning and can also collect user feedback and annotation. |
Copied to clipboard
| Challenge: | EvalSense is a flexible framework for constructing domain-specific evaluation suites for large language models . it provides out-of-the-box support for a broad range of model providers and evaluation strategies . |
| Approach: | They propose a framework for constructing domain-specific evaluation suites for large language models. |
| Outcome: | The proposed framework provides out-of-the-box support for a broad range of model providers and evaluation strategies. |
Copied to clipboard
| Challenge: | EWS financial flows are opaque and lack standardized labels, structures, and terminology for EWS-related spending. |
| Approach: | They propose an agent-based Retrieval-Augmented Generation system that uses hybrid retrieval and internal chain-of-thought reasoning to extract relevant financial data and classify EWS investments. |
| Outcome: | The proposed system outperforms four alternatives on multi-label classification and budget allocation on an annotated CREWS Fund corpus. |
Copied to clipboard
| Challenge: | Existing tools for evaluating RAG systems often collapse heterogeneous behaviors into single scores. |
| Approach: | They propose a diagnostic framework for automated, reference-free evaluation of RAG pipelines. |
| Outcome: | The proposed framework decomposes RAG behavior into retrieval quality,answer relevance and completeness, strictclaim-level faithfulness, and judge calibration. |
Copied to clipboard
| Challenge: | Translation Memory (TM) systems are core components of computer-aided translation tools . however, they fail to retrieve semantically relevant content when surface similarity is low. |
| Approach: | They propose an open-source demo and evaluation toolkit for TM retrieval that connects modern sentence encoders and strong lexical/fuzzy baselines with a vector database. |
| Outcome: | The proposed toolkit exposes the end-to-end retrieval pipeline through a web-based UI for qualitative inspection and preference logging. |
Copied to clipboard
| Challenge: | Questionnaire-like prompts have become an important format to probe, assess, and utilize large language models (LLMs) |
| Approach: | They propose an open-source Python framework for generating responses from questionnaire-style prompts to support in-silico surveys and annotation tasks with large language models (LLMs). |
| Outcome: | The proposed framework can be used to generate responses from questionnaire-style prompts and to perform annotations on large language models. |
Copied to clipboard
| Challenge: | Existing interfaces lack intuitive, contextaware capabilities needed for easily navigating complex architectural components in 3D spaces. |
| Approach: | They propose a virtual assistant that allows users to interact with the BIM file in a VR environment. |
| Outcome: | The proposed assistant could allow users to interact with the BIM file in a virtual reality environment and perform complex actions. |
Copied to clipboard
| Challenge: | a new deliberation interface enables users to engage with multiple large language models (LLMs) ArgsBase exemplifies hybrid argumentation and supports epistemically responsible human–AI collaboration. |
| Approach: | They propose a deliberation interface that enables users to engage with multiple large language models coordinated by a moderator agent. |
| Outcome: | The proposed system exemplifies hybrid argumentation and aligns with recent calls for "reasonable parrots" the user study shows that the tool is easy to use, perspective-enhancing, and promising for research . |
Copied to clipboard
| Challenge: | a new open-source web application for simultaneous speech-to-text translation is developed for Estonian . the system translates live Estonian speech into English, Russian, and Ukrainian text, and also supports English-to Estonian translation. |
| Approach: | They propose a web application that combines streaming speech recognition with a simultaneous translation model. |
| Outcome: | The proposed system outperforms existing streaming speech recognition systems in Estonian-to-English translation. |
Copied to clipboard
| Challenge: | largelanguage models (LLMs)-powered web agents can be useful for research in areas such as social science, public health, and economics. |
| Approach: | They propose a model-agnostic multi-agent system that auto-mates the process of validating and remediatingweb-sourced datasets. |
| Outcome: | The proposed system outperforms baseline approaches and achieves datacompleteness and precision up to 73.3%. |
Copied to clipboard
| Challenge: | Entity linking (EL) is the task of mapping named entities in text to canonical entries in a knowledge base. |
| Approach: | They propose a unified library for using and developing entity linking systems . a strong emphasis is placed on usability, making it highly extensible . |
| Outcome: | a new library aims to disambiguate named entities in text by mapping them to canonical entries in a knowledge base. |
Copied to clipboard
| Challenge: | Existing methods for ESG compliance assessment rely on fact-based retrieval methods. |
| Approach: | They propose a multi-modal information extraction pipeline to extract, structure, and evaluate sustainability reports. |
| Outcome: | The proposed system extracts, structures, and evaluates ESG-related content from text, tables, figures, and infographics. |
Copied to clipboard
| Challenge: | Existing efforts to improve Bangla's NLP performance have focused on isolated tasks such as Part-of-Speech tagging and Named Entity Recognition (NER) but comprehensive, integrated systems for core NLP tasks such Shallow Parsing and Dependency Parser are largely absent. |
| Approach: | They propose to integrate a large-scale, manually annotated Bangla Treebank with high-quality pretrained models for POS tagging, NER, shallow parsing, and dependency parse. |
| Outcome: | The proposed system achieves strong in-domain baseline performance while maintaining high efficiency in resource usage. |