Papers by Qin Zhu

55 papers
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that retrieval-augmented generation improves accuracy and relevance of large language models.
Approach: They propose to introduce the information bottleneck theory into retrieval-augmented generation by maximizing mutual information between compression and ground output while minimizing mutual information .
Outcome: The proposed approach improves accuracy and correctness of answer generation and conciseness with 2.5% compression rate.
Sequence Structure Aware Retriever for Procedural Document Retrieval: A New Dataset and Baseline (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing retrieval methods neglect the execution sequence structures inherent in procedural documents.
Approach: They propose a retrieval model which integrates procedural graphs with document representations.
Outcome: The proposed model integrates procedural graphs with document representations to improve document retrieval.
Python is Not Always the Best Choice: Embracing Multilingual Program of Thoughts (2024.emnlp-main)

Copied to clipboard

Challenge: Program of Thoughts (PoT) is an approach characterized by its executable intermediate steps, which ensure the accuracy of the logical calculations in the reasoning process.
Approach: They propose a task and model agnostic approach which harnesses strength and diversity from various languages to achieve better performance across all tasks.
Outcome: The proposed approach outperforms Python Self-Consistency in almost all tasks and models and achieves comparable or superior performance on ChatGPT.
Distilled Dual-Encoder Model for Vision-Language Understanding (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that the proposed cross-modal attention distillation is crucial to the success of our framework.
Approach: They propose a framework that distills knowledge of fusion-encoder teacher into dual-encoding student model.
Outcome: The proposed model is competitive with the fusion-encoder teacher model in performance, but suffers from a lack of deep cross-modal interactions.
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)

Copied to clipboard

Challenge: Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility .
Approach: They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning.
Outcome: The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis.
CrowdAgent: Multi-Agent Managed Multi-Source Annotation System (2025.emnlp-demos)

Copied to clipboard

Challenge: Recent approaches to annotate data focus on labeling, but lack holistic process control . a novel system that integrates task assignment, data annotation, and quality/cost management is needed .
Approach: They propose a multi-agent system that integrates task assignment, data annotation, and quality/cost management.
Outcome: The proposed system automates human management by using a collaborative multi-agent system.
Pass off Fish Eyes for Pearls: Attacking Model Selection of Pre-trained Models (2022.acl-long)

Copied to clipboard

Challenge: Existing feature-based model selection methods are vulnerable to fine-tuning and are not reliable indicators for the PTM’s transferability.
Approach: They propose feature-based model selection methods which assess PTMs’ transferability to a specific task in a fast way without fine-tuning.
Outcome: The proposed methods can make FMS mistakenly judge transferability of models and can be combined with the backdoor attack to misguide the FMS to select poisoned models.
Arbitrary Time Information Modeling via Polynomial Approximation for Temporal Knowledge Graph Embedding (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge graphs lack rich inference patterns and the limited ability to model arbitrary timestamps continuously.
Approach: They propose a temporal knowledge graph-based temporal representation method that decomposes time information by polynomials and then enhances the model's capability to represent arbitrary timestamps flexibly.
Outcome: The proposed method can encode arbitrary time information or even unseen timestamps while capturing rich inference patterns and higher-arity relations of the knowledge base.
TLSA: LLM-Guided Text-Label Space Alignment with Contrastive Learning for Generalized Category Discovery (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generalized category discovery suffer from weak text–label alignment, inconsistent objectives across known and novel categories, and poor discrimination of semantically similar clusters.
Approach: They propose a unified framework that enforces contrastive alignment between text and label representations within a shared semantic space.
Outcome: The proposed framework outperforms state-of-the-art methods on four benchmark datasets.
Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation (P19-3)

Copied to clipboard

Challenge: Texar is an open-source text generation toolkit that supports a broad set of text generation tasks.
Approach: They introduce Texar, an open-source text generation toolkit that supports text generation tasks.
Outcome: Texar supports machine translation, summarization, dialog, content manipulation, and more.
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts (2022.findings-acl)

Copied to clipboard

Challenge: Recent years have seen a surge of interest in improving the generation quality of commonsense reasoning tasks.
Approach: They propose a method that diversifies the generative reasoning by a mixture of expert strategy on commonsense knowledge graphs to encourage various generation outputs.
Outcome: The proposed method improves diversity while achieving on par performance on two GCR benchmarks, based on both automatic and human evaluations.
Hierarchical Catalogue Generation for Literature Review: A Benchmark (2023.findings-emnlp)

Copied to clipboard

Challenge: Scientific literature review generation aims to extract and organize important information from an abundant collection of reference papers and produces corresponding reviews while lacking a clear and logical hierarchy.
Approach: They propose a task to generate a hierarchical catalogue of a review paper given various references by using a database of 7.6k literature review catalogues and 389k reference papers.
Outcome: The proposed method produces a hierarchical catalogue of a review paper given various references.
MMXU: A Multi-Modal and Multi-X-ray Understanding Dataset for Disease Progression (2025.findings-acl)

Copied to clipboard

Challenge: Existing datasets and models fail to consider critical aspects of medical diagnostics, authors argue . MMXU enables multi-image questions incorporating both current and historical patient data.
Approach: They propose a dataset for MedVQA that focuses on identifying changes in specific regions between two patient visits.
Outcome: The proposed dataset improves diagnostic accuracy by 20% by integrating historical data.
Learning to Ask Unanswerable Questions for Machine Reading Comprehension (P19-1)

Copied to clipboard

Challenge: Existing models for extractive reading comprehension are not good at deciding whether no answer is presented in the context.
Approach: They propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired with its corresponding paragraph that contains the answer.
Outcome: The proposed model performs better on the SQuAD 2.0 dataset than the baseline model and the BERT-large model.
Let’s Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models (2024.lrec-main)

Copied to clipboard

Challenge: Empirical evaluations conducted on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models.
Approach: They propose a diffusion model which extracts aspects step by step and learns a denoising process that progressively restores them in a reverse manner.
Outcome: Empirical evaluations on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models.
Controllable Contrastive Generation for Multilingual Biomedical Entity Linking (2023.emnlp-main)

Copied to clipboard

Challenge: Multilingual biomedical entity linking (MBEL) aims to map language-specific mentions in biomedically text to standardized concepts in a multilingual knowledge base (KB).
Approach: They propose a prompt-based controllable contrastive generation framework for MBEL which summarizes multidimensional information of the UMLS concept mentioned in biomedical text into a natural sentence following a predefined template.
Outcome: The proposed framework matches against UMLS concepts in as many languages and types as possible, thus facilitating cross-information disambiguation.
Automatic and Reliable Evaluation for Academic Caption-to-Figure Generation with LMMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets for evaluating text-to-image generation focus mostly on real-life images, which poses challenges for assessing academic figure generation given real scientific captions.
Approach: They propose a dataset that first provides a Holistic Evaluation for Academic caption-to-Figure Generation (HE4AFG) they collect real figure captions from 8 scientific domains and generate 3,900 evaluation samples .
Outcome: The proposed model provides high-quality human ratings in terms of three aspects—scientific aesthetic (SA), topic relevance (TR), and attribute correctness (AC).
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to augment pre-trained language models with disease knowledge are lacking.
Approach: They propose a method to augment BERT-like pre-trained language models with disease knowledge.
Outcome: The proposed method improves on a suite of BERT models over three tasks.
A Diffusion Model for Event Skeleton Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for event schema generation are noise-sensitive and error-accumulating, e.g., inability to correct errors while generating schema.
Approach: They propose a novel diffusion event graph model that embeds and roundes event graphs into learnable latent representations and a denoising process to maintain the model's robustness.
Outcome: The proposed model achieves better results than existing state-of-the-art models on three IED bombing datasets.
Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation (2024.findings-emnlp)

Copied to clipboard

Challenge: Current LLMs are achieving better performance on various benchmarks, but their performance in practical applications does not always match their benchmark results.
Approach: They propose to detect and rewrite leaked benchmarks without altering their difficulties by using Inference-Time Decontamination (ITD) to mitigate performance inflation caused by memorizing leaked samples.
Outcome: The proposed method reduces inflated accuracy by 22.9% on GSM8K and 19.0% on MMLU.
Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring (2025.naacl-long)

Copied to clipboard

Challenge: Existing black-box jailbreak methods often rely on model feedback . existing methods may be intercepted by content moderators during the search process .
Approach: They propose a method that guides malicious prompt construction by local training a mirror model of the target black-box model through benign data distillation.
Outcome: The proposed method achieves a 92% attack success rate and 80% stealth rate on a subset of AdvBench.
FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognition (2021.findings-emnlp)

Copied to clipboard

Challenge: Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence.
Approach: They propose a fast correction model that takes multiple ASR candidates as input for better correction accuracy.
Outcome: The proposed model can reduce the word error rate (WER) with multiple candidates by 3.2% and 2.6%.
Learning to Describe for Predicting Zero-shot Drug-Drug Interactions (2023.emnlp-main)

Copied to clipboard

Challenge: Existing computational methods for DDI prediction fail to capture interactions for new drugs due to the lack of knowledge.
Approach: They propose a problem setup as zero-shot DDI prediction that deals with the case of new drugs by using textual information from online databases.
Outcome: The proposed method improves on several settings including zero-shot and few-shot DDI prediction and the selected texts are semantically relevant.
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach: They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome: The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .
Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes .
Approach: They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering.
Outcome: The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability.
Guiding Medical Vision-Language Models with Diverse Visual Prompts: Framework Design and Comprehensive Exploration of Prompt Variations (2025.naacl-long)

Copied to clipboard

Challenge: Current vision-language models lack the ability to focus on specific areas designated by humans . a new framework that integrates medical entity extraction, visual prompt generation, and dataset adaptation is proposed to improve visual prompt-guided fine-tuning.
Approach: They propose to use visual prompts to guide and enhance formation of region-specific attention.
Outcome: The proposed framework outperforms state-of-the-art large vision-language models on medical datasets.
AMA: Adaptive Memory via Multi-Agent Collaboration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to longterm memory rely on rigid retrieval granularity, accumulation-heavy maintenance strategies, and coarse-grained update mechanisms.
Approach: They propose a framework that leverages coordinated agents to manage memory across multiple granularities.
Outcome: The proposed framework outperforms state-of-the-art benchmarks while reducing token consumption by approximately 80%.
BOLT: Benchmarking Open-World Learning for Text Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on out-of-distribution (OOD) detection while overlooking broader challenges such as the discovery of novel categories.
Approach: They propose a unified Benchmark and evaluation toolkit supporting Open-world learning for text classification.
Outcome: The proposed methods overfit training distributions and struggle to generalize to unseen classes.
EMTIR-GRPO: Efficient Multi-Tool Augmented Large Language Models via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Tool-integrated reasoning (TIR) enables large language models to invoke external tools for tasks beyond their internal capacity but often suffers from tool overuse.
Approach: They propose an algorithm that uses a composite reward to model tool costs and tool efficiency.
Outcome: The proposed algorithm models heterogeneous tool costs and encourages more cost-effective tool-use strategies.
A Versatile Adaptive Curriculum Learning Framework for Task-oriented Dialogue Policy Learning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing training paradigms for dialogue policy learning with brute-force random sampling are expensive and lack reliable evaluation of difficulty scores.
Approach: They propose a flexible adaptive curriculum learning framework that integrates curriculum learning with a generic global curriculum.
Outcome: The proposed framework improves learning performance and efficiency on three public dialogue datasets.
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have promoted generative error correction (GER) for automatic speech recognition (ASR).
Approach: They propose a multimodal LLM to receive source speech as extra input and reformat it as a cloze test with logits calibration to remove input information redundancy and simplify GER with clear instructions.
Outcome: The proposed model improves on 9 popular ASR datasets and is faster than vanilla GER.
Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits (2025.coling-main)

Copied to clipboard

Challenge: Existing data on MBTI personality detection are based on self-reported labels and fail to capture the full range of population personality traits.
Approach: They construct a manually annotated MBTI personality detection dataset with soft labels under the guidance of psychologists and use them to identify the task.
Outcome: The MBTIBench is the first manually annotated MBti personality detection dataset with soft labels under the guidance of psychologists.
A Text-Centered Shared-Private Framework via Cross-Modal Prediction for Multimodal Sentiment Analysis (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies treat all three modal features equally and implicitly explore the interactions between different modalities.
Approach: They propose a text-centered shared-private framework for multimodal fusion . they propose modalities that can provide shared and private semantics .
Outcome: The proposed framework outperforms baselines on the MOSEI and MOSI datasets.
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)

Copied to clipboard

Challenge: Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss.
Approach: They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant.
Outcome: The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting.
Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement (2024.findings-emnlp)

Copied to clipboard

Challenge: Decompilation is the process of converting compiled code back into a high-level programming language for analysis when source code is unavailable.
Approach: They propose two methods to improve decompilation performance without fine-tuning and fine-grained alignment enhancement to achieve further improvements.
Outcome: The proposed methods achieved a Re-Executability performance improvement of approximately 3.90% on the Decompile-Eval benchmark, establishing a new state-of-the-art performance of 52.41%.
Black-Box Membership Inference Attacks for Video Training Data in Multimodal Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods assess model memorization of key semantic concepts within a video but do not provide reliable evidence that a specific video was used during training.
Approach: They propose a black-box MIA framework that can provide reliable evidence of specific video data usage for training multimodal large language models.
Outcome: The proposed framework can provide reliable evidence of specific video data usage for training multimodal large language models.
GenDis: Generative-Discriminative Dual-View Co-Training for Generalized Category Discovery (2026.acl-long)

Copied to clipboard

Challenge: Existing methods rely on one-hot discriminative supervision, leading to overfitting on seen classes and poor generalization to unseen ones.
Approach: They propose a Generative–Discriminative Dual-View Co-Training framework that unifies discriminative classification and semantic label generation within an LLM.
Outcome: The proposed framework outperforms existing methods on five benchmarks on the generalized category discovery (GCD) task.
Machine Translation With Weakly Paired Documents (D19-1)

Copied to clipboard

Challenge: Recent studies explore the possibility of unsupervised machine translation with monolingual data only.
Approach: They propose a method to mine bilingual sentences from weakly paired documents . they use word distribution-level alignments to constrain word distributions of two weakly-paired documents.
Outcome: The proposed method outperforms previous results on six translation tasks using weakly paired bilingual documents and a large number of bilingual sentences.
SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Experimental results show that SmartTrim accelerates the original model by 2-3 times with minimal performance degradation.
Approach: They propose an adaptive acceleration framework which prunes redundant token representations and attention heads within each layer of the original model.
Outcome: The proposed framework accelerates the original model by 2-3 times with minimal performance degradation across vision-language tasks.
Meta-Tool: Unleash Open-World Function Calling Capabilities of General-Purpose Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models struggle with addressing diverse user inquiries in open-world tasks.
Approach: They propose a plug-and-play tool retrieval system for LLMs to access external tool library and use retrieved tools to solve user's problem.
Outcome: The proposed model improves on a finetuned version of LLaMA-3.1 and 2,800 dialogues and 7,361 tools spanning ten distinct test categories.
Length Controlled Generation for Black-box LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach: They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome: The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.
WebCPM: Interactive Web Search for Chinese Long-form Question Answering (2023.acl-long)

Copied to clipboard

Challenge: Long-form question answering requires two procedures: information retrieval and information synthesis.
Approach: They propose a Chinese long-form question answering dataset called WebCPM . the dataset is based on a web search interface that engages with a search engine in real time .
Outcome: The proposed dataset generates answers that are no worse than human-written ones . the dataset is the first Chinese LFQA dataset .
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)

Copied to clipboard

Challenge: Commercial news provides rich semantics and timely information for automated financial risk detection.
Approach: They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement.
Outcome: The proposed model outperforms existing models in terms of generalization and semantics and annotation.
Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition (2023.acl-long)

Copied to clipboard

Challenge: Existing efforts to improve robustness of audio-visual speech recognition with visual information focus on audio modality . current approaches introduce noise adaptation techniques to improve reliability of AVSR task .
Approach: They propose a visual-invariant modality to strengthen robustness of audio-visual speech recognition (AVSR) it can adapt to any testing noises without dependence on noisy training data, a.k.a., unsupervised noise adaptation.
Outcome: The proposed method outperforms existing state-of-the-arts on visual speech recognition task under various noisy and clean conditions.
Less Is More: Domain Adaptation with Lottery Ticket for Reading Comprehension (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing domain adaptation paradigms for reading comprehension require large amounts of annotation data to achieve the desired task performance.
Approach: They propose a few-shot domain adaptation paradigm for reading comprehension . they introduce self-attention attribution to weigh parameters and refine the lottery subnetwork .
Outcome: The proposed model outperforms the full model fine-tuning adaptation on four out of five domains with a small amount of data available for adaptation.
Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning (2023.acl-long)

Copied to clipboard

Challenge: Prompt tuning is a parameter-efficient approach to adapting pre-trained language models to downstream tasks.
Approach: They propose to combine pre-trained modules with pre-trains to boost prompt tuning for few-shot learning.
Outcome: The proposed model outperforms prompt tuning, full model tuning, and prior prompt pre-training methods in few-shot learning settings.
CoLo: A Contrastive Learning Based Re-ranking Framework for One-Stage Summarization (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for extractive and abstractive summarization use token-level or sentence-level training objectives.
Approach: They propose a Contrastive Learning based re-ranking framework for one-stage summarization called CoLo.
Outcome: The proposed framework boosts extractive and abstractive results on CNN/DailyMail benchmarks while maintaining inference efficiency.
Unified Active Retrieval for Retrieval Augmented Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing active retrieval methods struggle with handling various types of instructions.
Approach: They propose a unified active retrieval framework for retrieval-augmented generation . they propose to combine four orthogonal criteria into plug-and-play classification tasks .
Outcome: The proposed framework outperforms existing methods on four representative types of user instructions on four types of instructions.
Soft Contextual Data Augmentation for Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Existing methods for enhancing training data are limited in natural language tasks due to text characteristics.
Approach: They propose a data augmentation method that softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words.
Outcome: The proposed method outperforms baseline methods on small and large scale machine translation datasets.
OAgents: An Empirical Study of Building Effective Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that agent research practices are far from standard, rigorous . lack of a standard evaluation protocol makes previous works not reproducible, authors say .
Approach: They conduct an empirical study on the GAIA benchmark to investigate agent design choices . they find that lack of a standard evaluation protocol makes previous works not reproducible .
Outcome: The proposed framework achieves state-of-the-art performance among open-source projects.
BeamAggR: Beam Aggregation Reasoning over Multi-source Knowledge for Multi-hop Question Answering (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated strong reasoning capabilities, but they still suffer from factual errors when tackling knowledge-intensive tasks.
Approach: They propose a reasoning framework for knowledge-intensive multi-hop QA that prioritizes promising answers at each hop of question.
Outcome: The proposed framework outperforms SOTA methods on four open-domain multi-hop reasoning datasets by 8.5%.
Parsing Tweets into Universal Dependencies (N18-1)

Copied to clipboard

Challenge: a new tweet treebank for English is designed to analyze tweets with universal dependencies (UD).
Approach: They extend the universal dependencies guidelines to include special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies.
Outcome: The proposed method outperforms state-of-the-art parsers on other treebanks in accuracy and speed.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning (2024.findings-acl)

Copied to clipboard

Challenge: BioT5+ is an extension of the BioT5, but lacked a nuanced understanding of molecular structures.
Approach: They propose a new bio-entity modeling framework, BioT5+, which integrates IUPAC names and molecule data.
Outcome: The proposed model bridges the gap between molecular representations and textual descriptions and improves the grounded reasoning of bio-text and bio-sequences.
MedMCP-Calc: Benchmarking LLMs for Realistic Medical Calculator Scenarios via MCP Integration (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on static single-step calculations with explicit instructions.
Approach: They propose a benchmark for evaluating medical calculators in realistic scenarios . they use 118 scenario tasks across 4 clinical domains to evaluate medical calculator performance .
Outcome: The first benchmark for evaluating medical calculators in realistic scenarios is released . it features 118 scenario tasks across 4 clinical domains and is based on a model context protocol integration.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations