Papers by Feng Lin

109 papers
AdaMix: Adaptive Mixing for Short and Long Reasoning Adapters (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for large reasoning models have improved efficiency but still face limitations such as conflicting objectives and limited adaptability.
Approach: They propose an adaptive reasoning framework that applies a uniform, computation-intensive deep reasoning strategy to all problems.
Outcome: The proposed framework reduces the average response length of DeepSeek-R1-Distill-Qwen-7B by 54.9% while improving accuracy by up to 4.8% on five mathematical datasets.
CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that rule-based evaluation methods are ineffective for open-ended natural language generation.
Approach: They propose a pointwise generative reward model with a dedicated two-stage rollout method and unified query-based criteria that can be trained with 5.7K high-quality data.
Outcome: The proposed model achieves superior performance on diverse reward model benchmarks, especially in Best-of-N scenarios, and delivers more effective improvements in downstream RL practice.
Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs (2026.acl-long)

Copied to clipboard

Challenge: High-quality post-training data is the primary engine driving LLM capabilities . datasets are often treated as isolated artifacts, overlooking their true developmental context .
Approach: They propose a framework to reconstruct the evolutionary graph of dataset development using data lineage.
Outcome: The proposed framework characterizes domain-specific structural patterns in Math-oriented datasets and general-domain corpora.
Enhancing Neural Data-To-Text Generation Models with External Background Knowledge (D19-1)

Copied to clipboard

Challenge: Recent neural models for data-to-text generation rely on parallel pairs of data and text to learn writing knowledge.
Approach: They propose to enhance neural models with external knowledge to improve fidelity of generated text.
Outcome: The proposed model improves on Wikipedia infobox-to-text datasets on 21 datasets.
S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks rely heavily on text-based evaluation and largely ignore paralinguistic cues such as prosody, emotion, and speaker traits.
Approach: They propose a speech-native benchmark for evaluating instruction-following S2S models with explicit assessment of both semantic understanding and paralinguistic expression.
Outcome: The proposed system enables more natural, robust, and human-aligned speech agents.
Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are gaining popularity due to their lack of knowledge hallucination and lack of a coherent model.
Approach: They propose a self-supervised quantized representation method to compress KG structural and semantic knowledge into discrete codes that align the format of language sentences.
Outcome: The proposed framework outperforms existing unsupervised methods producing more distinguishable codes on KG link prediction and triple classification tasks.
CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios (2025.emnlp-main)

Copied to clipboard

Challenge: a number of tools are used to perform complex tasks, but the tool utilization process can cause errors.
Approach: They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks.
Outcome: The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios.
Dynamic Dialogue Policy for Continual Reinforcement Learning (2022.coling-1)

Copied to clipboard

Challenge: Continual reinforcement learning of the dialogue policy has remained unaddressed . lack of a framework with training protocols, baseline models and suitable metrics has hindered research in this direction.
Approach: They propose a continual learning algorithm, baseline architectures and metrics for assessing continual reinforcement learning models.
Outcome: The proposed architecture can integrate new knowledge seamlessly and achieve significant zero-shot performance when exposed to unseen domains.
I-MCTS: Enhancing Agentic AutoML via Introspective Monte Carlo Tree Search (2026.findings-eacl)

Copied to clipboard

Challenge: Existing LLM-based agents struggle with low diversity and suboptimal code generation.
Approach: They propose an approach that iteratively expands tree nodes through an introspective process that meticulously analyzes solutions and results from parent and sibling nodes.
Outcome: The proposed approach shows a 4% improvement in performance compared to the strong open-source AutoML agents.
Learning Semantic Correspondences from Noisy Data-text Pairs by Local-to-Global Alignments (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for data-to-text generation use a large-scale training corpus to learn semantic correspondences between structured input data and associated texts.
Approach: They propose a local-to-global alignment framework that uses local and global models to learn semantic correspondences from large-scale datasets.
Outcome: The proposed framework can be generalized to restaurant and computer domains and improve alignment accuracy.
Beyond Linguistic Cues: Fine-grained Conversational Emotion Recognition via Belief-Desire Modelling (2024.lrec-main)

Copied to clipboard

Challenge: Emotion recognition in conversation (ERC) is essential for dialogue systems to identify the emotions expressed by speakers.
Approach: They propose a method that incorporates both belief and desire to accurately identify emotions by extracting emotion-eliciting events from utterances and construct graphs that represent beliefs and desires in conversations.
Outcome: The proposed model outperforms existing models on four popular ERC datasets and validates its performance with multiple state-of-the-art models.
TableDreamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for table instruction tuning are limited due to limited data diversity and lack of data quality.
Approach: They propose a weakness-guided data synthesis framework for table instruction tuning that explores the vast input space of table understanding tasks and then iterates through the input space.
Outcome: The proposed framework boosts the average accuracy of Llama3.1-8B-instruct by 11.62% with 27K GPT-4o synthetic data and outperforms state-of-the-art data synthesis baselines which use more training data.
Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods focus on equally treating the contribution of each modality or statically using text as the dominant modality to conduct interaction, which neglects the situation where each modal may become dominant.
Approach: They propose a Knowledge-Guided Dynamic Modality Attention Fusion Framework (KuDA) that uses sentiment knowledge to guide the model dynamically selecting the dominant modality and adjusting the contributions of each modality.
Outcome: The proposed model can be used to highlight the contribution of dominant modality through the correlation evaluation loss.
Fine-grained Pluggable Gradient Ascent for Knowledge Unlearning in Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies on knowledge unlearning focus on computer vision but extend their exploration to other fields.
Approach: They propose an adaptive objective that calculates gradients with fine-grained control specifically targeting sensitive tokens.
Outcome: The proposed method improves the general ability of language models while achieving knowledge unlearning.
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
Task-Oriented Conversation Generation Using Heterogeneous Memory Networks (D19-1)

Copied to clipboard

Challenge: Existing memory networks do not perform well when leveraging heterogeneous information from different sources.
Approach: They propose to use user utterances, dialogue history and background knowledge tuples to integrate external knowledge into a neural dialogue model.
Outcome: The proposed model outperforms the state-of-the-art data-driven task-oriented dialogue models on real-world datasets.
AdaptThink: Reasoning Models Can Learn When to Think (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large reasoning models have demonstrated remarkable capabilities in tackling complex tasks.
Approach: They propose an algorithm to teach reasoning models to choose the optimal thinking mode based on problem difficulty.
Outcome: The proposed algorithm reduces the average response length and improves accuracy on three math datasets.
Multimodal Table Understanding (2024.acl-long)

Copied to clipboard

Challenge: Existing approaches to understanding tables rely on textual inputs and table images are difficult to access in real-world scenarios.
Approach: They propose a multimodal table understanding problem where the model needs to generate correct responses to various table-related requests based on the given table image.
Outcome: The proposed model outperforms open-source MLLMs on 23 benchmarks under held-in and held-out settings.
AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation (2025.findings-acl)

Copied to clipboard

Challenge: Existing models of seeker simulations are limited by the cost and ethical concerns of involving real seekers in mental health research.
Approach: They propose an emotional and cognitive dynamic agent system equipped with tertiary memory to enable dynamic control of the simulator's configurations.
Outcome: The proposed system achieves more realistic seeker simulation compared to baselines.
How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehension (2023.findings-acl)

Copied to clipboard

Challenge: Despite recent progress in multi-answer MRC, there is no systematic analysis of how this phenomenon arises and how to better address it.
Approach: They develop a taxonomy to categorize commonly-seen multi-answer MRC instances and examine how well different paradigms deal with different types of multi-announced questions.
Outcome: The proposed taxonomy categorizes commonly-seen multi-answer instances and analyzes how well different paradigms deal with different types of multi-announced instances.
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool.
Approach: They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images .
Outcome: The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images.
DeepMed: Building a Medical DeepResearch Agent via Multi-hop Med-Search Data and Turn-Controlled Agentic Training & Inference (2026.findings-acl)

Copied to clipboard

Challenge: Medical reasoning models are constrained by parametric knowledge and can induce hallucinations and spurious attributions.
Approach: They propose a model that uses a multi-hop med-search QA synthesis method to apply the DR paradigm in medical contexts.
Outcome: The proposed model outperforms larger medical reasoning models on medical benchmarks.
Active Sentence Learning by Adversarial Uncertainty Sampling in Discrete Space (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing uncertainty sampling methods are time-consuming and can't be executed frequently.
Approach: They propose adversarial uncertainty sampling in discrete space to find informative unlabeled text samples for annotation using adversarials.
Outcome: The proposed approach outperforms baselines on effectiveness on five datasets.
Why Do More Experts Fail? A Theoretical Analysis of Model Merging (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for model merging struggle to maintain performance gains as the number of merged models increases.
Approach: They propose a Reparameterized Heavy-Tailed method to extend the merged model’s coverage and enhance performance.
Outcome: The proposed method extends the merged model’s coverage and enhances performance on 19 benchmarks, including knowledge-intensive and general-purpose tasks.
Cognitive-Level Adaptive Generation via Capability-Aware Retrieval and Style Adaptation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models struggle to adapt content to users with differing cognitive capacities, leading to cognitive misalignment.
Approach: They propose a cognitive-level alignment framework that aligns both knowledge complexity and presentation style with user cognition.
Outcome: The proposed framework aligns knowledge complexity and presentation style with user cognition.
Large Language Model-based Human-Agent Collaboration for Complex Task Solving (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in large language models have led to the development of LLM-based autonomous agents.
Approach: They propose a Reinforcement Learning-based Human-Agent Collaboration method which trains a policy model to determine the most opportune stages for human intervention within the task-solving process.
Outcome: The proposed method improves human-agent collaboration significantly through well-planned, limited human intervention.
Token-level Inference-Time Alignment for Vision-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) often prioritize linguistic fluency over visual fidelity . despite widespread adoption, VLMs often exhibit a critical failure mode: hallucination .
Approach: They propose a framework for Token-level Inference-Time Alignment that steers the decoding process without updating the base model parameters.
Outcome: The proposed framework improves performance on 13 benchmarks across architectures . it boosts LLaVA-1.5-7B by 8.6% on MMVet and achieves a 74.0 MMStar score .
DialogUSR: Complex Dialogue Utterance Splitting and Reformulation for Multiple Intent Detection (2022.findings-emnlp)

Copied to clipboard

Challenge: DialogUSR is a plug-in and domain-agnostic module that empowers multi-intent detection for chatbots . a single user query triggers inquiries on highspeed train ticket price and weather of destination.
Approach: They propose a dialog utterance splitting and reformulation task that splits multi-intent user query into multiple single-intention sub-queries and recovers all coreferred and omitted information in the sub-questions.
Outcome: The proposed model can be used to split multi-intent user queries into multiple sub-queries . it can be trained in two stages and perform in-depth analyses on the proposed models .
GenPT: Beyond Self-Report for Reliable LLM Psychometrics via Generative Projective Testing (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) inherit contamination from training corpora, directional bias under social-desirability framing, and limited responsiveness to context beyond the item text.
Approach: They propose a paradigm that reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
Outcome: The proposed paradigm reformulates TAT, Rorschach, and SCT with newly generated stimuli and organises assessment as a three-stage pipeline.
MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation (2023.acl-long)

Copied to clipboard

Challenge: MMDialog is a dataset of 1.08 million real-world dialogues with 1.53 million unique images across 4,184 topics.
Approach: They propose to use a curated set of 1.08 million dialogues with 1.53 million unique images to generalize the open domain.
Outcome: The proposed system can predict responses to multi-modal content with state-of-the-art techniques and measure their performance.
LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for agentic programming in long-horizon command-line interface tasks are limited by short task horizons, data contamination from GitHub scraping, and a lack of fine-grained evaluation metrics.
Approach: They propose a benchmark to evaluate agentic capabilities across long-horizon command-line interface tasks.
Outcome: The proposed benchmarks cover four engineering categories: from scratch, feature addition, bug fixing, and refactoring.
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Existing work on augmenting question answering models with external knowledge (e.g., knowledge graphs) lacks transparency into the model’s prediction rationale.
Approach: They propose a knowledge-aware approach that equips pre-trained language models with a multi-hop relational reasoning module that performs multi-relational reasoning over subgraphs extracted from external knowledge graphs.
Outcome: The proposed model performs multi-hop, multi-relational reasoning over subgraphs extracted from external knowledge graphs.
RAAMove: A Corpus for Analyzing Moves in Research Article Abstracts (2024.lrec-main)

Copied to clipboard

Challenge: RAAMove is a comprehensive multi-domain corpus dedicated to the annotation of move structures in Research Article (RA) abstracts.
Approach: They propose a multi-domain corpus dedicated to the annotation of move structures in RA abstracts.
Outcome: The proposed corpus is based on a human-annotated dataset and a BERT-based model to verify its effectiveness.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)

Copied to clipboard

Challenge: Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems.
Approach: They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance.
Outcome: The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist.
Visually-Guided Policy Optimization for Multimodal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing RLVRs lack visual faithfulness due to text-dominated reasoning . a novel framework to reinforce visual focus during policy optimization is proposed .
Approach: They propose a framework to reinforce visual focus during policy optimization using visual attention compensation mechanism.
Outcome: The proposed framework exhibits better visual activation and superior performance in multimodal reasoning and visual-dependent tasks.
Telling the Whole Story: A Manually Annotated Chinese Dataset for the Analysis of Humor in Jokes (D19-1)

Copied to clipboard

Challenge: Humor plays important role in human communication, which makes it important problem for natural language processing.
Approach: They propose a novel annotation scheme to give scenarios of how humor arises in text . they report reasonable agreement between annotators and analyze the dataset .
Outcome: The proposed scheme gives scenarios of how humor arises in text . it contains key words that trigger humor, character relationship, scene, and humor categories .
A Timestep aware Sentence Embedding and Acme Coverage for Brief but Informative Title Generation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods for title generation are based on timestep aware sentence embeddings, but they are not effective for generating a title with appropriate information in the content.
Approach: They propose a Timestep aware Sentence Embedding mechanism which refreshes the sentences’ embeddings with corresponding key words in different decoding timesteps.
Outcome: The proposed framework outperforms existing methods on various title generation tasks and the evaluation scores are significantly higher than previous approaches.
Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMs (2025.coling-main)

Copied to clipboard

Challenge: Existing solutions to alleviate hallucination have considered utilizing LLMs’ inherent reasoning abilities to alleviating hallucinism, such as self-correction and diverse sampling methods.
Approach: They propose a counterfactual multi-agent debate framework that predetermines LLMs' stances to override their inherent biases for answer inspection.
Outcome: Extensive experiments on four datasets of three tasks demonstrate the superiority of the proposed framework over existing methods.
Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator (2023.findings-acl)

Copied to clipboard

Challenge: Existing transformer models are computationally demanding and prohibitively costly for long sequences due to the quadratic complexity of its selfattention module.
Approach: They propose a transformer-based model that inherits weights from large pretrained models by removing redundancies in hidden sequences using the ready-made Fast Fourier Transform operator.
Outcome: The proposed model outperforms the standard BART model on the long-range modeling benchmark LRA with significant improvements in speed and space.
Robust Dialogue State Tracking with Weak Supervision and Sparse Data (2022.tacl-1)

Copied to clipboard

Challenge: Generalizing dialogue state tracking (DST) to new data and domains is especially challenging due to the strong reliance on abundant and fine-grained supervision during training.
Approach: They propose a training strategy to build extractive DST models without the need for fine-grained manual span labels.
Outcome: The proposed model improves robustness against sample sparsity, new concepts, and topics, leading to state-of-the-art performance on a range of benchmarks.
ORANGE: Text-video Retrieval via Watch-time-aware Heterogeneous Graph Contrastive Learning (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for text-video retrieval focus on informative representations and delicate matching mechanisms, but real-world scenarios often involve brief, ambiguous queries and low-quality videos.
Approach: They propose a novel method to learn informative embeddings for queries and videos . they use a watch-time-aware contrastive learning paradigm to capture dependencies .
Outcome: The proposed method is effective in a real-world video-search service.
MC2: Towards Transparent and Culturally-Aware NLP for Minority Languages in China (2024.acl-long)

Copied to clipboard

Challenge: MC2 is the largest open-source corpus of minority languages in china . MC2, however, includes four underrepresented languages: Tibetan, Uyghur, Kazakh, and Mongolian .
Approach: They propose a multilingual corpus of minority languages in China that includes four underrepresented languages . they prioritize accuracy while enhancing diversity by using a quality-centric approach .
Outcome: The proposed model prioritizes accuracy while enhancing diversity, the authors say . MC2 includes four underrepresented languages: Tibetan, Uyghur, Kazakh, and Mongolian .
WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Recent code large language models have demonstrated impressive performance on code-related tasks.
Approach: They propose a paradigm that learns from expert battles to address these limitations . they create an arena where leading LLMs challenge each other with evaluations .
Outcome: The proposed model improves on existing models by leveraging expert battles . it achieves state-of-the-art performance even without relying on proprietary models .
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for conditional question answering struggle with finding probable answers and identifying missing conditions.
Approach: They propose a conditional question answering prompting approach that first identifies all conditions and constructs their logical relationships explicitly according to the document, then verifyes whether these conditions are satisfied and finally solves the logical expression to indicate any missing conditions.
Outcome: The proposed method outperforms existing prompting baselines on two CQA benchmark datasets and can facilitate GPT-3.5-Turbo or GPT-4 to outperFORM all existing supervised models.
SCALAR: Scientific Citation-based Live Assessment of Long-context Academic Reasoning (2026.eacl-long)

Copied to clipboard

Challenge: Long-context understanding is a critical capability for large language models . evaluating this capability requires extensive human annotation, which is time-consuming and costly.
Approach: They propose a benchmark to assess citation-grounded long-context reasoning in academic writing.
Outcome: The proposed benchmark compares state-of-the-art models with human experts on two tasks . human experts achieve 90% accuracy, but most models struggle with the cloze-style task .
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence? (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing LLMs' abilities to detect evidence in long contexts are far inferior to humans.
Approach: They propose a benchmark to assess LLMs' abilities in evidence and multi-step commonsense reasoning within a long context.
Outcome: The proposed method improves the performance of LLMs in evidence detection and commonsense reasoning.
Arxiv Copilot: A Self-Evolving and Efficient LLM System for Personalized Academic Assistance (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing solutions for document QA fail to provide personalized and up-to-date information efficiently.
Approach: They propose to deploy a self-evolving, efficient LLM system that can offer personalized research services, maintaining a real-time updated database.
Outcome: The proposed system saves 69.92% of time after efficient deployment.
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
Trustworthy and Explainable Causal Representation Learning in Transformers (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to interpretable representation learning rely on masks that weight the significance of input features, but the origin of these masks is uncertain.
Approach: They propose a causal framework that directly learns identifiable representations from attention weights rather than relying on importance masks.
Outcome: The proposed framework learns identifiable and explainable representations from attention weights, rather than masks, and guarantees faithfulness on real-world datasets.
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information (2020.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training methods are not effective for machine translation tasks.
Approach: They propose a method to pre-train a universal multilingual neural machine translation model . they use random aligned substitution technique to bring words and phrases with similar meanings closer in the representation space.
Outcome: The proposed approach improves translation quality on low, medium, rich resource languages.
CLARity: Reasoning Consistency Alone Can Teach Reinforced Experts (2026.acl-long)

Copied to clipboard

Challenge: Existing solutions to supervise the reasoning process are prohibitively expensive.
Approach: They propose a cost-effective reinforcement learning framework that enhances reasoning quality using a small, general-purpose LLM only.
Outcome: Experiments show that CLARity improves reasoning quality by 16.5% over standard outcome-based reinforcement learning (RL) human evaluations confirm substantial gains in factual correctness and reasoning coherence, leading to more trustworthy model outputs.
Operation-guided Neural Networks for High Fidelity Data-To-Text Generation (D18-1)

Copied to clipboard

Challenge: Recent neural models for data-to-text generation generate descriptions that are not consistent with structured data.
Approach: They propose a framework for data-to-text generation that uses symbolic operations to generate texts from structured data.
Outcome: The proposed framework improves the fidelity of the generated texts to the input structured data.
RelCLIP: Adapting Language-Image Pretraining for Visual Relationship Detection via Relational Contrastive Learning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing visual relationship detection models only use numeric ids of relation labels for training, but ignore semantic correlation between labels.
Approach: They propose a visual Relationship prediction framework that transfers natural language knowledge from Contrastive Language-Image Pre-training models to enhance the relationship prediction.
Outcome: The proposed framework improves visual relationship prediction by matching semantic correlations with relation triplets.
A Confidence-based Acquisition Model for Self-supervised Active Learning and Label Correction (2025.tacl-1)

Copied to clipboard

Challenge: Existing approaches to training deep neural networks require large amounts of meticulously annotated data.
Approach: They propose a pool-based active learning framework that requires expert annotators to label only a fraction of a sequence and facilitates self-supervision for the remainder of the sequence.
Outcome: The proposed model outperforms baselines on dialogue belief tracking tasks.
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing tools for building TOD systems often lack a user-friendly interface . a toolkit with advanced, easily integrable modules is needed to bridge this gap .
Approach: They propose a multifaceted dialogue system toolkit that integrates diverse datasets and models with a streamlined training process and in-depth evaluation tools.
Outcome: The proposed toolkit combines RL and transfer learning to support the rapid development and evaluation of robust dialogue policies.
Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books (2025.acl-long)

Copied to clipboard

Challenge: Using code rules improves rule retrieval and application of grammar books in low-resource languages.
Approach: They propose to decompose a grammar rule retrieval and application step into two steps . they propose to represent grammar rules as code functions to facilitate LLM reasoning .
Outcome: The proposed model significantly boosts rule retrieval and application, resulting in 13.1% BLEU improvement.
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues (2022.acl-long)

Copied to clipboard

Challenge: Existing work in vision language cross-modal reasoning uses binary or multi-choice classification based on source image and textual query.
Approach: They propose a task where a textual premise is the background presumption on each source image.
Outcome: The proposed task is based on a dataset of 15,360 movie screenshots and human-curated premise templates from 6 pre-defined categories.
Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing studies focus on contrastive learning on the instance level without discriminating the contribution of each word.
Approach: They propose a hierarchical contrastive learning mechanism which can unify semantic meaning in the input text.
Outcome: The proposed model outperforms baselines on storytelling, paraphrasing, dialogue generation, and storytelling tasks.
UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing legal benchmarks focusing on knowledge and logic evaluate LLMs on various tasks in legal domain, but few have explored the practical application of LLM by actual users.
Approach: They propose a Chinese user-centric legal benchmark that aims to assess the practical application of LLMs by real users.
Outcome: The proposed model outperforms existing models on various tasks in legal domain but does not outperfect ChatGPT.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
Learning Logic Rules for Document-Level Relation Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for document-level relation extraction relied on implicitly powerful representations, which makes the model less transparent.
Approach: They propose a probabilistic model for document-level relation extraction by learning logic rules.
Outcome: The proposed model outperforms baseline models in relation performance and logical consistency.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention (P18-2)

Copied to clipboard

Challenge: Experimental results show the effectiveness of our slot filling model at addressing the OOV problem.
Approach: They propose a generative neural network model for slot filling based on a sequence-to-sequence model and a pointer network.
Outcome: The proposed model is able to predict slot values on spoken language data.
LLMEdgeRefine: Enhancing Text Clustering with LLM-Based Boundary Point Refinement (2024.emnlp-main)

Copied to clipboard

Challenge: LLMEdgeRefine is an iterative clustering method enhanced by large language models . existing clustering methods struggle with domain-specific fine-tuning and outliers .
Approach: They propose an iterative clustering method enhanced by large language models focusing on edge points refinement . authors propose to use LLMs to iterate clusters and iterating to improve semantic coherence .
Outcome: The proposed method outperforms state-of-the-art methods and offers robustness, adaptability, and cost-efficiency for diverse text clustering applications.
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text.
Approach: They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity.
Outcome: The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity.
MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for text-to-audio-video (T2AV) generation are largely designed for human-recorded videos or single-speaker settings.
Approach: They propose a failure-driven diagnostic benchmark for multi-talker dialogue-centric audio-video generation.
Outcome: The benchmark evaluates multi-speaker dialogue generation at four levels: audio-visual signal fidelity, temporal attribute consistency, social interaction, and cinematic expression.
Enhancing Large Vision-Language Models with Ultra-Detailed Image Caption Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing pipelines for generating high-quality, ultra-detailed image captions are limited by the scarcity of image caption data.
Approach: They propose a pipeline for generating high-quality, ultra-detailed image captions that integrates both pre-processing and post-processor stages.
Outcome: The proposed pipeline improves LVLMs' perception and cognitive abilities across multiple vision-language benchmarks.
Autonomous Aspect-Image Instruction a2II: Q-Former Guided Multimodal Sentiment Classification (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to identify sentiment polarities of aspects are limited by the limited multimodal data available.
Approach: They propose to use instruction tuning paradigm to combine language and vision data to combine text and image modalities.
Outcome: The proposed model achieves state-of-the-art on benchmark datasets and in few-shot settings.
EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion Recognition in Task-Oriented Dialogue Systems (2022.lrec-1)

Copied to clipboard

Challenge: Existing emotion-annotated task-oriented corpora are limited in size, label richness, and public availability, creating a bottleneck for downstream tasks.
Approach: They propose a large-scale manually emotion-annotated corpus of task-oriented dialogues based on a multi-domain task-orientated dataset.
Outcome: The proposed method is based on a task-oriented dialogue dataset with 11K dialogues and 83K emotion annotations of user utterances.
ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity? (2023.acl-short)

Copied to clipboard

Challenge: Recent research on dialog state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas.
Approach: They propose to use schema descriptions to facilitate zero-shot transfer to new domains . they argue that general purpose language models lack the ability to replace specialized systems .
Outcome: The proposed method achieves state-of-the-art in zero-shot DST with in-context learning capabilities.
SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Distantly-Supervised Named Entity Recognition (DS-NER) is widely used in the supervised setting, but the context-free matching process and the limited coverage of knowledge bases introduce inaccurate and incomplete annotation noise respectively.
Approach: They propose to handle two types of noise separately with Memory-smoothed Focal Loss and Entity-aware KNN to relieve the entity ambiguity problem caused by inaccurate annotation and a noise-tolerant loss to improve the model’s robustness.
Outcome: The proposed model achieves a new state-of-the-art on five public datasets.
HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies show that large language models are robust in commonsense reasoning . however, some variations in questions can lead to incorrect responses .
Approach: They propose a large-scale bilingual benchmark consisting of 11,200 cases . they conduct extensive experiments on 41 representative LLMs .
Outcome: The proposed benchmark systematically evaluates the robustness of large language models in commonsense reasoning.
FedCSR: A Federated Framework for Multi-Platform Cross-Domain Sequential Recommendation with Dual Contrastive Learning (2025.coling-main)

Copied to clipboard

Challenge: Existing federated frameworks for cross-domain sequential recommendation rely on user alignment, which increases communication costs and privacy risks.
Approach: They propose a federated cross-domain sequential recommendation framework that eliminates the need for user alignment between platforms.
Outcome: The proposed framework eliminates the need for user alignment between platforms.
MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities.
Approach: They propose a competition-based benchmark framework specifically designed to assess LLMs within multi-agent environments.
Outcome: The proposed framework enhances the LLMs’ abilities in navigating complex social and cognitive dimensions by over threefold between the strongest and weakest LLM models.
VIEWS: Entity-Aware News Video Captioning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing video captioning benchmarks and models produce generic captions for videos that lack specific identification of individuals, locations, or organizations.
Approach: They propose a task of directly summarizing news videos into captions that are entity-aware . they validate the effectiveness of their approach across three video captioning models .
Outcome: The proposed approach is effective across three video captioning models.
Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors (2025.acl-long)

Copied to clipboard

Challenge: Metaphors are pervasive in communication, making them crucial for natural language processing.
Approach: They propose a multicultural multimodal metaphor dataset designed for cross-cultural studies of metaphor in Chinese and English.
Outcome: The proposed model improves metaphor comprehension across cultural backgrounds and cultural domains.
SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model (2025.naacl-long)

Copied to clipboard

Challenge: Fine-tuning requires substantial computational resources and is prone to overfitting when applied to small datasets.
Approach: They propose a parameter-efficient fine-tuning method that integrates a State Space Model (SSM) to interconnect low-rank matrices.
Outcome: The proposed method achieves comparable performance to LoRA on the general language understanding evaluation (GLUE) benchmark while using only half the parameters.
DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for reconstruction of large language models overlook diversity among experts, leading to potential redundancy.
Approach: They propose a pruning-based expert reconstruction method that prunes a specific LLM and retrains it on routers, experts and normalization modules.
Outcome: The proposed method outperforms pruning and MoE reconstruction methods on Llama-style models with open-source training corpora.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) integrate visual and textual inputs, yet modality alignment remains one of the most challenging aspects.
Approach: They propose a token-level supervision alignment method that enables more precise visual-text alignment during pretraining.
Outcome: The proposed method improves performance across various model sizes, with smaller models benefiting the most.
Efficient Low-Resource Language Adaptation via Multi-Source Dynamic Logit Fusion (2026.acl-long)

Copied to clipboard

Challenge: Proxy Tuning offers a logit-level strategy for introducing scaling effects, but it often fails in LRL settings because the large model’s weak LRL competence might overwhelm the knowledge of specialized smaller models.
Approach: They propose a logit-based framework that balances LRL competence from a continually pretrained small model, task competence from high-resource language instruction tuning, and the scaling benefits of large models.
Outcome: Experiments across four model families and eight LRLs show that TriMix outperforms single-model baselines and Proxy Tuning.
Token-level Proximal Policy Optimization for Query Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have improved search engines and recommendation systems through their text understanding capabilities.
Approach: They propose a token-level proximal policy optimization approach to empower LLMs to perform better in query generation through fine-tuning.
Outcome: The proposed approach outperforms existing LLMs on an open-source and industrial dataset.
Disentangling Reasoning Tokens and Boilerplate Tokens For Language Model Fine-tuning (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to enhance agent capabilities for Large Language Models treat all tokens equally . however, reasoning tokens versus boilerplate tokens differ in importance and learning complexity . recent research has focused on enhancing agent capabilities in large language models .
Approach: They propose a Shuffle-Aware Discriminator (SHAD) for adaptive token discrimination . they propose SHAD method which adaptively emphasizes reasoning tokens during fine-tuning .
Outcome: The proposed method improves performance over standard fine-tuning methods.
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)

Copied to clipboard

Challenge: Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis.
Approach: They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge.
Outcome: The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks.
CreditDecoding: Accelerating Parallel Decoding in Diffusion Large Language Models with Trace Credit (2026.acl-long)

Copied to clipboard

Challenge: Diffusion large language models generate text through iterative denoising with bidirectional attention, enabling richer contextual dependencies.
Approach: They propose a training-free parallel decoding method that fuses Trace Credit with current logits to boost the confidence of correct but underconfident tokens.
Outcome: The proposed method achieves 5.48 times speedup with +0.48 accuracy on LLaDA-8B and is orthogonal to mainstream inference optimizations.
A Simple Recipe towards Reducing Hallucination in Neural Surface Realisation (P19-1)

Copied to clipboard

Challenge: Recent neural language generation systems often hallucinate contents when trained on loosely corresponding pairs of the input structure and text.
Approach: They propose to integrate a language understanding module for data refinement with self-training iterations to induce strong equivalence between the input data and the paired text.
Outcome: Experiments on the E2E challenge dataset show that the proposed framework reduces relative unaligned noise by 50% compared with the current state-of-the-art ensemble generator.
Breaking Block Boundaries: Anchor-based History-stable Decoding for Diffusion Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Semi-autoregressive (Semi-AR) decoding suffers from inherent block constraints . naive lookahead decoding is unreliable, token stability closely correlates with convergence trend, and historical information is isolated.
Approach: They propose a training-free, plug-and-play dynamic decoding strategy that monitors the stability of tokens in real time through dynamic anchors.
Outcome: The proposed approach reduces decoding steps by 80% while improving performance by 3.67% on the BBH benchmark.
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach: They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome: The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.
PaSa: An LLM Agent for Comprehensive Academic Paper Search (2025.acl-long)

Copied to clipboard

Challenge: We introduce PaSa, an advanced Paper Search agent powered by large language models . despite being trained on synthetic data, PaSA outperforms existing baselines on RealScholarQuery .
Approach: They introduce PaSa, an advanced Paper Search agent powered by large language models . they optimize PaSA using a synthetic dataset, AutoScholarQuery, which includes 35k fine-grained queries .
Outcome: The paper analyzes the performance of a paper search agent using a synthetic dataset . it significantly outperforms existing benchmarks on RealScholarQuery .
Generalized Category Discovery with Large Language Models in the Loop (2024.findings-acl)

Copied to clipboard

Challenge: Generalized Category Discovery (GCD) is a crucial task that aims to recognize both known and novel categories from a set of unlabeled data.
Approach: They propose a framework that introduces Large Language Models into the training loop to generate category names without human effort.
Outcome: The proposed framework outperforms SOTA models on three benchmark datasets and generates accurate category names for the discovered clusters.
Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have produced significant advances in the field of recommender systems.
Approach: They propose to retrieve up-to-date structure information from the knowledge graph to augment recommendations by leveraging external knowledge sources.
Outcome: Experiments on a large dataset show that the proposed method is effective in enhancing LLM-based recommendations.
Understanding LLMs’ Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From (2025.emnlp-main)

Copied to clipboard

Challenge: Cross-lingual context retrieval is a fundamental aspect of cross-lingual alignment, but the performance and mechanism of it for large language models (LLMs) remains unclear.
Approach: They evaluate cross-lingual context retrieval of over 40 large language models . they use cross-linguistic machine reading comprehension as a representative scenario .
Outcome: The results show that open LLMs show strong cross-lingual context retrieval ability . the results also show that their oracle performances improve after training .
Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance (2021.emnlp-main)

Copied to clipboard

Challenge: Neural dialogue belief trackers that take uncertainty into account are often overconfident in their decisions and therefore less robust.
Approach: They propose to use different uncertainty measures in neural belief tracking to integrate uncertainty into the feature space of the policy and train policies through interaction with a user simulator.
Outcome: The proposed approach improves both performance and robustness of the downstream dialogue policy.
HoWToBench: Holistic Evaluation for LLM’s Capability in Human-level Writing using Tree of Writing (2026.acl-long)

Copied to clipboard

Challenge: Evaluating the writing capabilities of large language models remains a significant challenge due to the multidimensional nature of writing skills and the limitations of existing metrics.
Approach: They propose to model the aggregation weights of sub-features in a tree-structured workflow and propose a Chinese writing benchmark that mitigates biases.
Outcome: The proposed tree-of-writing (ToW) measures the writing capabilities of large language models (LLMs) in Chinese and shows that it mitigates biases and achieves a *0.93* Pearson correlation with human judgments.
Teaching Large Language Models an Unseen Language on the Fly (2024.findings-acl)

Copied to clipboard

Challenge: Existing large language models struggle to support numerous low-resource languages . Existing models lack sufficient training data for effective parameter updating .
Approach: They propose a framework for adapting LLMs to unseen languages by in-context learning.
Outcome: The proposed framework improves Chinese-to-Zhuang translation performance and Zhuan-to Chinese translation performance.
MAPLE: Enhancing Review Generation with Multi-Aspect Prompt LEarning in Explainable Recommendation (2025.acl-long)

Copied to clipboard

Challenge: Existing models that generate generic aspects do not provide personalized informative recommendations.
Approach: They propose a model that integrates aspect category as another input dimension to facilitate memorizing fine-grained aspect terms.
Outcome: The proposed model outperforms baseline model on restaurant review datasets in the restaurant domain.
NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs (2026.acl-long)

Copied to clipboard

Challenge: Large language models have significantly advanced Multilingual Machine Translation (MMT) yet scaling to many languages while maintaining robust performance across directions remains challenging.
Approach: They propose a strategy to reduce the number of translations in one direction . they propose auxiliary parallel sentences to promote cross-lingual transfer .
Outcome: The proposed model performs on par with or better than substantially larger baselines.
PuzzleGPT: Emulating Human Puzzle-Solving Ability for Time and Location Prediction (2025.findings-naacl)

Copied to clipboard

Challenge: PuzzleGPT is a modular and iterative puzzlesolving method for predicting time and location from images.
Approach: They propose to formalize this ability into core skills and implement it using different modules in an expert pipeline called PuzzleGPT.
Outcome: The proposed method outperforms large VLMs and finetuned models on TARA and WikiTilo and rivals or surpasses finetuned models.
Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on prompt engineering or framework scheduling of one/multiple LLMs.
Approach: They propose to integrate LLMs as agents into their training corpus by decomposition and redesigning the training corpu . they propose to use LLM-FLAN to effectively fine-tune LANguage models for Agents by reducing hallucinations.
Outcome: The proposed model outperforms prior best models by 3.5% across agent evaluation datasets.
InTriage: Intelligent Telephone Triage in Pre-Hospital Emergency Care (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing TT processes face challenges such as incomplete data collection, communication barriers, and manual errors, leading to high over-triage and under-triages rates.
Approach: They propose to use an AI-driven multilingual TT system to provide decision support for triage.
Outcome: The proposed system achieves word error rate of 14.57% for speech recognition and an F1 score of 73.34% for key information extraction.
StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation (2024.findings-acl)

Copied to clipboard

Challenge: Current evaluations for large language models use a single-item assessment paradigm . current evaluations struggle to discern whether a model possesses the required capabilities or merely memorizes/guesses the answers to specific questions.
Approach: They propose a framework to evaluate large language models using atomic test objectives.
Outcome: The proposed evaluation framework resists data contamination and reduces interference of potential biases, and sheds light on the design of future principled and trustworthy LLM evaluation protocols.
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting (2025.findings-acl)

Copied to clipboard

Challenge: Current document image parsing solutions rely on specialized models or generate content autoregressively.
Approach: They propose a multimodal document image parsing model that integrates specialized models with autogeneous content generation.
Outcome: The proposed model achieves state-of-the-art performance across diverse page-level and element-level settings while ensuring superior efficiency.
Crab: A Novel Configurable Role-Playing LLM with Assessing Benchmark (2025.acl-long)

Copied to clipboard

Challenge: Existing RP-LLMs employ only a single role with numerous dialogues, but Crab enables dynamic configuration of desired roles, thereby enhancing related flexibility and adaptability.
Approach: They propose a Configurable Role-Playing LLM with Assessing Benchmark that combines a Role dataset curation, persona-emodying Llm construction, and comprehensive benchmark creation for RP dialogue generation.
Outcome: The proposed model outperforms existing LLMs in performing fine-grained evaluations of RP while keeping dialogue per role minimal.
CBP-Tuning: Efficient Local Customization for Black-box Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Customized black-box prompt tuning is a new approach to customize large language models . however, as models grow, the resources required for training and deployment become increasingly expensive .
Approach: They propose a framework that facilitates efficient local customization while preserving bidirectional privacy.
Outcome: The proposed framework facilitates efficient local customization while preserving bidirectional privacy.
T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step (2024.acl-long)

Copied to clipboard

Challenge: Existing studies evaluate the tool utilization ability of large language models based on the final output or only consider the single-step tool calling.
Approach: They propose a new approach to evaluate the tool utilization capability of large language models (LLMs) they decompose the tool usage into multiple sub-processes, including instruction following, planning, reasoning, retrieval, understanding, and review.
Outcome: The proposed model exhibits consistency with the outcome-oriented evaluation and provides a more fine-grained analysis of the capabilities of LLMs.
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding (2024.findings-acl)

Copied to clipboard

Challenge: Existing autoregressive models generate tokens sequentially and are memory-bound, resulting in a memory-based inference stage that is memory-limited.
Approach: They propose an approach to accelerate the inference speed of large language models with billions of parameters by integrating semi-autoregressive inference and speculative decoding capabilities.
Outcome: The proposed approach has demonstrated inference speedups of 2.7x-4.0x on humanEval-X while maintaining output quality.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations