Papers by Liang Jiang

82 papers
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)

Copied to clipboard

Challenge: Current multimodal large language models (MLLMs) show limited understanding of dental images.
Approach: They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning.
Outcome: The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks.
Synergizing Large Language Models and Pre-Trained Smaller Models for Conversational Intent Discovery (2024.findings-acl)

Copied to clipboard

Challenge: Current attempts at CID rely on pretrained Small Language Models (SLMs) this lacks the ability to label new intents and is a challenge for small language models.
Approach: They propose to combine Large Language Models (LLMs) with pre-trained SLMs for CID to enhance the semantic comprehension of LLMs.
Outcome: The proposed approach improves the semantic comprehension of LLMs and the operational agility of SLMs by realigning existing descriptors within the SLM’s feature space to correct cluster distortion and promote robust learning of representations.
Reason from Fallacy: Enhancing Large Language Models’ Logical Reasoning through Logical Fallacy Understanding (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but struggle with some more complex reasoning tasks including logical reasoning.
Approach: They propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW to evaluate LLMs’ capability of logical fallacy understanding.
Outcome: The proposed dataset can be used to evaluate LLMs’ LFU capability and to fine-tune LLM models to obtain significantly enhanced performance on logical reasoning.
SDBench: A Survey-based Domain-specific LLM Benchmarking and Optimization Framework (2025.acl-long)

Copied to clipboard

Challenge: acquiring domain-specific knowledge often requires professional expert manpower.
Approach: They propose a generic framework for generating evaluation datasets for domain-specific LLMs.
Outcome: The proposed framework reduces the reliance on expert manpower while ensuring that the collected data is uniformly distributed.
Can Language Models Replace Programmers for Coding? REPOCOD Says ‘Not Yet’ (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for code generation use short completions, synthetic examples, or focus on limited scale repositories, failing to represent real-world coding tasks.
Approach: They propose a Python code-generation benchmark that contains 980 whole-function generation tasks with realistic dependencies from 11 popular projects.
Outcome: The proposed benchmarks are short completions, synthetic examples, or focus on limited scale repositories, failing to represent real-world coding tasks.
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)

Copied to clipboard

Challenge: Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications.
Approach: They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios.
Outcome: The proposed model improves on baselines in short and long distance reasoning scenarios.
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks (D19-1)

Copied to clipboard

Challenge: Existing models that can handle cross-lingual tasks with limited or no training data are insensitive to different languages.
Approach: They propose to use Unicoder to train models in one language and apply it to other languages.
Outcome: Experiments show that Unicoder learns the mappings among different languages from more perspectives.
Immediate Inference: The Missing Foundation in Large Language Model Logical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Recent work on LLMs has focused on fine-grained skill decomposition and consistency probing at the propositional level.
Approach: They propose a benchmark evaluating immediate inference that evaluates elemental operations over categorical propositions and proposes a model that uses immediate inferential reasoning.
Outcome: The proposed benchmark demonstrates that models lack robust operator grounding, oscillating between structural reasoning and surface pattern matching, inconsistent handling of quantifiers and negation.
Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability (2026.acl-long)

Copied to clipboard

Challenge: Large language models have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning, but their strictly sequential nature constrains test-time scalability.
Approach: They propose an end-to-end reinforcement learning framework to enhance LLMs' DAC-style reasoning capacity by decomposing a problem into subproblems and solving them sequentially.
Outcome: The proposed model surpasses CoT by 8.6% and 6.3% on competition-level benchmarks and is available at the [github.com/MasterVito/DAC-RL].
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adversarial regularization treat adversarials and defending players equally, which is undesirable because only the defending player contributes to the generalization performance.
Approach: They propose a method which formulates adversarial regularization as a Stackelberg game and induces a competition between a leader and a follower.
Outcome: The proposed method outperforms existing adversarial regularization baselines on a set of machine translation and natural language understanding tasks.
AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models (LRMs) generate coherent reasoning paths before conclusions, but they introduce new vulnerabilities.
Approach: They propose a framework that leverages a weaker but less-aligned model to simulate execution reasoning for initial hijacking attempts and iteratively refines attacks by exploiting reasoning patterns leaked through the target LRM’s refusals.
Outcome: The proposed framework achieves 100% success rate within one or few turns, neutralizing reasoning-based defenses even when evaluated by robustly aligned external models.
Beyond Memorization: The Challenge of Random Memory Access in Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in Language Models (LMs) have shown their effectiveness in knowledge-intensive tasks.
Approach: They investigate whether a generative language model is able to access its memory sequentially or randomly.
Outcome: The proposed LMs are able to access memory sequentially or randomly.
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks.
Approach: They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes.
Outcome: The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset.
Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translation (2024.findings-emnlp)

Copied to clipboard

Challenge: Neural machine translation (NMT) is pivotal for crosslingual conversation and trade . traditional solutions that penalize text redundancy or token reoccurrence have shown limited efficacy .
Approach: They propose an algorithm that modulates suppression of tokens dynamically, informed by attention weights and inter-token distances.
Outcome: The proposed algorithm outperforms existing methods in precision and generalizability.
CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing concept reasoning related datasets suffer from modeledge leakage and context leakage.
Approach: They propose a concept reasoning for large language models with modeledge leakage prevention and context leakage preventive methods to improve the models' conceptual reasoning abilities.
Outcome: The proposed method significantly improves the existing models and reasoning methods, achieving a 7% increase in accuracy compared to CoT and showing better granularity.
Beyond Screenshots: Evaluating VLMs’ Understanding of UI Animations (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies of Vision Language Models (VLMs) for UI understanding have focused primarily on static screenshots, leaving it unclear how well these models handle dynamic UI animations.
Approach: They evaluate UI animation models' ability to perceive animation effects and interpret animation meaning . they use motion, context, and perceptual cues to probe factors affecting VLM performance .
Outcome: The proposed model can detect primitive motion, but its interpretation is inconsistent . the proposed model is based on 300 annotated UI animation videos .
Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: Recent approaches to fine-tuning of large language models suffer from task interference and catastrophic forgetting.
Approach: They propose a fine-tuning framework that adapts isolation decisions based on online estimates of parameter importance.
Outcome: The proposed framework reduces interference and forgetting while releasing outdated parameters to recover plasticity.
Token-wise Curriculum Learning for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of “easy” samples from training data at the early stage of training.
Approach: They propose a token-wise curriculum learning approach that creates sufficient amounts of easy samples from training data.
Outcome: The proposed approach outperforms baselines on five language pairs on low-resource languages.
Mapping natural language commands to web elements (D18-1)

Copied to clipboard

Challenge: a dataset of over 50,000 natural language commands captures various phenomena, including functional references, relational reasoning, and visual reasoning.
Approach: They propose a task that requires the user to choose the correct element on a web page . they use a dataset of over 50,000 natural language commands to map these to web pages .
Outcome: The proposed task can be viewed as a reference game based on a dataset of over 50,000 natural language commands .
Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Incomplete learning is widespread and heterogeneous in large language models . authors identify five recurrent sources of incomplete learning: missing prerequisite knowledge, conflicts between SFT supervision and pre-training knowledge, internal inconsistencies within SFT data, left-side forgetting during sequential fine-tuning, and insufficient optimization for rare or complex patterns.
Approach: They propose a diagnostic-first framework that maps incomplete learning to causes . they identify five recurrent sources of incomplete learning: missing prerequisite knowledge, conflicts between supervision and pre-training knowledge, internal inconsistencies, left-side forgetting during sequential fine-tuning, and insufficient optimization for rare or complex patterns.
Outcome: The proposed framework maps incomplete learning to causes using observable training and inference signals.
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (2021.acl-long)

Copied to clipboard

Challenge: 'lottery tickets' can be trained to match the performance of a full model . subnetwork training can also outperform random sampled subnetworks of the same size .
Approach: They propose to train a subnetwork of 'lottery tickets' to match the full model's performance.
Outcome: The proposed model outperforms subnetworks of the same size in a phase transition phenomenon . the proposed model improves single task fine-tuning by 0.9 points on BERT-base and 1.0 points on GLUE large .
Enhancing Answer Boundary Detection for Multilingual Machine Reading Comprehension (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to improve machine reading comprehension performance on low resource languages are limited due to the lack of sufficient training data.
Approach: They propose to use a mixed MRC task to translate the question to other languages and build cross-lingual question-passage pairs.
Outcome: The proposed task improves on two cross-lingual MRC datasets.
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering (2026.acl-long)

Copied to clipboard

Challenge: Entropy-Guided Stepwise Scaling (EGSS) is a novel TTS framework for software engineering tasks.
Approach: They propose an entropy-guided stepwise scaling framework that balances efficiency and effectiveness through entropic-guide encoding and robust test-suite augmentation.
Outcome: EGSS boosts performance by 5–10% across all evaluated models, and reduces inference-time token usage by over 28% . compared to existing methods, EGS reduces token usage and reduce inference time by over 20% .
Achieving Multi-Hop Calculation and Safe Abstention in Financial Numerical Reasoning by Metric Graph Constrained LLMs (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are prone to forced generation when confronting ambiguous evidence or complex recursive dependencies.
Approach: They propose a framework that imposes semantic and structural constraints via a financial metric knowledge graph.
Outcome: a neuro-symbolic framework outperforms existing models on financial metric knowledge graphs.
A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality (2025.emnlp-main)

Copied to clipboard

Challenge: Privacy-sensitive users require deploying large language models within their own infrastructure (on-premises) vulnerabilities in local environments can lead to unauthorized access and potential model theft.
Approach: They propose a framework that secures a few bottom layers in a secure environment . they propose metric to optimize trade-off between protection and customization flexibility .
Outcome: The proposed framework outperforms baselines on five models with 1.3B to 70B parameters.
Can Language Models Follow Multiple Turns of Entangled Instructions? (2025.findings-emnlp)

Copied to clipboard

Challenge: Despite of significant achievements in improving instruction-following capabilities of large language models, the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge.
Approach: They construct multi-turn instruction with 1.1K high-quality multi-turned conversations using the human-in-the-loop approach and examine their capabilities.
Outcome: The proposed model shows that it is difficult to integrate multiple turns and balance competing objectives when instructions intersect or conflict.
Learning to Contrast the Counterfactual Samples for Robust Visual Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods of generating counterfactual samples are not fully utilized in the task of Visual Question Answering (VQA).
Approach: They propose a self-supervised contrastive learning mechanism to learn the relationship between original samples, factual samples and counterfactual samples.
Outcome: The proposed method surpasses state-of-the-art models on the VQA-CP dataset, a diagnostic benchmark for assessing the VQ model’s robustness.
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing data selection strategies for continual pre-training of large language models often rely on scarce labeled data or computationally expensive LLMs.
Approach: They propose an annotation-independent data selection framework for CPT that evaluates grammatical complexity using lexical diversity and syntactic complexity.
Outcome: The proposed framework outperforms baselines on a financial dataset and surpasses full-data training by 1.7% using only 20% of the data.
MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction (2025.emnlp-industry)

Copied to clipboard

Challenge: Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences.
Approach: They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge.
Outcome: The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge.
Improve Interpretability of Neural Networks via Sparse Contrastive Coding (2022.findings-emnlp)

Copied to clipboard

Challenge: XAI has achieved remarkable advances, but few efforts have been devoted to solving the problem.
Approach: They propose a model-agnostic explanation method termed Sparse Contrastive Coding . they use model-based explanations to explain the black-box in a more model-oriented way .
Outcome: The proposed method outperforms five state-of-the-art methods in interpretability and classification metrics.
ARCH: Efficient Adversarial Regularized Training with Caching (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to regularize models require generating a perturbation for each sample in each epoch.
Approach: They propose an adversarial regularization method where perturbations are generated and cached once every several epochs.
Outcome: The proposed method significantly eases the computational burden (saves up to 70% of computational time) it produces a notably better (in most of the tasks) or comparable model generalization.
From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalities (2025.findings-acl)

Copied to clipboard

Challenge: MLLMs are able to integrate multiple modalities into a single model to tackle complex tasks in real-world scenarios.
Approach: They propose a comprehensive survey of Omni-MLLMs to address the challenges and opportunities of multimodal modeling.
Outcome: The proposed model can integrate multiple modalities into a single model and provide novel perspectives.
Don’t Tell the Answer, Truly Guide the Reasoning During RL Rollouts (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods such as GRPO often break down when task difficulty exceeds the model’s capacity, resulting in sparse rewards and inefficient training.
Approach: They propose to measure the compatibility between external guidance and a model's intrinsic policy by introducing an adaptive framework to enhance reasoning performance while explicitly preserving high Affinity.
Outcome: The proposed framework outperforms baseline models while maintaining high Affinity.
Reason Only When Needed: Efficient Generative Reward Modeling via Model-Internal Uncertainty (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generating reward models rely on voting-based mechanisms to evaluate CoT outputs.
Approach: They propose an efficient generative reward modeling framework grounded in model-internal uncertainty.
Outcome: The proposed framework reduces inference cost while improving answer accuracy.
WAFFLE: Fine-tuning Multi-Modal Model for Automated Front-End Development (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown promise in generating source code, but two major challenges persist in UI-to-HTML code generation: (1) effectively representing HTML’s hierarchical structure for LLMs; and (2) bridging the gap between the visual nature of UI designs and the text-based format of HTML code.
Approach: They propose a structure-aware attention mechanism that uses a contrastive fine-tuning approach to align LLMs’ understanding of UI images and HTML code.
Outcome: The proposed model outperforms existing methods on the WebSight-Test and Design2Code benchmarks.
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing.
Approach: They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning.
Outcome: The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability.
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for solving geometric problems are either small in scale or not publicly available.
Approach: They propose a large-scale benchmark for geometric problem solving using formal language and symbolic reasoning.
Outcome: The proposed approach parses geometry problems into formal language and performs symbolic reasoning step by step.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability.
Approach: They propose a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training.
Outcome: The proposed framework reduces inference cost while maintaining strong reasoning ability across multiple benchmarks.
EMTIR-GRPO: Efficient Multi-Tool Augmented Large Language Models via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Tool-integrated reasoning (TIR) enables large language models to invoke external tools for tasks beyond their internal capacity but often suffers from tool overuse.
Approach: They propose an algorithm that uses a composite reward to model tool costs and tool efficiency.
Outcome: The proposed algorithm models heterogeneous tool costs and encourages more cost-effective tool-use strategies.
LLM-Driven Multi-Perspective Location Completion for Next Location Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods assume that check-in data is complete, overlooking the subjective nature of user behavior, leading to inaccurate capture of user preferences.
Approach: They propose a framework that uses spatial coordinates to augment location completion by transforming geographic coordinates into text.
Outcome: The proposed framework outperforms state-of-the-art methods on three real-world datasets.
Colloquial Singaporean English Style Transfer with Fine-Grained Explainable Control (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for style transfer between Singlish and Standard English lack explainability and fine-grained control.
Approach: They propose a multi-agent framework where large language models act as expert agents for each linguistic aspect.
Outcome: The proposed model enables precise, interpretable transformations, advancing explainability in NLP for Singlish.
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmark datasets focus on low-level cognitive tasks while providing limited coverage of higher-level reasoning skills.
Approach: They analyze the cognitive depth of popular LLM benchmarks using Bloom’s Taxonomy to evaluate both the cognitive and knowledge dimensions.
Outcome: The results show that incorporating higher-level cognitive instructions into the current instruction fine-tuning process improves model performance.
Dynamic Generation of Multi LLM Agents Communication Topologies with Graph Diffusion Models (2026.acl-long)

Copied to clipboard

Challenge: Existing frameworks rely on static or rule-based topologies that fail to adapt to task requirements.
Approach: They propose a generative framework that generates highly task-adaptive topologies . they validated the framework on multiple benchmarks and validated it on multiple platforms .
Outcome: The proposed framework outperforms existing frameworks in task-adaptive communication topologies.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to translate spoken language understanding into low-resource languages are limited to implicit alignment and disregard the inherent semantic structure in SLU.
Approach: They propose to model utterance-slot-word structure by a multi-level contrastive learning framework . they also propose a label-aware joint model leveraging label semantics to enhance alignment .
Outcome: The proposed model improves performance on two zero-shot cross-lingual datasets.
EMPATH: An Ensemble Method for Automatic Fine-Grained Turn-Level Dialogue Empathy Evaluation with a Novel Emotional Distance Metric (2026.findings-acl)

Copied to clipboard

Challenge: Empathy evaluation metrics are lacking in the competitions, and classical dialogue evaluation metrics require further investigation.
Approach: They propose a framework which combines fine-tuned models, large language models, classical dialogue evaluation metrics, and a novel metric.
Outcome: The proposed framework improves on the WASSA 2024 benchmark and shows a statistically significant 8% improvement on the EX dataset.
ToNER: Type-oriented Named Entity Recognition with Generative Language Model (2024.lrec-main)

Copied to clipboard

Challenge: Input too many potential entity types would distract the model inevitably.
Approach: They propose to use a generative model to exploit entity types' merit on promoting NER task by appending a type matching model to identify the entity types most likely to appear in the sentence.
Outcome: The proposed framework exploits entity types' merit on promoting NER task by adding auxiliary task to the model to discover the entity types.
Multi-View Document Representation Learning for Open-Domain Dense Retrieval (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for dense retrieval are hard to match with multiple views.
Approach: They propose a multi-view document representation learning framework to generate multiple embeddings through viewers to represent documents and enforce them to align with different queries.
Outcome: The proposed method outperforms recent works and achieves state-of-the-art results.
DORM: Preference Data Weights Optimization for Reward Modeling in LLM Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences are noisy and varying in importance of preference samples.
Approach: a new method enhances reward modeling by learning to dynamically weigh preference data.
Outcome: a new method improves the performance of large language models with human preferences . it initializes data importance and iteratively refines them to maximize validation performance.
Evaluating Scene-based In-Situ Item Labeling for Immersive Conversational Recommendation (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating item labels fail to leverage scenario-specific information modalities, present redundant information that is visually inferable, and lack latent awareness of users' information needs.
Approach: They propose a principled categorization of information needs into explicit intent satisfaction and proactive information needs and define evaluation metrics for item label selection.
Outcome: The proposed evaluation framework is based on IR-, LLM-, and VLM-based methods across fashion, movie recommendation, and retail shopping scenarios.
MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluation methods focus on single-language scenarios, overlooking multilingual and cross-lingual contexts.
Approach: They propose a tool to assess instruction-following capabilities across 23 different languages with 1667 verifiable instruction tasks.
Outcome: MaXIFE evaluates instruction-following capabilities across 23 languages with 1667 verifiable instruction tasks.
From Text to Historical Ecological Knowledge: The Construction and Application of the Shan Jing Knowledge Base (2024.lrec-main)

Copied to clipboard

Challenge: Traditional Ecological Knowledge (TEK) is a shared cultural heritage and crucial instrument to tackle environmental challenges.
Approach: They propose to build a language resource based on Shanhai Jing (the classic of mountains and seas) written 2000 years ago and uses a stylized narrative and juxtaposition of knowledge from multiple domains to build the knowledge base.
Outcome: The proposed knowledge base contains 1432 systematically classified entities and 3294 relationships.
RAAT: Relation-Augmented Attention Transformer for Relation Modeling in Document-Level Event Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods focus on sentencelevel event extraction (SEE), but they are inconsistent with actual situations.
Approach: They propose a document-level event extraction framework which can model relation dependencies by a relation-augmented Attention Transformer.
Outcome: The proposed framework can achieve state-of-the-art performance on two public datasets.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have substantially improved the reasoning abilities of Large Language Models (LLMs).
Approach: They propose a method that balances exploration and exploitation in the hidden-state space of response trajectories.
Outcome: The proposed model yields consistent improvements across models, algorithms and reasoning benchmarks.
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)

Copied to clipboard

Challenge: XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios .
Approach: They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora.
Outcome: The proposed dataset is labeled in English and includes only natural language understanding tasks.
METNet: A Mutual Enhanced Transformation Network for Aspect-based Sentiment Analysis (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for learning complex sentences with multiple aspects are ill-equipped to learn complex sentences .
Approach: They propose a mutual enhanced transformation network for the ABSA task . it improves representation learning of the aspect with contextual semantic features .
Outcome: The proposed model improves representation learning of the aspect with contextual semantic features, giving the aspect more abundant information.
LLM-based Open Domain Planning by Leveraging Entity-Attribute-Level Domain Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, large language models (LLMs) based on Open domain Natural language planning have limited application potential.
Approach: They propose a dataset with a baseline for Open domain Natural language planning . the dataset provides the largest dataset for textual procedures to date .
Outcome: The proposed dataset provides the largest dataset for textual procedures to date . it leverages entity-attribute-level action models to reveal relevant physical properties .
CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers? (2025.findings-emnlp)

Copied to clipboard

Challenge: CLAIMCHECK is an annotated dataset of NeurIPS 2023 and 2024 submissions and reviews from OpenReview.
Approach: They annotate NeurIPS 2023 and 2024 submissions and reviews for weaknesses and dispute them for fine-grained labels of validity, objectivity, and type of the identified weaknesses.
Outcome: The proposed dataset is richly annotated by ML experts for weaknesses statements in the reviews and the claims that they dispute, as well as fine-grained labels of validity, objectivity, and type of the identified weaknesses.
PEDNet: A Persona Enhanced Dual Alternating Learning Network for Conversational Response Generation (2020.coling-main)

Copied to clipboard

Challenge: Existing persona-based dialogue models generate personalized responses using predefined persona information, but they lack personality.
Approach: They propose a persona-based dual Alternating Learning Network that generates personalized responses using predefined persona information.
Outcome: The proposed method produces more personalized responses than baseline methods.
Actively Learn from LLMs with Uncertainty Propagation for Generalized Category Discovery (2024.naacl-long)

Copied to clipboard

Challenge: Generalized category discovery (GCD) is a crucial task in open-world computing, where new categories frequently emerge, necessitating models that can adapt and learn continually.
Approach: They propose to integrate the feedback from LLMs into an active learning paradigm to simplify the labeling task and minimize the spread of inaccurate feedback.
Outcome: The proposed approach significantly improves baseline models at a nominal average cost.
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval (2023.acl-long)

Copied to clipboard

Challenge: SimLM uses a simple bottleneck architecture that learns to compress the passage information into a dense vector through self-supervised pre-training.
Approach: They propose a simple yet effective pre-training method for dense passage retrieval that learns to compress the passage information into a dense vector through self-supervised pre-tuning.
Outcome: The proposed method outperforms multi-vector approaches on large-scale passage retrieval datasets and shows significant improvements over baselines.
Self-Training with Differentiable Teacher (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods for self-training are interpreted as teacher-student frameworks, where the teacher generates pseudo-labels and the student makes predictions.
Approach: They propose a differentiable self-training method that treats teacher-student as a Stackelberg game where a leader is always in a more advantageous position than a follower.
Outcome: The proposed model outperforms existing methods on semi- and weakly-supervised learning tasks on semi and weak supervised tasks.
Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate that our method significantly outperforms traditional contrastive learning approaches when using the same amount of data.
Approach: They propose a new contrastive learning method built on embedding conditional probability distributions that integrates two tasks: information compression and conditional distribution alignment.
Outcome: The proposed method outperforms traditional contrastive learning approaches and achieves comparable performance to state-of-the-art models when using the same amount of data.
Maria: A Visual Experience Powered Conversational Agent (2021.acl-long)

Copied to clipboard

Challenge: Existing studies focus on grounding conversational agents on text-only corpora, but they lack the perception ability to our physical world.
Approach: They propose to ground conversational agents on images retrieved from large-scale image indexes . they propose to use visual knowledge to generate informative responses based on the extracted knowledge .
Outcome: The proposed agent outperforms state-of-the-art methods on automatic metrics and human evaluation.
Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to machine reading comprehension treat documents at their hierarchical nature, ignoring their dependencies.
Approach: They propose a machine reading comprehension benchmark with two-grained answers . they use graph attention networks to model documents at their hierarchical nature .
Outcome: The proposed framework outperforms existing systems at long and short answer criteria.
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on *broadening* the training set with data augmentation techniques to maximize such benefits.
Approach: They propose a method that embeds problem reflection into each training instance.
Outcome: The proposed method enhances performance in standard and complex scenarios that require reflective thinking.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing studies show that stronger models are not always optimal teachers, suggesting a mismatch between the teacher’s output and the student’s learning ability.
Approach: They propose a method that routes each prompt to its optimal teacher via a query-level router that jointly considers the student models’ learnability and teacher models’ response quality.
Outcome: The proposed method outperforms baselines on six benchmarks including instruct tuning and math reasoning settings.
Supervised neural machine translation based on data augmentation and improved training & inference process (D19-52)

Copied to clipboard

Challenge: This paper describes the neural machine translation systems for the shared translation tasks of WAT 2019 .
Approach: They propose a model for translation tasks of WAT 2019 that employs a Transformer model as the baseline and a deep layer model to improve translation quality.
Outcome: The proposed methods can improve translation quality over traditional statistical machine translation (SMT) The proposed models can improve the translation quality of Japanese-English and Japanese-Chinese corpus.
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing (2020.acl-main)

Copied to clipboard

Challenge: Existing multi-domain neural machine translation models lack adaptation to individual domains.
Approach: They propose a multi-domain neural machine translation model with individual modules for each domain . they use word-level, adaptive and layer-wise domain mixing to achieve this .
Outcome: The proposed model outperforms existing models in several NMT tasks.
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)

Copied to clipboard

Challenge: Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks.
Approach: They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment.
Outcome: The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment.
Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency (2025.acl-long)

Copied to clipboard

Challenge: Large Multimodal Models (LMMs) have demonstrated impressive performance on general video comprehension benchmarks, but their robustness needs to be thoroughly investigated for broader applications.
Approach: They propose a temporal robustness benchmark which introduces temporal inconsistency perturbations separately at the visual and textual modalities to assess the robustness of models.
Outcome: The proposed method improves the model’s robustness and reliability in temporal analysis.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Learning Neural Templates for Recommender Dialogue System (2021.emnlp-main)

Copied to clipboard

Challenge: Recent advances in neural models have shown promising progress on this task, but key challenges remain .
Approach: They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template .
Outcome: The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial.
CogSteer: Cognition-Inspired Selective Layer Intervention for Efficiently Steering Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) achieve excellent performance through pretraining on extensive data.
Approach: They propose an efficient selective layer intervention based on parameter-efficient fine-tuning methods to select the optimal steering layer to modulate LLM semantics.
Outcome: The proposed approach is based on a model-agnostic framework and is safe to deploy.
An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework Based on Semantic Blocks (2022.coling-1)

Copied to clipboard

Challenge: Existing unsupervised summarization methods fail to consider efficiency and effectiveness when the input document is extremely long.
Approach: They propose an efficient Coarse-to-Fine Facet-Aware Ranking framework for unsupervised long document summarization based on the semantic block.
Outcome: The proposed framework can achieve new state-of-the-art unsupervised summarization results on Gov-Report, billSum, arXiv, and PubMed.
Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for infrared modeling ignore supervisory signals of infra-modality-specific attributes, which may lead to biased understanding of in-frarea images.
Approach: They propose a multi-agent generation system which transfers knowledge from visible images to generate infrared image-text pairs and infra-instructional data.
Outcome: The proposed system generates infrared image-text pairs and infra-response data and is able to answer common infreas tasks with the proposed model.
FuseSearch: Learning Adaptive Parallel Execution for Efficient Code Localization (2026.findings-acl)

Copied to clipboard

Challenge: Existing parallel code localization agents suffer from a 34.9% redundant tool invocation rate . specialized localization agent that operate as dedicated search components is needed to achieve high localization accuracy.
Approach: They propose a parallel code localization system that reframes parallel code execution as a quality–efficiency co-optimization problem.
Outcome: The proposed method matches SOTA performance while being 93.6% faster.
Neuron-Level Sequential Editing for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing model editing methods focus on single-round editing and often face significant challenges in sequential model editing.
Approach: They propose a model editing method that optimizes the target layer’s hidden states using the model’s original weights to prevent model failure.
Outcome: The proposed method outperforms existing model editing methods and is available on the open-source platform 4open.science.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations