Papers by Jiang Guo

87 papers
LCR-RAG: Enhancing Logical Consistency in Retrieval-Augmented Generation via Neuro-symbolic Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge and improve factual accuracy.
Approach: They propose a framework that integrates neuro-symbolic verification with reinforcement learning to optimize logical consistency.
Outcome: The proposed framework outperforms strong RAG baselines on hotpotQA, ASQA, and TriviaQA.
A Mutual Information Perspective on Knowledge Graph Embedding (2025.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph embedding techniques suffer from high intra-group similarity, loss of semantic information, and insufficient inference capability, particularly in complex relation patterns such as 1-N and N-1 relations.
Approach: They propose a knowledge graph embedding framework that leverages mutual information maximization to improve the semantic representation of entities and relations.
Outcome: Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed method, with consistent performance improvements across various baseline models.
CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages (2025.findings-acl)

Copied to clipboard

Challenge: Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data.
Approach: They propose a framework that aligns music modalities with multilingual text in a shared representation space.
Outcome: Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts .
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches for inferential text generation ignore context that is not explicitly provided . Existing models ignore background knowledge that provides crucial evidence to generate inferences .
Approach: They propose an approach that automatically finds evidence for an event from a large text corpus and leverages it to guide the generation of inferential texts.
Outcome: The proposed model generates inferential texts from a large text corpus and uses evidence to guide it.
SDBench: A Survey-based Domain-specific LLM Benchmarking and Optimization Framework (2025.acl-long)

Copied to clipboard

Challenge: acquiring domain-specific knowledge often requires professional expert manpower.
Approach: They propose a generic framework for generating evaluation datasets for domain-specific LLMs.
Outcome: The proposed framework reduces the reliance on expert manpower while ensuring that the collected data is uniformly distributed.
ProvBench: A Benchmark of Legal Provision Recommendation for Contract Auto-Reviewing (2025.acl-long)

Copied to clipboard

Challenge: Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts .
Approach: They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts.
Outcome: The proposed task recommends legal provisions related to contract clauses and detects legal conflicts.
Dynamic Parallel Tree Search for Efficient LLM Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Recent methods focus on search accuracy while overlooking computational efficiency.
Approach: They propose a parallelism framework that dynamically optimizes reasoning path in inference.
Outcome: The proposed framework improves efficiency by 2-4 on average while maintaining or even surpassing existing reasoning algorithms in accuracy.
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in vision-language models have unified perception and understanding tasks within Visual Question Answering paradigms.
Approach: They propose to outline timeline, architecture, and pipeline of nearly all TIU MLLMs and review their performance on mainstream benchmarks.
Outcome: The proposed models perform well on mainstream benchmarks and are compared with other models.
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data.
Approach: They propose a framework that imposes strong typing constraints and incorporates key relationships from schema.
Outcome: The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider.
VLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training (2025.findings-emnlp)

Copied to clipboard

Challenge: a significant drawback of Vision-language Models is their reliance on static training data, leading to outdated information and limited contextual awareness.
Approach: They propose a framework with knowledge-enhanced reranking and noise-injected training to improve the VLM's ranking ability.
Outcome: The proposed framework is based on a simple yet effective instruction template and is able to induce its ranking ability and serve it as a reranker to precisely filter the top-k retrieved images.
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information.
Approach: They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives .
Outcome: The proposed agent outperforms existing methods and matches human quality in idea generation.
Context as a Tool: Context Management for Long-Horizon SWE-Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models rely on append-only context maintenance or passively triggered compression heuristics, leading to context explosion, semantic drift, and degraded reasoning in long-running interactions.
Approach: They propose a new context management paradigm that elevates context maintenance to a callable tool . they propose 'cat' framework that injects context-management actions into complete interaction trajectories .
Outcome: The proposed model outperforms ReAct-based agents and static compression baselines on SWE-Verified tests.
Multi-Source Domain Adaptation with Mixture of Experts (D18-1)

Copied to clipboard

Challenge: Existing methods for domain adaptation from multiple sources are designed to transfer supervision from a single source domain.
Approach: They propose to capture the relationship between a target example and different source domains by a point-to-set metric.
Outcome: The proposed method outperforms baselines and can handle negative transfer.
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance.
Approach: They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning .
Outcome: Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance .
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents.
Approach: They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety.
Outcome: The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system.
Beyond Screenshots: Evaluating VLMs’ Understanding of UI Animations (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies of Vision Language Models (VLMs) for UI understanding have focused primarily on static screenshots, leaving it unclear how well these models handle dynamic UI animations.
Approach: They evaluate UI animation models' ability to perceive animation effects and interpret animation meaning . they use motion, context, and perceptual cues to probe factors affecting VLM performance .
Outcome: The proposed model can detect primitive motion, but its interpretation is inconsistent . the proposed model is based on 300 annotated UI animation videos .
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)

Copied to clipboard

Challenge: drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers .
Approach: They propose a framework that automates method statement generation by using multi-agent collaboration.
Outcome: The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity.
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach: They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome: The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Continual Pretraining on Encrypted Synthetic Data for Privacy-Preserving LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods to protect PII from training on small corpora are difficult to implement in real-world applications.
Approach: They propose an entity-based framework that synthesizes encrypted training data to protect PII.
Outcome: The proposed framework outperforms base models and ensures PII security on limited-scale datasets while exhibiting a modest performance gap compared to models trained on unencrypted synthetic data.
GROLE: Instance-Level Group Relative Optimization for LoRA Experts in Incremental Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models demonstrate remarkable zero-shot generalization, but adapting to downstream tasks requires continual fine-tuning.
Approach: They propose a method that incrementally constructs a pool of frozen, task-specific LoRA experts.
Outcome: The proposed approach outperforms state-of-the-art methods in task-free and blurred-boundary settings.
You Only Read Once (YORO): Learning to Internalize Database Knowledge for Text-to-SQL (2025.naacl-long)

Copied to clipboard

Challenge: Existing text-to-SQL systems encode the same schema for every question, resulting in unnecessary high inference cost and missing crucial database knowledge.
Approach: They propose a paradigm that directly internalizes database knowledge into the parametric knowledge of a text-to-SQL model during training and eliminates the need for schema encoding during inference.
Outcome: The proposed paradigm significantly reduces the input token length by 66%-98% and outperforms traditional systems on three benchmarks.
LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data (2025.findings-acl)

Copied to clipboard

Challenge: Long-context processing ability has emerged as a significant challenge for large language models.
Approach: They propose a pipeline for synthesizing faithful long-context reasoning instruction datasets . they integrate ground truth and citation-based reasoning prompts integrating them .
Outcome: The proposed pipeline eliminates distractions and improves reasoning chains.
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models (2022.findings-naacl)

Copied to clipboard

Challenge: Existing work on cross-lingual transfer has not studied how to leverage knowledge of rich-resource languages without labels.
Approach: They propose a 2-step knowledge distillation framework to achieve knowledge transfer from off-the-shelf models in rich-resource languages.
Outcome: The proposed method reduces annotation cost and protects private labels.
PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding (2022.emnlp-industry)

Copied to clipboard

Challenge: In a large fraction of the global traffic from smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of the entities in a user's query due to factors including ambiguous mentions, mispronunciation, background noise and faulty on-device signal processing.
Approach: They propose a parametric transformer-based language model to learn patterns from in-session customer-device interactions coupled with a non-parametric personalized entity index to compute the correct query.
Outcome: The proposed system improves on the existing system and shows that it can learn the correct query from in-session customer-device interactions.
MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction (2025.emnlp-industry)

Copied to clipboard

Challenge: Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences.
Approach: They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge.
Outcome: The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge.
Towards Omni-RAG: Comprehensive Retrieval-Augmented Generation for Large Language Models in Medical Applications (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to source planning fail to achieve this due to misalignment between the model’s expectation of the sources and their actual content.
Approach: They propose a method to optimise large-scale medical knowledge models by combining multiple medical knowledge sources into one query.
Outcome: The proposed method significantly improves multi-source planning performance while training a smaller model to learn source alignment.
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction (2025.acl-industry)

Copied to clipboard

Challenge: Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task.
Approach: They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations.
Outcome: The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task.
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Copied to clipboard

Challenge: Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach: They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome: The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.
KnowCoder-X: Boosting Multilingual Information Extraction via Code (2025.findings-acl)

Copied to clipboard

Challenge: Empirical evidence indicates that Large Language Models exhibit spontaneous cross-lingual alignment in Information Extraction (IE) however, a significant imbalance across languages persists, highlighting an underlying deficiency.
Approach: They propose a code LLM with advanced cross-lingual and multilingual capabilities for universal IE that standardizes the representation of multilingual schemas using Python classes and conducts IE alignment instruction tuning on translated instance prediction task.
Outcome: The proposed model surpasses ChatGPT and SoTA by 30.17% without training in 29 unseen languages and significantly improves cross-lingual IE transferability.
Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base (D19-1)

Copied to clipboard

Challenge: Recent approaches to handle large knowledge base decompose tasks into subtasks and solve them sequentially.
Approach: They propose a multi-task learning framework that resolves coreference in conversations . they propose enabling shared supervisions and type-aware entity detection model .
Outcome: The proposed framework improves overall F1 score from 67% to 79% on a large-scale conversational question answering dataset.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
Self-Bootstrapped Visual-Language Model for Knowledge Selection and Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: a framework that leverages the visual-language model to select key knowledge retrieved by DPR and answer questions improves performance of the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
Approach: They propose a framework that leverages visual-language models to retrieve related knowledge . they use dense passage retrieval to retrieve knowledge related to visual-linguistics .
Outcome: The proposed framework significantly improves the baseline on the open-domain Knowledge-based VQA benchmark, OK-VQA.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) language models are a dominant paradigm in the field of parallelism and non-causal modeling.
Approach: They propose a blockwise discrete diffusion model that preserves AR-compatible serving while enabling parallel intra-block generation.
Outcome: The proposed model achieves theoretical speedups over 5 and wall-clock speedup of 2.3 on H200 GPUs in latency-critical regimes.
Conflicts Make Large Reasoning Models Vulnerable to Attacks (2026.findings-acl)

Copied to clipboard

Challenge: Large Reasoning Models have demonstrated outstanding capabilities in solving complex reasoning tasks by incorporating step-by-step chain-of-thought (CoT) reasoning.
Approach: They evaluate three large reasoning models that perform explicit and coherent reasoning under conflicting objectives and use them to evaluate their performance.
Outcome: The proposed models perform explicit and coherent reasoning before producing their outputs, improving problem-solving and multi-step decision making.
Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA (2025.findings-acl)

Copied to clipboard

Challenge: Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model.
Approach: They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering.
Outcome: The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies.
LLM-Driven Multi-Perspective Location Completion for Next Location Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods assume that check-in data is complete, overlooking the subjective nature of user behavior, leading to inaccurate capture of user preferences.
Approach: They propose a framework that uses spatial coordinates to augment location completion by transforming geographic coordinates into text.
Outcome: The proposed framework outperforms state-of-the-art methods on three real-world datasets.
Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models exhibit human-like behaviors such as exploration, verification, reflection, and correction.
Approach: They propose a supervised fine-tuning framework for long chain-of-thoughts reasoning . they leverage a difficulty-aware reward model to estimate the learning value of questions .
Outcome: The proposed framework performs fine-tuning on large reasoning models on 10% of the data selected.
SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems (2025.findings-acl)

Copied to clipboard

Challenge: SciVerse is a multi-modal scientific evaluation benchmark to assess large multi-models . it examines the scientific knowledge comprehension, multi-mod content interpretation and Chain-of-Thought reasoning . authors examine the scientific proficiency of LMMs in scientific domains based on their work .
Approach: They propose a multi-modal scientific evaluation benchmark to thoroughly assess Large Multi-modal Models across 5,735 test instances in five different versions.
Outcome: The proposed evaluation reveals critical limitations in LMMs' scientific proficiency and provides new insights into future developments.
A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods (2023.eacl-main)

Copied to clipboard

Challenge: Multi-task learning is a popular approach in natural language processing because of its commonalities and differences.
Approach: They propose to summarize recent advances in multi-task learning methods based on their task relatedness into two general multi-step training methods.
Outcome: The proposed methods summarize the tasks and discuss future directions.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks (2023.findings-acl)

Copied to clipboard

Challenge: Pretraining and fine-tuning are the dominant paradigms in natural language processing.
Approach: They propose a parameter-efficient multitask learning framework that takes trainable hyper-embeddings and visual modality as input and outputs weights for different modules in a pretrained language model.
Outcome: The proposed framework adds fewer trainable parameters in multi-task learning while achieving superior performances and transfer ability compared to state-of-the-art methods.
Evaluating Scene-based In-Situ Item Labeling for Immersive Conversational Recommendation (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating item labels fail to leverage scenario-specific information modalities, present redundant information that is visually inferable, and lack latent awareness of users' information needs.
Approach: They propose a principled categorization of information needs into explicit intent satisfaction and proactive information needs and define evaluation metrics for item label selection.
Outcome: The proposed evaluation framework is based on IR-, LLM-, and VLM-based methods across fashion, movie recommendation, and retail shopping scenarios.
Learning Numeral Embedding (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing word embedding methods do not learn numeral embedds well because numerals are limited in number and their appearances in training corpora are highly scarce.
Approach: They propose two numeral embedding methods that can handle the out-of-vocabulary problem for numerals.
Outcome: The proposed methods can handle the out-of-vocabulary problem for numerals.
Knowledge Decoupling via Orthogonal Projection for Lifelong Editing of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing large language models (LLMs) have achieved some success, but their knowledge understanding and memory capacity significantly degrades after extensive editing.
Approach: They propose a method that stores the basis vectors of the representation space of past edits in a knowledge cache and projects the gradient of the current edit onto a space orthogonal to previous knowledge for updating.
Outcome: The proposed method improves question-answering ability and hallucination mitigation by 14% and 61% for large language models after 3,000 edits.
World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Vision-Language Models and the scarcity of high-quality multi-modal alignment data have inspired numerous researches on synthetic VLM data generation.
Approach: They propose a multi-modal data construction pipeline that organizes the final output into a Python code format.
Outcome: The proposed pipeline improves visual question answering and visual grounding benchmarks across different VLMs.
On Synthetic Data Strategies for Domain-Specific Generative Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Generative retrieval models can be used to generate ranked lists of potentially relevant document identifiers for a user query.
Approach: They propose a synthetic data generation strategy for a two-stage training framework that focuses on learning to decode document identifiers from queries and a strategy for mining hard negatives based on initial model's predictions.
Outcome: The proposed model can generate ranked lists of potentially relevant document identifiers for a user query and then refine ranking through preference learning.
Benchmarking Fine-Grained Error Detection in Multimodal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Multimodal Process Reward Models (MPRMs) have emerged as a pivotal framework for enhancing the reasoning capabilities of Multimodal Large Language Models.
Approach: They propose a benchmark specifically designed to evaluate MPRMs’ proficiency in detecting erroneous reasoning steps across diverse error categories.
Outcome: The proposed model achieves up to 4.8% performance improvement through test-time scaling.
Graph Neural Network Enhanced Retrieval for Question Answering of Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing retrieval methods divide reference documents into passages, treating them in isolation. Existing methods only use contiguous passages or keywords.
Approach: They propose a retrieval method that leverages graph neural networks to exploit relatedness between passages to enhance retrieval.
Outcome: The proposed method improves retrieval by exploiting the relatedness between passages.
Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion (2025.naacl-long)

Copied to clipboard

Challenge: Existing embedding-based methods rely on triples in the KG, which is vulnerable to specious relation patterns and long-tail entities.
Approach: They propose a context-enriched framework for KGC that uses a large language model to generate potential answers for each query triple.
Outcome: The proposed framework improves on FB15k237 and WN18RR datasets.
Sentence-Permuted Paragraph Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models produce similar contents from homogenized contexts due to the fixed left-to-right sentence order.
Approach: They propose a framework permuting sentence orders to improve content diversity of multi-sentence paragraphs by permutating the sentence orders.
Outcome: The proposed framework produces more diverse outputs with higher quality than existing models.
CodeBERT: A Pre-Trained Model for Programming and Natural Languages (2020.findings-emnlp)

Copied to clipboard

Challenge: Large pre-trained models have improved performance on a variety of natural language processing tasks.
Approach: They develop a bimodal pre-trained model for programming language (PL) and natural language (NL) it incorporates a hybrid objective function that detects replaced tokens from generators.
Outcome: The proposed model performs better on two NL-PL applications by fine-tuning model parameters.
Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved impressive performance across diverse tasks, but suffer from the "reversal curse" this limitation poses a challenge to the advancement of artificial general intelligence (AGI)
Approach: They propose to use training data to permute training sentences into entities and feed them into the model.
Outcome: The proposed method improves the performance of large language models (LLMs) on reversed questions and improves existing models.
Unlocking the Power of Large Language Models for Entity Alignment (2024.acl-long)

Copied to clipboard

Challenge: Entity Alignment (EA) is a crucial step in unifying data from heterogeneous sources and plays a critical role in data-driven AI applications.
Approach: They propose a framework that incorporates large language models to improve EA.
Outcome: The proposed framework incorporates large language models (LLMs) to improve EA accuracy while preserving efficiency.
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment.
Approach: VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control.
Outcome: Experimental results show that VersBand performs better than baseline models across multiple song generation tasks.
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis (2025.findings-acl)

Copied to clipboard

Challenge: Existing zero-shot singing voice synthesis models depend on phoneme and note boundary annotations, limiting their robustness and producing poor transitions between phonemes and notes.
Approach: They propose a multi-task multilingual zero-shot SVS model with style transfer and style control based on various prompts.
Outcome: Experimental results show that TCSinger 2 outperforms baseline models in subjective and objective metrics across multiple related tasks.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)

Copied to clipboard

Challenge: XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios .
Approach: They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora.
Outcome: The proposed dataset is labeled in English and includes only natural language understanding tasks.
LiCoMemory: Lightweight and Cognitive Agentic Memory for Efficient Long-Term Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models are constrained by limited context windows and lack of persistent memory . recent efforts address these limitations via external memory architectures .
Approach: They propose an end-to-end agentic memory framework for real-time updating and retrieval that integrates hierarchical and temporal indexing layers.
Outcome: The proposed framework outperforms established benchmarks in temporal reasoning, multi-session consistency, and retrieval efficiency.
Syntax-Enhanced Pre-trained Model (2021.acl-long)

Copied to clipboard

Challenge: Existing methods that use syntax of text in pre-training and fine-tuning suffer from discrepancy between the two stages.
Approach: They propose a model that utilizes the syntactic structure of text in pre-training and fine-tuning stages.
Outcome: The proposed model achieves state-of-the-art on six public benchmark datasets.
MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for AI math tutoring largely overlook these skills.
Approach: They evaluate 12 leading multimodal large language models and find clear performance gaps between them.
Outcome: The proposed benchmarks show that they can solve 770 problems and provide diagnostics and guidance to students step by step.
Empowering Diffusion Models on the Embedding Space for Text Generation (2024.naacl-long)

Copied to clipboard

Challenge: Recent work adapts diffusion models to textual data by diffusing on the embedding space.
Approach: They propose an embedding diffusion model based on Transformer to solve the problem of embeddable space and denoising model.
Outcome: The proposed model is more efficient than previous methods on seminal text generation tasks and is superior to existing models.
FAQ: Mitigating Quantization Error via Regenerating Calibration Data with Family-Aware Quantization (2026.findings-acl)

Copied to clipboard

Challenge: representativeness and universality of calibration data remain a bottleneck in quantization accuracy.
Approach: They propose a framework that leverages prior knowledge from LLMs to generate calibration samples . their framework reduces accuracy loss by up to 28.5% compared to baseline .
Outcome: Experiments show that family-aware quantization reduces accuracy loss by up to 28.5% compared to baseline data.
Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks (2024.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods struggle to effectively propagate updates to interconnected facts, limiting the performance of reasoning tasks based on these updated facts.
Approach: They propose a reasoning-based benchmark, ReCoE, which covers six common reasoning schemes in the real world.
Outcome: The proposed reasoning-based benchmark shows that current models struggle to propagate updated knowledge within reasoning schemes.
DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints (2026.acl-long)

Copied to clipboard

Challenge: Existing LLM planning benchmarks emphasize local, step-level reasoning rather than global constrained optimization.
Approach: They propose a benchmark for practical long-horizon agent planning that uses local constrained reasoning and global constrained optimization.
Outcome: The proposed benchmarks show that even frontier agentic LLMs struggle with these problems.
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to scale out spoken language understanding to low-resource languages are noisy.
Approach: They propose a method for mitigating noise in augmented data by training models with augmented datasets.
Outcome: The proposed method outperforms state-of-the-art methods on two benchmark datasets.
DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step.
Approach: They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences.
Outcome: The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines.
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing (D19-1)

Copied to clipboard

Challenge: Existing approaches to learn cross-lingual word embeddings in a contextual space are lacking.
Approach: They propose a method to generate cross-lingual contextualized word embeddings using pre-trained BERT models by learning a linear transformation from contextual word alignments.
Outcome: The proposed approach outperforms state-of-the-art models on zero-shot cross-lingual transfer parsing and is highly competitive with existing models.
Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for contrastive pre-training ignore the relevance between codes in large code corpus.
Approach: They propose a Soft-labeled contrastive pre-training framework with positive sample construction methods to learn functional-level code representation.
Outcome: The proposed framework can obtain fine-grained soft-labels through an iterative adversarial manner and use them to learn better code representation.
JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Current evaluation methods for large language models rely on static benchmarks . limited knowledge coverage and fixed difficulties hinder the targeted optimizations resulting in superficial evaluations of LLMs - a problem that has been addressed by JudgeAgent .
Approach: They propose a knowledge-driven and dynamic evaluation framework for large language models . judgeAgent leverages LLM agents equipped with context graphs to traverse knowledge structures .
Outcome: The proposed framework can achieve comprehensive evaluations and facilitate effective model iterations.
GraphIE: A Graph-Based Framework for Information Extraction (N19-1)

Copied to clipboard

Challenge: Most modern Information Extraction (IE) systems are implemented as sequential taggers and model local dependencies.
Approach: They propose a framework that operates over a graph representing a broad set of dependencies between textual units.
Outcome: The proposed framework outperforms the state-of-the-art sequence tagging model on three different tasks.
Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models.
Approach: They propose a method to integrate multiple models from diverse training scenarios into a unified model.
Outcome: The proposed method outperforms state-of-the-art models on mainstream language models by large margins.
Dynamics of Cognitive Heterogeneity: Investigating Behavioral Biases in Multi-Stage Supply Chains with LLM-Based Simulation (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) allow repeatable experiments in which individual characteristics can be precisely defined.
Approach: They propose a scalable experimental paradigm using Large Language Models to simulate multi-stage supply chain dynamics.
Outcome: The proposed model systematically replicates and validates the results of a behavioral simulation on agents in multi-stage supply chain dynamics.
Multi-view Classification Model for Knowledge Graph Completion (2020.aacl-main)

Copied to clipboard

Challenge: Existing knowledge graph completion models only evaluated candidate triples from content information.
Approach: They propose a multi-view classification model where multiple views are performed based on both content and context information for candidate triple evaluation.
Outcome: The proposed model improves on two representative datasets and improves performance.
BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use.
Approach: They propose a modular framework that provides a unified view of backdoor threats in LLM agents.
Outcome: The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents.
C3LRSO: A Chinese Corpus for Complex Logical Reasoning in Sentence Ordering (2025.coling-main)

Copied to clipboard

Challenge: Existing sentence ordering datasets for non-English languages are unavailable.
Approach: They propose a parameter-free sentence ordering dataset that provides genuinely unordered sentences without artificial segmentation cues.
Outcome: The proposed method outperforms existing methods on the sentence ordering task.
MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings.
Approach: They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment.
Outcome: The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment.
Working Hard or Hardly Working: Challenges of Integrating Typology into Neural Dependency Parsers (D19-1)

Copied to clipboard

Challenge: linguistic typology has shown great promise in pre-neural parsing, but results for neural architectures have been mixed.
Approach: They explore the task of leveraging typology in the context of cross-lingual dependency parsing.
Outcome: The proposed approach improves performance in the context of cross-lingual dependency parsing.
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)

Copied to clipboard

Challenge: Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections.
Approach: They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight.
Outcome: The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%.
DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026.acl-demo)

Copied to clipboard

Challenge: Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities.
Approach: They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training.
Outcome: The proposed framework achieves an optimal balance between generation efficiency and data quality.
Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations .
Approach: They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations.
Outcome: The proposed framework improves on real-world HMTC datasets with significant improvements over baselines.
Accelerating Adaptive Retrieval Augmented Generation via Instruction-Driven Representation Reduction of Retrieval Overlaps (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to augmented generation ignore the overlap in retrieval results . overlapping content is redundantly represented, affecting the overall efficiency.
Approach: They propose a model-agnostic approach to re-augmented generation that speeds up prefilling and decoding . they propose an instruction-driven module to guide the model to more suitable ways for LLMs .
Outcome: The proposed approach achieves 2.79 and 2.33 times significant acceleration on average for prefilling and decoding respectively while maintaining equal generation quality.
GMN: Generative Multi-modal Network for Practical Document Information Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world.
Approach: They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module.
Outcome: The proposed method can deal with complex documents that are hard to serialize into sequential order.
Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study (2025.emnlp-main)

Copied to clipboard

Challenge: Large Audio-Language Models (LALMs) are increasingly being deployed in real-world applications, yet their robustness against malicious audio injection remains underexplored.
Approach: They quantitatively assess their vulnerabilities and resilience using metrics: the Defense Success Rate, Context Robustness Score, and Judgment Robustic Index.
Outcome: The proposed models demonstrate significant performance disparities across four attack scenarios.
Graceful Forgetting in Generative Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies show that pre-trained models do not provide all knowledge needed for fine-tuning tasks.
Approach: They propose a framework to achieve graceful forgetting in generative language models by pre-training a model on large-scale correlating datasets.
Outcome: The proposed framework improves the learning plasticity of the target task by selectively discarding irrelevant knowledge.
When TableQA Meets Noise: A Dual Denoising Framework for Complex Questions and Large-scale Tables (2026.acl-long)

Copied to clipboard

Challenge: Extensive research shows that noisy data significantly degrades the performance of table reasoning in real-world applications.
Approach: They propose a dual denoising framework for complex questions and large-scale tables that uses Tree-guided table pruning to remove irrelevant data step by step.
Outcome: The proposed framework achieves outstanding performance on TableQA tasks with complex questions and large-scale tables.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations