Papers by Ling Zhang

67 papers
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows.
Approach: They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution.
Outcome: Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution .
NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes (2024.acl-long)

Copied to clipboard

Challenge: Complex reasoning ability is one of the most important features of Large Language Models.
Approach: They propose a new benchmark that measures the reasoning ability of Large Language Models . it contains 900 algorithmic questions belonging to the NP-Hard complexity class .
Outcome: The proposed benchmark contains 900 questions belonging to the NP-Hard complexity class and is updated on a monthly basis.
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-Context QA (2025.findings-acl)

Copied to clipboard

Challenge: Current long-context large language models lack citations to support their responses, making verification difficult due to potential hallucinations.
Approach: They propose to use off-the-shelf LLMs to automatically construct long-context QA instances with precise sentence-level citations and leverage this pipeline to construct a large-scale SFT dataset for LQAC.
Outcome: The proposed pipeline can generate responses with fine-grained citations on the fly, surpassing existing models including GPT-4o.
CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes.
Approach: They propose a benchmark to evaluate LLMs' ability to perform codeflow by reusing existing functions over multiple turns.
Outcome: The proposed benchmarks show that LLMs perform significantly worse in multi-turn codeflow scenarios and that their performance inversely correlates with dependency complexity.
BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition (2025.coling-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that aims to detect the entity spans of text and classify them into pre-defined set of entity types.
Approach: They propose a boundary-aware contrastive learning strategy to enhance the LLM’s ability to perceive entity boundaries for generalized entity spans.
Outcome: The proposed framework outperforms prior methods and validates its effectiveness across a range of LLM architectures.
Generalization in Text-based Games via Hierarchical Reinforcement Learning (2021.findings-emnlp)

Copied to clipboard

Challenge: Reinforcement Learning (RL) based agents are promising for text-based games, but their generalization remains a challenge.
Approach: They propose a hierarchical framework for reinforcement learning based on knowledge graphs . they propose to decompose the game into subtasks and execute a sub-policy in the low level to conduct goal-conditioned reinforcement learning.
Outcome: The proposed framework enjoys favorable generalizability on a set of difficulty levels and is able to handle complex training tasks.
Constraining Sequential Model Editing with Editing Anchor Compression (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit hallucinations due to incorrect or outdated knowledge embedded in their parameters.
Approach: They propose a framework to constrain the deviation of the parameter matrix during sequential editing by selecting editing anchors that are important in encoding new relations without deviating too much from the original matrix.
Outcome: The proposed framework minimizes deviations caused by model editing while retaining over 70% of the general abilities.
E-VarM: Enhanced Variational Word Masks to Improve the Interpretability of Text Classification Models (2022.coling-1)

Copied to clipboard

Challenge: Empirical studies show that our approach outperforms the SOTA methods in improving the interpretability of text classification models.
Approach: They propose an enhanced variational word masks approach that exploits the Variational Information Bottleneck to obtain task-specific words.
Outcome: Empirical results show that the proposed method outperforms the SOTA methods in improving the interpretability of the model.
Latent Suicide Risk Detection on Microblog via Suicide-Oriented Word Embeddings and Layered Attention (D19-1)

Copied to clipboard

Challenge: Existing approaches to detect suicidal ideation on social media are limited to a small group of people.
Approach: They propose to use tree holes to embed words into microblogs to strengthen the sensibility of suicide-related lexicons and to use a two-layered attention mechanism to grasp intermittently changing points from individual's open blog streams.
Outcome: The proposed approach can achieve over 91% accuracy with the use of suicide-oriented word embeddings and attention on a large-scale well-labelled suicide data set.
Joint Intent Detection and Entity Linking on Spatial Domain Queries (2020.findings-emnlp)

Copied to clipboard

Challenge: Spatial domain queries have unique properties making them more challenging for language understanding than common conversational queries.
Approach: They propose a language understanding framework for spatial domain queries that jointly learns the intent detection and entity linking tasks on a voice assistant service.
Outcome: The proposed framework outperforms baseline methods with a significant margin.
Aligning Large Language Models with Human Preferences through Representation Engineering (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for achieving this alignment involve employing reinforcement learning from human feedback (RLHF) Existing approaches involve using RLHF to fine-tune LLMs based on human labels . however, RLRF is susceptible to instability during fine- tuning and presents challenges in implementation.
Approach: They propose to use reinforcement learning from human feedback to fine-tune large language models with human preferences to achieve precise control of model behavior.
Outcome: Experiments show that RAHF can be used to capture and manipulate representations to align with a broad spectrum of human preferences or values rather than being confined to a single concept or function.
AdaptThink: Reasoning Models Can Learn When to Think (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large reasoning models have demonstrated remarkable capabilities in tackling complex tasks.
Approach: They propose an algorithm to teach reasoning models to choose the optimal thinking mode based on problem difficulty.
Outcome: The proposed algorithm reduces the average response length and improves accuracy on three math datasets.
OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety (2024.acl-demos)

Copied to clipboard

Challenge: a rapid development of Chinese large language models poses big challenges for efficient LLM evaluation.
Approach: They propose an evaluation testbed that benchmarks Chinese LLMs across capability, alignment and safety.
Outcome: The evaluation platform OpenEval benchmarks Chinese LLMs across capability, alignment and safety.
Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables.
Approach: They propose a framework that allows LLMs to efficiently and faithfully reason over structured environments.
Outcome: The proposed framework surpasses state-of-the-art fine-tuned methods on three KGQA and two TableQA datasets and surpasse CWQ and WTQ methods.
Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solving (2025.findings-emnlp)

Copied to clipboard

Challenge: a new study examines the potential of retrieval-augmented generation (RAG) with foundation models to enhance expert-level reasoning.
Approach: They introduce PhoPile, a high-quality multimodal dataset specifically designed for Olympiad-level physics.
Outcome: The proposed model can be used to solve Olympiad-level physics problems.
KB-Plugin: A Plug-and-play Framework for Large Language Models to Induce Programs over Low-resourced Knowledge Bases (2024.emnlp-main)

Copied to clipboard

Challenge: Program induction (PI) is a promising paradigm for using knowledge bases (KBs) to help large language models answer complex knowledge-intensive questions.
Approach: They propose a plug-and-play framework that enables large language models to induce programs over any low-resourced KB.
Outcome: Experiments show that KB-Plugin outperforms SoTA low-resourced PI methods with 25x smaller backbone LLM on large-scale and domain-specific KBs and even approaches the performance of supervised methods.
Open-Topic False Information Detection on Social Networks with Contrastive Adversarial Learning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing models for false information detection on social networks are too harsh for actual social networks that contain both seen and unseen topics simultaneously.
Approach: They propose an open-topic scenario that assumes that all test data topics are seen or unseen by the model, but which is too harsh for actual social networks that contain both seen and unseened topics simultaneously.
Outcome: The proposed model improves on two benchmark datasets and a variety of graph neural networks on two social networks and shows that it is more accurate than existing models.
Beyond Human Labels: A Multi-Linguistic Auto-Generated Benchmark for Evaluating Large Language Models on Resume Parsing (2025.emnlp-main)

Copied to clipboard

Challenge: Efficient resume parsing is critical for global hiring, yet the lack of dedicated benchmarks for evaluating large language models (LLMs) on multilingual, structure-rich resumes hinders progress.
Approach: They propose to use a human-in-the-loop pipeline to generate 2,500 synthetic resumes spanning 50 templates, 30 career fields, and 5 languages to evaluate large language models.
Outcome: The proposed benchmarks show that the models perform poorly on multilingual resumes and lack of standardized templates.
SceneGenAgent: Precise Industrial Scene Generation with Coding Agent (2025.acl-long)

Copied to clipboard

Challenge: Recent work on scene generation focuses on generating 3D scenes from textual descriptions . however, the task of generating industrial scenes with LLMs is complex and requires precise measurements and positioning .
Approach: They propose an LLM-based agent for generating industrial scenes through C# code.
Outcome: Experiments show that LLMs powered by SceneGenAgent exceed their original performance . the agent achieves 81.0% success rate in real-world industrial scene generation tasks .
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
LongReward: Improving Long-context Large Language Models with AI Feedback (2025.acl-long)

Copied to clipboard

Challenge: In recent years, significant advancements have been achieved in the development of long-context large language models (LLMs).
Approach: They propose a method that utilizes an off-the-shelf LLM to provide rewards for long-context model responses from four human-valued dimensions: helpfulness, logicality, faithfulness, and completeness.
Outcome: The proposed method improves models’ long-context performance and enhances their ability to follow short instructions.
Efficient Pretraining Data Selection for Language Models via Multi-Actor Collaboration (2025.acl-long)

Copied to clipboard

Challenge: Efficient data selection is crucial to accelerate the pretraining of language models . limited research has addressed the inherent conflicts between data selection methods .
Approach: They propose a multi-actor collaborative data selection mechanism that prioritizes data based on its specific criterion and updates prioritization rules using the current state of the model.
Outcome: The proposed model accelerates convergence in LM pretraining and achieves an average relative performance gain of 10.5% across multiple language model benchmarks.
RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for assessing retrieval of relevant information are understudied . previous studies have neglected to evaluate ARAG methods .
Approach: They propose a benchmark to evaluate existing ARAG methods that use threshold tuning to adjust retrieval for queries instead of indiscriminate retrieval.
Outcome: The proposed method can be used to evaluate existing ARAG methods without calibration or training.
Constructing Interpretive Spatio-Temporal Features for Multi-Turn Responses Selection (P19-1)

Copied to clipboard

Challenge: Existing models for response selection do not perform well when there are many candidate responses.
Approach: They propose a Spatio-Temporal Matching network (STM) for response selection . they use soft alignment to obtain local relevance between context and response .
Outcome: The proposed model significantly outperforms the state-of-the-art model on two large-scale multi-turn response selection tasks.
CT-FineBench: A Diagnostic Fidelity Benchmark for Fine-Grained Evaluation of CT Report Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation metrics for radiology report generation focus on lexical overlap and entity matching.
Approach: They propose a benchmark to evaluate the fine-grained factual consistency of CT reports . they use a question-answering process to query a machine-generated report .
Outcome: The proposed benchmark evaluates the fine-grained factual consistency of CT reports . it correlates better with expert clinical assessment and is more sensitive to errors .
PresentAgent: Multimodal Agent for Presentation Video Generation (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing methods for generating static slides or text summaries are limited to producing narrated presentations.
Approach: They propose a multimodal agent that transforms long-form documents into narrated presentations.
Outcome: The present agent produces fully synchronized visual and spoken content that closely mimics human-style presentations.
Think-Search-Patch: A Retrieval-Augmented Reasoning Framework for Repository-Level Code Repair (2025.emnlp-industry)

Copied to clipboard

Challenge: Large language models suffer from multiple-file coding scenarios with strong inter-file dependencies . experimental results show that large language models exhibit inadequate performance in multi-file scenarios .
Approach: They propose a retrieval-augmented reasoning framework for repository-level code repair . they use a dataset to generate standardized patches based on the key snippets .
Outcome: The proposed framework improves retrieval accuracy and repair success on SWE-bench Lite . it surpasses models with larger size in managing extensive code contexts and fixing bugs spanning across multiple files.
Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement (2025.emnlp-industry)

Copied to clipboard

Challenge: Phonetic Cloaking Replacement (PCR) is a problem in content moderation in China.
Approach: They organize PCR into a four-way surface-form taxonomy and compile PCR-ToxiCN, a dataset of 500 phonetically cloaked offensive posts gathered from the RedNote platform.
Outcome: The proposed model achieves only an F1-score and zero-shot chain-of-thought prompting pushes performance even lower.
Just Adjust One Prompt: Enhancing In-Context Dialogue Scoring via Constructing the Optimal Subgraph of Demonstrations and Prompts (2023.emnlp-main)

Copied to clipboard

Challenge: Using large language models as chatbots can cause hallucinations and lack of empathy, authors report . a dimension-agnostic scoring method is proposed to improve the performance of chatbot performance .
Approach: They propose a dimension-agnostic scoring method that leverages in-context learning . they propose to automatically generate prompts and then request the LLM multiple times .
Outcome: The proposed method outperforms baselines on five datasets.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
Pre-training Language Model as a Multi-perspective Course Learner (2023.findings-acl)

Copied to clipboard

Challenge: Experimental results show that our method significantly improves ELECTRA’s average performance by 2.8% and 3.2% absolute points respectively on GLUE and SQuAD 2.0 benchmarks.
Approach: They propose a multi-perspective course learning method to fetch many degrees and visual angles for sample-efficient pre-training and to fully leverage the relationship between generator and discriminator.
Outcome: The proposed method improves ELECTRA's performance on GLUE and SQuAD 2.0 benchmarks and overshadows recent advanced ELECL-style models under the same settings.
Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors.
Approach: They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques.
Outcome: The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions.
ELAD: Explanation-Guided Large Language Models Active Distillation (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences.
Approach: They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance.
Outcome: The proposed framework significantly improves the efficiency of LLMs knowledge distillation.
UniSpeaker: A Unified Approach for Multimodality-driven Speaker Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: a new framework for speaker generation is proposed to enable multimodal speaker generation . multimodal cues such as visual appearance, textual descriptions, and other biometric signals are still in its early stages.
Approach: a new framework is proposed to enable multimodal speaker generation . the framework uses self-distillation to apply speaker disentanglement to speech generation a model is developed .
Outcome: The proposed framework is the first to support unified voice generation from arbitrary modality combinations.
Perceiving the World: Question-guided Reinforcement Learning for Text-based Games (2022.acl-long)

Copied to clipboard

Challenge: Text-based games provide an interactive way to study natural language processing.
Approach: They propose a two-phase training framework to decouple language learning from reinforcement learning and improve the sample efficiency.
Outcome: The proposed method significantly improves performance and sample efficiency against compound error and limited pre-training data.
Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics (2022.naacl-main)

Copied to clipboard

Challenge: Recent work incorporates pre-trained word embeddings into Neural Topic Models (NTMs), generating highly coherent topics.
Approach: They conduct thorough experiments to investigate whether embeddings directly with an appropriate word selection method can generate more coherent and diverse topics than NTMs.
Outcome: The proposed model generates more coherent and diverse topics than traditional NTMs, achieving higher efficiency and simplicity.
VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery (2026.findings-eacl)

Copied to clipboard

Challenge: MLLMs that use domain-specific data are limited in understanding cultural heritage artifacts such as ancient Greek pottery . supervised fine-tuning improves adaptation to domain knowledge, but it struggles with deeper reasoning tasks.
Approach: They propose a visual question-answer tool that augments SFT with reinforcement learning using verifiable rewards.
Outcome: The proposed model outperforms baseline models on reasoning-intensive questions on ancient Greek pottery.
DiplomacyAgent: Do LLMs Balance Interests and Ethical Principles in International Events? (2025.emnlp-main)

Copied to clipboard

Challenge: a new study examines the safety implications of large language models in diplomatic positions . it identifies potential risks and ideological biases that could arise from LLMs .
Approach: They propose an LLM-based multi-agent system for diplomatic position analysis . they propose ethical constraint measures to enhance the safety of LLMs .
Outcome: The proposed system assesses the safety implications of large language models in diplomacy . it reveals that LLMs could exhibit a strong bias towards interests, leading to unsafe decisions .
TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing RL methods rely on unstructured self-sampling to fit scalar rewards, resulting in inefficient rollouts.
Approach: They propose a structured template-guided RL framework that augments policy optimization with explicit template guidance.
Outcome: Experiments show that TemplateRL outperforms GRPO and GRPI by 99% on AIME and 41% on AMC with superior stability on weak models and remarkable cross-domain generalization.
You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations (2026.findings-acl)

Copied to clipboard

Challenge: Psychological defenses are strategies people use to manage distress.
Approach: They propose a dialogue corpus with help seeker utterances labeled for defense level and a DMRS Co-Pilot pipeline that provides evidence-based pre-annotations.
Outcome: The proposed framework reduces annotation time by 24.0% in a counterbalanced study.
MMCLIP: Cross-Modal Attention Masked Modelling for Medical Language-Image Pre-Training (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-and-language pretraining methods face challenges in reconstructing pathological features due to limited data.
Approach: They propose a method that uses masked modeling to enhance visual and linguistic learning.
Outcome: MMCLIP integrates unpaired data through disease-kind prompts to achieve state-of-the-art performance in zero-shot and fine-tuning across five benchmarks.
Beyond Examples: Towards Automated Thought-level In-Context Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: In-context learning (ICL) struggles with complex reasoning due to superficial, example-level implicit imitation.
Approach: They propose an automated method that shifts from surface-level examples to more guidance-oriented thought patterns.
Outcome: The proposed method achieves 80.6% accuracy on MATH and 62.5% on AMC, surpassing GPT-4o’s 77.2% and 57.5% accuracy.
IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation models for instruction-following have many shortcomings, such as substantial costs and unreliable assessments.
Approach: They propose an LLM critic for fine-grained instruction-following evaluation using a checklist generator and a constraint-level preference optimization method.
Outcome: The proposed model beats strong LLM-as-a-Judge baselines in evaluations under lower computational overhead compared to baselines.
IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for instruction-following lack data coverage and oversimplified pairwise evaluation paradigms that misalign with model optimization scenarios.
Approach: They propose a meta-evaluation benchmark for instruction-following that covers diverse instruction and constraint types and a preference graph for each instruction.
Outcome: Extensive experiments on IF-RewardBench show that the proposed benchmark achieves a stronger positive correlation with downstream task performance compared to existing benchmarks.
CITB: A Benchmark for Continual Instruction Tuning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for instruction tuning do not leverage the rich natural language instructions.
Approach: They propose to use a benchmark to study how instruction tuning works in CL tasks.
Outcome: The proposed method can achieve similar or better results than existing CL methods.
Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomalies (2025.naacl-long)

Copied to clipboard

Challenge: Existing household robots are inability to recognize potential problems or dangers in home environments.
Approach: They propose a task of creating anomaly scenarios using generative models instead of manually labeled data to build simulated environments.
Outcome: The proposed framework outperforms existing models in terms of task description and scene diversity.
Open-ended Commonsense Reasoning with Unrestricted Answer Candidates (2023.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to commonsense reasoning are limited due to limited answer scope.
Approach: They propose to solve a commonsense question without a pre-defined answer scope . they leverage pre-trained language models to iteratively retrieve reasoning paths on the external knowledge base .
Outcome: The proposed method achieves better performance on two commonsense benchmark datasets.
GRAG: Graph Retrieval-Augmented Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and is not suitable for networked documents.
Approach: They propose a novel divide-and-conquer strategy that retrieves optimal subgraph structure in linear time.
Outcome: The proposed approach outperforms current state-of-the-art methods on graph reasoning benchmarks.
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice.
Approach: They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation.
Outcome: The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability .
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)

Copied to clipboard

Challenge: OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown.
Approach: They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning.
Outcome: The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods.
Efficient Knowledge Infusion via KG-LLM Alignment (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for knowledge infusion face knowledge mismatch and poor information compliance of LLMs with knowledge graphs.
Approach: They propose a three-stage alignment strategy to enhance the LLM's capability to utilize information from knowledge graphs.
Outcome: The proposed method outperforms baselines on biomedical question-answering datasets and outperformed existing methods.
Advancing Parameter Efficiency in Fine-tuning via Representation Editing (2024.acl-long)

Copied to clipboard

Challenge: Parameter Efficient Fine-Tuning (PEFT) has gained significant attention for its ability to achieve competitive results while updating only a small subset of trainable parameters.
Approach: They propose a new approach to fine-tuning neural models that scales and biases the representation produced at each layer.
Outcome: The proposed approach reduces the number of trainable parameters by a factor of 25,700 compared to full parameter fine-tuning and by . 32 compared with LoRA.
COMPASS: Enhancing Agent Long-Horizon Reasoning with Evolving Context (2026.acl-long)

Copied to clipboard

Challenge: Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents.
Approach: They propose a framework that separates tactical execution, strategic oversight, and context organization into three specialized components.
Outcome: The proposed framework improves accuracy by 20% relative to baselines on GAIA, BrowseComp, and Humanity’s Last Exam tasks.
Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning.
Approach: They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties.
Outcome: The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion.
Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process.
Approach: They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing.
Outcome: The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing.
Relation-aware Ensemble Learning for Knowledge Graph Embedding (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to explore semantics of knowledge graphs have been proposed to explore these semantics in distinct ways.
Approach: They propose to leverage existing methods in relation-aware manner to learn an ensemble by leveraging existing methods.
Outcome: The proposed method has the same computation cost as general ensemble methods but with much better performance on benchmark datasets.
RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Knowledge graph question answering (KGQA) aims to answer natural language questions using knowledge graphs.
Approach: They propose a framework that retrieves refined reasoning paths and evaluates their sufficiency.
Outcome: The proposed framework outperforms existing baselines while enabling small open-source LLMs to achieve competitive results without fine-tuning LLM.
DiffStyleTTS: Diffusion-based Hierarchical Prosody Modeling for Text-to-Speech with Diverse and Controllable Styles (2025.coling-main)

Copied to clipboard

Challenge: Existing models for text-to-speech (TTS) synthesize speech with acoustic features . autoregressive models have problems with word skipping and repeated reading . non-autoregressive acustic models lack probabilistic modeling and unimodal characteristics of Gaussian distribution don't conform to true distribution of aural features, which restricts the diversity of generated prosodic features.
Approach: They propose a multi-speaker acoustic model that hierarchically models speech prosodic features and controls different prosodic styles to guide prosody prediction.
Outcome: The proposed method outperforms baseline models in naturalness and achieves superior synthesis speed compared to baseline models.
DecIF: Improving Instruction-Following through Decomposition (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to obtain high-quality instruction-following data rely heavily on existing documents and existing methods.
Approach: They propose a data synthesis framework, DecIF, which automatically generates accurate and diverse instruction-following data from scratch for supervised fine-tuning and reinforcement learning.
Outcome: Extensive experiments show that the proposed framework can synthesize accurate instruction-following data for both SFT and RL paradigms compared to baselines.
Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents with Citation-Aware Rubric Rewards (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning (RL) rely on binary outcome rewards that fail to capture the comprehensiveness and factuality of agents’ reasoning process.
Approach: They propose a reward framework that emphasizes reasoning comprehensiveness, factual grounding, and evidence connectivity.
Outcome: The proposed framework outperforms standard outcome-based RL baselines across multiple deep search benchmarks and shows that it discourages shortcut exploitation and promotes comprehensive, evidence-grounded reasoning.
MedINST: Meta Dataset of Biomedical Instructions (2024.findings-emnlp)

Copied to clipboard

Challenge: Medical data and tasks require extensive preprocessing and standardization for effective use in training LLMs.
Approach: They propose to use MedINST as a meta-dataset to evaluate LLMs' generalization ability.
Outcome: The meta-dataset of biomedical instruction measures the generalization ability of LLMs across multiple open-domain tasks.
Turn-Level Active Learning for Dialogue State Tracking (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to annotate dialogues require supervised training, which requires human workers to manually annotates dialogues.
Approach: They propose a turn-level active learning framework to actively select dialogue turns to annotate . their approach can achieve comparable performance to traditional training approaches .
Outcome: The proposed model achieves comparable performance to existing training approaches with significantly less annotated data.
BNLP: A Text Annotation Platform for Quality Control of LLM-Generated Annotations (2026.findings-acl)

Copied to clipboard

Challenge: Existing annotation tools lack support for Large Language Models (LLMs) or use LLMs as one-off preannotation engines, compromising data reliability.
Approach: They propose a text annotation platform that embeds LLM-assisted labeling into a quality-aware collaborative workflow.
Outcome: Experiments show that BNLP reduces annotation time by 74.3% and improves annotation quality by 11.6% over purely manual annotation in LLM-assisted settings.
Promoting Data and Model Privacy in Federated Learning through Quantized LoRA (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing federated learning frameworks require substantial data and computational resources to develop large language models.
Approach: They propose a method that distributes a quantized version of the model’s parameters during training and combine it with a popular fine-tuning method to significantly reduce communication costs.
Outcome: The proposed method enables accurate estimations for parameter updates while preventing clients from accessing a model whose performance is comparable to the centrally hosted one.
Synapse: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models excel at generalized reasoning, but lack the ability to accumulate experiences and maintain narrative coherence over long horizons.
Approach: They propose a unified memory architecture that transcends static vector similarity.
Outcome: The proposed model outperforms state-of-the-art methods in temporal and multihop reasoning tasks.
ASTRA: An Automated Framework for Strategy Discovery, Retrieval, and Evolution for Jailbreaking LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods lack the capability for continuous learning and self-evolution from interactions, limiting the diversity and adaptability of attack strategies.
Approach: They propose an automated framework capable of discovering, retrieving, and evolving attack strategies.
Outcome: The proposed framework outperforms existing baselines in a black-box setting.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations