Papers by Qi Song

40 papers
Verified Critical Step Optimization for LLM Agents (2026.findings-acl)

Copied to clipboard

Challenge: Critical Step Optimization (CSO) focuses preference learning on verified critical steps where alternative actions demonstrably flip task outcomes from failure to success.
Approach: They propose a method which focuses preference learning on verified critical steps where alternative actions demonstrably flip task outcomes from failure to success.
Outcome: The proposed method outperforms the existing methods on GAIA-Text-103 and XBench-DeepSearch while requiring supervision at only 16% of trajectory steps.
Augmenting Multi-Turn Text-to-SQL Datasets with Self-Play (2022.findings-emnlp)

Copied to clipboard

Challenge: Numerous architectures and pretraining methods have been proposed for context-dependent text-to-SQL, but the size of the datasets used has been limited due to the high cost of annotating multi-turn dialogue and SQL pairs.
Approach: They propose to augment training datasets using self-play which leverages contextual information to synthesize new interactions to adapt the model to new databases.
Outcome: The proposed model improves accuracy on SParC and CoSQL, two widely used cross-domain text-to-SQl datasets.
Sentence-State LSTM for Text Representation (P18-1)

Copied to clipboard

Challenge: LSTMs have been shown to suffer from various limitations due to their sequential nature.
Approach: They propose to model hidden states of all words simultaneously at each recurrent step rather than one word at a time.
Outcome: The proposed model has strong representation power, giving competitive performances compared to stacked BiLSTM models with similar parameter numbers.
UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model (2025.findings-naacl)

Copied to clipboard

Challenge: Representative models like LLaVA and MiniGPT-4 have great capabilities in various tasks.
Approach: They propose a unified model to represent various multi-modal tasks using a single representation.
Outcome: The proposed model outperforms existing models in a variety of tasks while maintaining generality and scalability.
Beyond Function-Level Search: Repository-Aware Dual-Encoder Code Retrieval with Adversarial Verification (2025.findings-emnlp)

Copied to clipboard

Challenge: escalating complexity of modern codebases has intensified the need for code retrieval systems capable of interpreting cross-component change intents.
Approach: RepoAlignBench is a benchmark designed to evaluate repository-level code retrieval . the benchmark proposes an adversarial reflection-augmented dual-tower architecture .
Outcome: The proposed framework achieves 12.2% Top-5 Accuracy and 7.1% Recall improvements over state-of-the-art benchmarks.
One Battle After Another: Probing LLMs’ Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for instruction-following in multi-topic dialogues are limited to a fixed number of turns, susceptible to saturation and failing to account for users’ interactive experience.
Approach: They propose a framework featuring a three-layer tracking mechanism and a query synthesis agent to mimic sequential user behaviors.
Outcome: The proposed framework outperforms existing benchmarks in the evaluation of instruction following in multi-topic dialogues and demonstrates deficiencies in failure recovery and fine-grained instruction following.
Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Current mitigation strategies fail to preserve contextual reasoning capabilities in risky scenarios, leading to systemic risks for legal compliance.
Approach: They propose to use reinforcement learning with a rule-based reward to incentivize contextual reasoning capabilities while enhancing compliance with safety and privacy norms.
Outcome: The proposed model outperforms Qwen2.5-7B-Instruct model in safety and privacy benchmarks and achieves +8.58% accuracy improvement.
Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors.
Approach: They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) .
Outcome: The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench.
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on large language model-based agents focus on evaluation benchmarks without training support.
Approach: They propose a large-scale Chinese shopping simulation environment that uses large language models to train agents.
Outcome: The proposed model performs poorly in a large-scale and challenging shopping environment in China.
Is Large Language Model Performance on Reasoning Tasks Impacted by Different Ways Questions Are Asked? (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on Large Language Models (LLMs) have not investigated the impact of question types on LLM performance.
Approach: They evaluate the performance of five Large Language Models on reasoning tasks . they use quantitative reasoning tasks and deductive reasoning tasks to evaluate the models .
Outcome: The results show that Reasoning accuracy does not correlate with final selection accuracy.
Democratizing Reasoning Ability: Tailored Learning from Large Language Model (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature.
Approach: They propose a tailored learning approach to distill the exclusive reasoning ability to smaller LMs to facilitate democratization.
Outcome: The proposed approach enables the democratization of the exclusive reasoning ability by leveraging the black-box model as a reasoning teacher.
Unsupervised Chinese Word Segmentation with BERT Oriented Probing and Transformation (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods for unsupervised Chinese word segmentation exploit shallow semantic information, which can miss important context.
Approach: They propose to take advantage of deep contextual semantic information with a self-training manner to transform it into explicit word segmentation ability.
Outcome: The proposed approach achieves state-of-the-art F1 score on two CWS benchmark datasets.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Towards Understanding Omission in Dialogue Summarization (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for dialogue summarization are far from satisfactory . omission is a major factor in affecting the quality of summarizing, but few studies have explored the problem .
Approach: They propose a dataset that provides high-quality omission labels for dialogue summarization . they propose to use this dataset to detect omitted dialogue utterances .
Outcome: The proposed dataset improves summarization quality by providing ground-truth omission labels . the proposed dataset and codes are publicly available .
Auto Search Indexer for End-to-End Document Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Generative retrieval heavily relies on the “preprocessed” document identifiers, thus limiting its retrieval performance and ability to retrieve new documents.
Approach: They propose a fully end-to-end retrieval paradigm that can learn the best docids for existing and new documents automatically via a semantic indexing module.
Outcome: The proposed model outperforms baselines on public and industrial datasets and can handle new documents.
Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multi-modal large language models have demonstrated remarkable capabilities in multimodal understanding, reasoning, and interaction.
Approach: They propose a method that effectively aligns and integrates multi-scale knowledge of objects . they use a pipeline that provides over 300K essential training data to enhance alignment .
Outcome: The proposed method effectively aligns and integrates multi-scale knowledge of objects, including texts, coordinates, and images.
Beyond the Tip of Efficiency: Uncovering the Submerged Threats of Jailbreak Attacks in Small Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Small language models (SLMs) have become increasingly prominent in the deployment on edge devices due to their high efficiency and low computational cost.
Approach: They evaluate the security performance of 13 state-of-the-art small language models under various jailbreak attacks.
Outcome: The proposed methods demonstrate that SLMs are quite susceptible to jailbreak attacks and some are even vulnerable to harmful prompts.
GroundingGPT: Language Enhanced Multi-modal Grounding Model (2024.acl-long)

Copied to clipboard

Challenge: Existing multi-modal large language models focus on capturing global information while neglecting the fine-grained local information in multimodal inputs.
Approach: They propose an end-to-end language enhanced multi-modal grounding model that performs fine-grained grounding tasks for image, video and audio.
Outcome: The proposed model achieves impressive fine-grained understanding of multi-modal inputs while maintaining or improving its global comprehension capabilities.
Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: Existing studies have explored the evolutionary analysis of ancient scripts, with particular attention to the transformation of character forms from oracle bone inscriptions to regular script.
Approach: They propose a benchmark framework that leverages MLLMs to analyze the evolution of ancient Chinese scripts.
Outcome: The proposed framework improves performance on core tasks and character recognition and evolutionary reasoning tasks while limiting performance on other tasks.
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles (2025.emnlp-main)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated strong reasoning abilities across complex mathematical and scientific domains.
Approach: They propose a framework to assess whether LLMs can capture and apply personalized reasoning styles in social deduction games.
Outcome: The proposed framework evaluates LLMs on the game Avalon and shows that they can capture and apply individualized reasoning styles.
CoRec: An Easy Approach for Coordination Recognition (2023.emnlp-main)

Copied to clipboard

Challenge: Existing syntactic parsers are slow and suffer from errors, especially for long and complicated sentences.
Approach: They propose a pipeline model COordination RECognizer with coordinator identifier and conjunct boundary detector.
Outcome: The proposed model improves the yield of state-of-the-art Open IE models by reducing errors and slow processing time.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
Question Directed Graph Attention Network for Numerical Reasoning over Text (2020.emnlp-main)

Copied to clipboard

Challenge: Numerical reasoning requires both natural language understanding and arithmetic computation.
Approach: They propose a graph representation for the context of the passage and question needed for numerical reasoning.
Outcome: The proposed model achieves remarkable results in benchmark datasets such as DROP.
ResLoRA: Identity Residual Mapping in Low-Rank Adaption (2024.findings-acl)

Copied to clipboard

Challenge: Low-rank adaptation (LoRA) is one of the most popular parameter-efficient fine-tuning methods.
Approach: They propose a low-rank adaptation method that adds residual paths during training and merges them together during inference to achieve better results.
Outcome: The proposed method achieves 2.5x faster convergence speed and improves performance by 14.3% on NLG, NLU, and text-to-image tasks.
TIGER: Text-Informed Generalized Enzyme-Reaction Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to enzyme–reaction retrieval suffer from poor generalization across tasks and distributions . TIGER is a text-informed generalized enzyme-reaction retrieval framework that bridges enzymes and biochemical reactions.
Approach: They propose a text-informed generalized enzyme-reaction retrieval framework that leverages protein-to-text generation models to distill textual knowledge from enzyme sequences.
Outcome: The proposed framework outperforms state-of-the-art methods in enzyme–reaction retrieval tasks and distributions.
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)

Copied to clipboard

Challenge: Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges .
Approach: They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions.
Outcome: The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset .
Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have led to significant success in using LLMs as agents.
Approach: They propose a cognitive framework that incorporates first-order and second-order perspective transitions into LLMs to enhance their ability to identify and counteract deceptive information.
Outcome: The proposed framework enhances LLMs’ ability to identify and counteract deceptive information without extra fine-tuning and data.
EconProver: Towards More Economical Test-Time Scaling for Automated Theorem Proving (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have recently advanced the field of Automated Theorem Proving (ATP) Existing cost analyses regulate only the number of sampling passes, ignoring the substantial disparities in sampling costs.
Approach: They propose to integrate two complementary methods into a unified EconRL pipeline to increase pass rates under constrained sampling passes.
Outcome: The proposed method reduces token usage and sample passes while maintaining the original performance.
MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol (2025.emnlp-main)

Copied to clipboard

Challenge: Model Context Protocol (MCP) introduces an easy-to-use ecosystem for users and developers, but it also brings underexplored safety risks.
Approach: They propose a framework that addresses the missing safety mechanisms in MCP and a taxonomy that captures diverse range of unsafe behaviors observed in MMP scenarios.
Outcome: The proposed framework improves safety performance on state-of-the-art LLMs by capturing unsafe behaviors and analyzing the results.
RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Knowledge graph question answering (KGQA) aims to answer natural language questions using knowledge graphs.
Approach: They propose a framework that retrieves refined reasoning paths and evaluates their sufficiency.
Outcome: The proposed framework outperforms existing baselines while enabling small open-source LLMs to achieve competitive results without fine-tuning LLM.
Parrot: A Training Pipeline Enhances Both Program CoT and Natural Language CoT for Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing work focuses on enabling models to generate natural language chain-of-thought rationales or leverage executable and verifiable code, such as Python.
Approach: They propose a novel training pipeline that integrates sequential P-CoT and N-Co T generation and a subtask hybrid training strategy to facilitate natural language transferability.
Outcome: The proposed training pipeline improves both N-CoT and P-Co T performance over the RL baseline.
CoRAG: Enhancing Hybrid Retrieval-Augmented Generation through a Cooperative Retriever Architecture (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base, which often miss relevant information located further away from a global view.
Approach: Hybrid-RAG combines textual documents and graph-structured relational information for RAG . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base .
Outcome: Hybrid-RAG combines textual documents and graph-structured relational information . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base .
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence.
Approach: They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included .
Outcome: The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model.
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework (2025.findings-naacl)

Copied to clipboard

Challenge: Existing knowledge enhancement techniques for pre-trained language models (PLMs) introduce noisy entity representations.
Approach: They propose a knowledge enhancement filter that integrates external knowledge bases to enhance PLMs' ability to capture entity knowledge.
Outcome: The proposed method achieves the highest F1-score and accuracy while reducing the computational cost by 1.7-2.5x.
Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for hallucination detection are coarse-grained and lack long-range consistency checks.
Approach: They propose a benchmark for long-form hallucination detection that incorporates diverse entity types and intricate factual dependencies spanning extended contexts.
Outcome: The proposed framework outperforms baselines and robustly integrates fact-centric hyper-relational knowledge graphs.
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Challenge: generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach: They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome: The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.
QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research has focused on smaller, task-specific models enhanced by distilling knowledge from LLMs, but the diversity and quality of negative knowledge remains understudied.
Approach: They propose a quality-guided contrastive rationale distillation framework that aims to enhance reasoning capabilities through contrastive knowledge learning.
Outcome: The proposed method consistently outperforms existing distillation techniques yielding higher-quality rationales.
PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility.
Approach: They propose a contextual privacy evaluation benchmark that covers the entire relevant social context through private information flows.
Outcome: The proposed benchmarks cover legal compliance, real court cases, privacy policies, and synthetic data.
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP).
Approach: They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses.
Outcome: The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations