Papers by Rui Song

40 papers
Towards Modern Topic Models: A Survey of Taxonomies and Paradigm Shifts from Algorithm-Centric to LLM-Centered Topic Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing.
Approach: They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows.
Outcome: The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows.
F2TEval: Human-Aligned Multi-Dimensional Evaluation for Figure-to-Text Task (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluation methods for Figure-to-Text tasks are limited due to the inherent ambiguity and semantic compression of figures, the generated texts suffer from factual inaccuracies, incomplete coverage, and weak logical reasoning.
Approach: They propose a five-dimensional reference-free evaluation method aligned with expert criteria to support fine-grained evaluation.
Outcome: The proposed method outperforms Gemini-2.0 and Claude-3.5 with only 0.9B parameters.
Toward Robust In-Context Learning: Leveraging Out-of-distribution Proxies for Target Inaccessible Demonstration Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) perform well on Out-of-Distribution tasks, but performance degrades as distribution shift becomes more severe.
Approach: They propose a demonstration search framework that incorporates an OOD proxy to approximate the inaccessible target domain and guide the retrieval process.
Outcome: The proposed framework enhances robustness in out-of-distribution tasks by incorporating an OOD proxy to approximate the inaccessible target domain and guide the retrieval process.
The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies assume fake news is inherently existing rather than exploring its gradual formation.
Approach: They propose a Large Language Model-based simulation approach explicitly focusing on fake news evolution from real news.
Outcome: The proposed framework captures fake news evolution patterns and accurately reproduces known fake news, aligning closely with human evaluations.
Iterative Document Representation Learning Towards Summarization with Polishing (D18-1)

Copied to clipboard

Challenge: Existing summarization methods read through document only once to generate a document representation, resulting in a sub-optimal representation.
Approach: They propose an iterative model for supervised extractive text summarization which polishes the document representation on many passes through the document.
Outcome: The proposed model outperforms state-of-the-art extractive systems on CNN/DailyMail and DUC2002 datasets.
Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems (2025.emnlp-main)

Copied to clipboard

Challenge: Existing platforms lack a mechanism for user actions to dynamically reshape the environment.
Approach: They propose a novel agent-based simulation platform for recommender systems with a robust interaction mechanism.
Outcome: The proposed platform improves the credibility of the simulation and replicates the Matthew Effect and Brand Loyalty.
From Phrases to Subgraphs: Fine-Grained Semantic Parsing for Knowledge Graph Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to knowledge graph question answering (KGQA) face semantic misalignment and reasoning noise.
Approach: They propose a fine-grained semantic parsing framework for KGQA that maps natural language queries to executable logical forms.
Outcome: The proposed framework achieves 18.5% performance improvement over the SOTA on a multi-hop CWQ dataset.
CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to evaluate large language models are prone to data contamination.
Approach: They propose a method which parses contaminated data and back-translates it into a candidate set.
Outcome: The proposed method reduces data contamination and evaluates the LLMs more cleanly.
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: specialized LLMs are often limited in domain-specific applications that require specialized knowledge.
Approach: They provide a comprehensive overview of four key methods to enhance large language models by integrating domain-specific knowledge.
Outcome: The proposed methods are categorized into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization.
Beyond Single Frames: Can LMMs Comprehend Implicit Narratives in Comic Strip? (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Multimodal Models have demonstrated strong performance on vision-language benchmarks, yet current evaluations focus on single-image reasoning.
Approach: STRIPCIPHER is a benchmark designed to evaluate model ability on understanding implicit narratives in silent comics.
Outcome: STRIPCIPHER is a high-quality, human-annotated dataset featuring fine-grained annotations and comprehensive coverage of varying difficulty levels.
Interactive Semantic Parsing with Reinforcement Learning for Knowledge Graph Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve LLM reliability rely on factual hallucinations . Existing methods rely only on graph traversal, resulting in imprecise retrieval and heavy post-processing burdens.
Approach: They propose a framework that integrates knowledge Graphs as structured, high-fidelity buffers to enhance LLM reliability.
Outcome: The proposed framework allows logical constraints to be dynamically interleaved with graph search while optimizing via reinforcement learning with only final answer feedback eliminates the need for gold program annotations.
A Sequence-to-Structure Approach to Document-level Targeted Sentiment Analysis (2023.findings-emnlp)

Copied to clipboard

Challenge: Aspect-based sentiment analysis (ABSA) has received wide attention in NLP for nearly two decades . previous studies focused on sentence-level ABSA, but document-level research has not received enough attention.
Approach: They propose a Sequence-to-Structure approach to address the document-level targeted sentiment analysis task, which aims to extract the opinion targets consisting of multi-level entities from a review document and predict their sentiments.
Outcome: The proposed approach outperforms baselines on six domains on the document-level targeted sentiment analysis task.
Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Misleading visualizations can distort perception and lead to incorrect conclusions.
Approach: They propose a large-scale multimodal dataset to evaluate MLLMs on misleading chart reasoning.
Outcome: The proposed framework evaluates MLLMs on misleading chart reasoning on a large-scale multimodal dataset spanning 21 misleader types and 10 chart types . it contains 3,026 curated examples spanning standard chart code, CSV data, multiple-choice questions, and labeled explanations, validated through iterative MLML checks and exhausted expert human review.
Model Surgery: Modulating LLM’s Behavior Via Simple Parameter Editing (2025.naacl-long)

Copied to clipboard

Challenge: Current approaches for detoxification or preventing jailbreaking involve fine-tuning billions of parameters through gradient descent with substantial computational cost.
Approach: They propose to use supervised fine-tuning and Reinforcement Learning from human feedback to modify LLMs' behavior by directly editing a small subset of parameters.
Outcome: Experiments show that editing a small subset of parameters can modulate specific behaviors of LLMs, such as detoxification and resistance to jailbreak, with only inference-level computational resources.
A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese (2026.tacl-1)

Copied to clipboard

Challenge: Using sub-linear length normalized log-probabilities (SLLN-LP), we find unequal lengths of sentences in minimal pairs difficult for LMs even up to 32B parameters.
Approach: They propose to use ZhoBLiMP as a linguistic minimal pair benchmark for Chinese language models to mitigate biases.
Outcome: The proposed metric mitigates biases in Chinese language models with over 100 paradigms . Anaphor, Quantifiers, and Ellipsis are difficult for LMs even up to 32B parameters .
Distilling the Essence, Discarding the Dross: Improving Fairness in Multimodal Large Language Models via Historical Reflection-Guided Prompt Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to debiase MLLMs rely on handcrafted prompts that are brittle and difficult to generalize across tasks and bias types.
Approach: They propose an adaptive self-debiasing framework that optimizes task-specific debiasers to suppress stereotypical outputs.
Outcome: The proposed framework suppresses stereotypical outputs while maintaining performance.
High-Order Semantic Alignment for Unsupervised Fine-Grained Image-Text Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies focus on learning global or local correspondence, but lack fine-grained local-global alignment.
Approach: They propose a High Order Semantic Alignment (HOSA) model that can provide complementary and comprehensive semantic clues to infer correlation scores.
Outcome: The proposed model outperforms state-of-the-art models in retrieving the most relevant results.
Data-Centric Explainable Debiasing for Improving Fairness in Pre-trained Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing data-centric debiasing strategies mainly leverage explicit bias words for counterfactual data augmentation to balance the training data.
Approach: They propose a method which uses an explainability method to search for implicit bias words to assist in debiasing PLMs.
Outcome: Extensive results show that the proposed method achieves state-of-the-art debiasing performance and strong generalization while maintaining predictive abilities.
A Dual-Mind Framework for Strategic and Expressive Negotiation Agent (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to negotiation dialogue focus on only one aspect, ignoring the synergistic effect of their combined synergies.
Approach: They propose a dual-mind negotiation agent framework that integrates an intuitive and a deliberative module for slow, expression optimization.
Outcome: The proposed framework achieves state-of-the-art on negotiation datasets showing that it improves negotiation ability.
Knowledge-Aware Co-Reasoning for Multidisciplinary Collaboration (2025.emnlp-main)

Copied to clipboard

Challenge: Existing multi-agent paradigms rely on prompt engineering and lack of knowledge integration.
Approach: They propose a framework that integrates structured knowledge reasoning into multidisciplinary collaboration by using clinical knowledge graphs to guide dynamic discipline determination.
Outcome: Extensive experiments on academic and real-world datasets demonstrate the effectiveness of the proposed framework.
Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: Existing studies have explored the evolutionary analysis of ancient scripts, with particular attention to the transformation of character forms from oracle bone inscriptions to regular script.
Approach: They propose a benchmark framework that leverages MLLMs to analyze the evolution of ancient Chinese scripts.
Outcome: The proposed framework improves performance on core tasks and character recognition and evolutionary reasoning tasks while limiting performance on other tasks.
Generating Classical Chinese Poems via Conditional Variational Autoencoder and Adversarial Training (D18-1)

Copied to clipboard

Challenge: Existing models for automatic poetry generation lack term novelty and thematic consistency.
Approach: They propose a conditional variational autoencoder with adversarial training for classical Chinese poem generation.
Outcome: The proposed model outperforms existing models on a large poetry corpus on 'classical Chinese' . it generates poems with novel terms and learns their thematic consistency with their titles.
CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing Vision-language models are prone to hallucinating nonexistent entities or events and missing subtle but critical visual cues.
Approach: They propose a Traffic VideoQA Benchmark that enforces a single structured decision pattern over each video question quadruple and provides actionable diagnostics that decompose failures into positive omission, positive swap, negative hallucination, mutual-exclusivity violation.
Outcome: The proposed model detects true hazards when an accident occurs, and rejects plausible-but-false hypotheses under near-identical counterfactual scenes.
Reverse Chain: A Generic-Rule for LLMs to Master Multi-API Planning (2024.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to enable large language models to implement function calling are limited in their tool-use capabilities.
Approach: They propose a controllable, target-driven approach to empower LLMs to operate external APIs only via prompts.
Outcome: The proposed approach limits LLMs to executing simple tasks, e.g., API Selection and Argument Completion.
From Fake to Real: Mitigating Out-of-Distribution Bias in In-Context Learning via Feedback Supervision from Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: In-Context Learning (ICL) is one of the most common methods for complex Natural Language Understanding tasks.
Approach: They propose a method that uses model confidence and perturbation perplexity to enhance the quality of pseudo-labels.
Outcome: The proposed method reduces OOD biases by avoiding direct use of source data.
Graph Neural Network Enhanced Retrieval for Question Answering of Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing retrieval methods divide reference documents into passages, treating them in isolation. Existing methods only use contiguous passages or keywords.
Approach: They propose a retrieval method that leverages graph neural networks to exploit relatedness between passages to enhance retrieval.
Outcome: The proposed method improves retrieval by exploiting the relatedness between passages.
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
ReAgent: Reversible Multi-Agent Reasoning for Knowledge-Enhanced Multi-Hop QA (2025.emnlp-main)

Copied to clipboard

Challenge: Multi-hop question answering (QA) is a central challenge in natural language processing . early mistakes can cause errors and undermine the final result, authors say .
Approach: They propose a reversible multi-agent reasoning framework that backtracks to earlier valid states when conflicts arise.
Outcome: Empirical evaluation shows that the framework improves on forward-only benchmarks by 6% . the approach enables agents to backtrack to valid states when conflicts arise .
A Simple Contrastive Learning Framework for Interactive Argument Pair Identification via Argument-Context Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing work on argument mining uses context-based methods to identify whether two arguments are interactively related.
Approach: They propose a contrastive learning framework to extract valuable information from the context.
Outcome: The proposed framework achieves state-of-the-art performance on the benchmark dataset and visually displays more compact representations.
Locally Aggregated Feature Attribution on Natural Language Model Understanding (2022.naacl-main)

Copied to clipboard

Challenge: a growing popularity of deep-learning models makes model understanding more important . feature attribution methods have shown promising results in computer vision but are not trivial .
Approach: They propose a gradient-based feature attribution method that smooths gradients by aggregating similar reference texts derived from language model embeddings.
Outcome: The proposed method outperforms existing methods on public datasets and key words detection tasks.
Beyond Benchmarks: A Capability-Based Maturity Model for Systematic AI Integration in Hospitals (2026.findings-acl)

Copied to clipboard

Challenge: Current Large Language Models (LLMs) excel in standardized tests focused on medical knowledge recall, but not in real-world healthcare scenarios.
Approach: They propose a "capability-based hospital AI Maturity Model" framework that categorizes capabilities into distinct maturity levels . medical artificial intelligence is currently at a critical transition stage from technical verification to deep clinical integration .
Outcome: The proposed model provides a clear, stepwise evolutionary path for hospitals from foundational infrastructure construction to ubiquitous intelligence.
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)

Copied to clipboard

Challenge: Commercial news provides rich semantics and timely information for automated financial risk detection.
Approach: They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement.
Outcome: The proposed model outperforms existing models in terms of generalization and semantics and annotation.
When Personalization Tricks Detectors: The Feature-Inversion Trap in Machine-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Personalized MGT detection remains largely underexplored due to personalization challenges . large language models (LLMs) can imitate personal writing styles, but they can generate fake news and misinformation.
Approach: They propose a benchmark to evaluate detector robustness under personalization . they attribute this limitation to a feature-inversion trap that flips the effect in personalized contexts .
Outcome: The proposed framework predicts detector robustness under personalization with an 85% correlation to actual results.
Efficient Data Labeling by Hierarchical Crowdsourcing with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Large language models (LLMs) have been gaining attention for their impressive performance in in-context dialogues.
Approach: They propose a hierarchical framework that leverages multiple LLMs for efficient data labeling under budget constraints.
Outcome: The proposed framework outperforms human labelers and GPT-4 in terms of accuracy and efficiency.
ACSE: An Ancient Character Semantic-Aware Embedding for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on pre-Qin documents are insufficient to understand ancient characters . ancient characters have a low level of digitization and training corpora are extremely scarce .
Approach: They propose a semantic-aware embedding for ancient Chinese characters that integrates glyphs and lexicality into modern Chinese semantic space.
Outcome: The proposed model integrates glyph and lexicality of ancient characters and maps them to the modern Chinese semantic space.
Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have focused on replacing the reward model in Reinforcement Learning with Human Feedback (RLHF) methods for Large Language Models (LLMs).
Approach: They propose a self-supervised preference optimization framework that replaces the reward model with a preference loss and alignment loss to improve LLMs' ability to understand human preferences.
Outcome: The proposed framework can be integrated with existing preference optimization methods and significantly boost their performance.
DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-language models lack fine-grained classification, single-view imagery, and inaccurate metadata.
Approach: They propose a hierarchical, multi-view benchmark to evaluate VLMs across three levels of cognitive complexity.
Outcome: The proposed benchmark evaluates vision-language models across three levels of complexity . it systematically identifies five primary failure modes . the proposed benchmarks are available on https://github.com/meituan/DiningBench.
Learning to Customize Model Structures for Few-shot Dialogue Generation Tasks (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for training generative models with minimal corpus are difficult . fine-tuning distinguishes tasks from parameter perspective but ignores model-structure perspective .
Approach: They propose an algorithm that can customize a unique dialogue model for each task in the few-shot setting.
Outcome: The proposed method outperforms baselines on two datasets in task consistency, response quality, diversity and consistency.
Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for open attribute value extraction for emerging entities are noisy or incomplete, even missing.
Approach: They propose a knowledge-guided reinforcement learning framework for open attribute value extraction for emerging entities.
Outcome: The proposed framework outperforms baselines by 16.5 - 27.8%.
OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for Knowledge-Based Visual Question Answering lack multimodal retrieval . large language models (LLMs) have demonstrated remarkable generalization and reasoning capabilities in text-based systems.
Approach: They propose a multimodal vision-language retrieval-augmented generation system that harmonizes multiple modalities and modality to enhance retrieval.
Outcome: The proposed system achieves state-of-the-art retrieval performance and competitive answers on InfoSeek and Encyclopedic-VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations