Papers by Bo Sun

49 papers
All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG (2026.acl-long)

Copied to clipboard

Challenge: Existing mRAG systems suffer from a language bias during reranking, systematically favoring English and the query’s native language.
Approach: They propose a language-agnostic utility-driven reranker alignment technique to mitigate language bias during re-ranking.
Outcome: The proposed approach mitigates language bias and consistently improves mRAG performance across languages.
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment (2025.findings-acl)

Copied to clipboard

Challenge: Medical dialogue systems (MDS) struggle to identify relevant medical knowledge and generate accurate responses.
Approach: They propose a medical dialogue system that integrates knowledge refining and dynamic prompt adjustment to improve medical knowledge and accuracy.
Outcome: The proposed system outperforms state-of-the-art systems in both generation quality and medical entity accuracy.
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework (2023.findings-acl)

Copied to clipboard

Challenge: Existing models of robustness evaluation are incomprehensive, impractical, and invalid .
Approach: They propose a framework for automatic robustness evaluation that shifts towards model-centric evaluation to further exploit the advantages of adversarial attacks.
Outcome: The proposed framework is based on a model-centric evaluation protocol and a robustness evaluation protocol.
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)

Copied to clipboard

Challenge: TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations.
Approach: They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity.
Outcome: The proposed model performs poorly on visual and structural complexity.
Rethinking Smoothness for Fast and Adaptable Entity Alignment Decoding (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs rely on entity and relation embeddings . Fig. 1 shows how to decode knowledge graph in under 6 seconds .
Approach: They propose a framework that only utilizes entity embeddings to decode knowledge graphs.
Outcome: The proposed framework reconstructs KG representation by maximizing smoothness of entity embeddings.
Unifying Inference-Time Planning Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are used to generate a formal representation of a plan in a planning language.
Approach: They propose a unifying organizational framework based on intermediate representations to unify the inference-time LLM-as-formalizer methodology for classical planning.
Outcome: The proposed framework subsumes most existing work and proposes new ones that involve syntactically similar but high-resource intermediate languages.
DecoupleSearch: Decouple Planning and Search via Hierarchical Reward Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems have emerged as a pivotal methodology for enhancing Large Language Models (LLMs).
Approach: They propose a framework that decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
Outcome: The proposed framework decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation.
Approach: a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 .
Outcome: a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 .
From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing via Synchronous Semantic Decoding (2021.acl-long)

Copied to clipboard

Challenge: Experimental results show that Synchronous Semantic Decoding (SSD) can achieve state-of-the-art unsupervised semantic parsing performance on multiple datasets.
Approach: They propose an unsupervised method which solves the semantic gap and the structure gap by leveraging paraphrasing and grammar-constrained decoding.
Outcome: The proposed method can solve the semantic gap and structure gap on multiple datasets.
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing (2022.emnlp-main)

Copied to clipboard

Challenge: Existing studies on semantic parsing use Maximum Likelihood Estimation (MLE) to train discriminative semantic parses.
Approach: They propose a semantic-aware contrastive learning algorithm which can learn to distinguish fine-grained meaning representations and take the overall sequence-level semantic into consideration.
Outcome: The proposed algorithm improves on two standard datasets and gets state-of-the-art performance over existing methods.
Sequence-to-Action: End-to-End Semantic Graph Generation for Semantic Parsing (P18-1)

Copied to clipboard

Challenge: Existing methods for semantic parsing are difficult to design and learn, especially in wideopen domains.
Approach: They propose a neural semantic parsing approach which models semantic par- sing as an end-to-end semantic graph generation process.
Outcome: The proposed model achieves state-of-the-art performance on Overnight dataset and gets competitive performance on Geo and Atis datasets.
LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals (2026.acl-long)

Copied to clipboard

Challenge: Existing models generate tokens by updating high-dimensional representations and decoding from them at each timestep.
Approach: They propose a framework that allows reasoning correction and length control based on derived ideal trajectories.
Outcome: The proposed model can predict correctness and length control based on ideal trajectories.
Navigating the Infinite Dynamic Web Space: Effective In-Context Exploration via Cognitive Multi-Agent Collaboration (2026.eacl-long)

Copied to clipboard

Challenge: Existing methods for dynamic web navigation rely on greedy strategies or value estimation, struggle to achieve effective backtracking and are heavily dependent on proprietary models.
Approach: They propose a cognitive multi-agent collaboration framework that enhances cyberspace exploration capability through In-Context Exploration.
Outcome: The proposed framework surpasses the proprietary model Claude-3.5 Sonnet on the WebArena benchmark.
Multimodal Clickbait Detection by De-confounding Biases Using Causal Representation Inference (2024.emnlp-main)

Copied to clipboard

Challenge: a new method to detect clickbait posts on the Web is needed to detect such posts.
Approach: They propose a method to detect clickbait posts on the Web using latent factors . they use features in multiple modalities to characterize the posts and causal inference to eliminate noise .
Outcome: The proposed method can detect clickbait posts on popular social media platforms with good generalization ability.
Musical Score Understanding Benchmark: Evaluating Large Language Models’ Comprehension of Complete Musical Scores (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores.
Approach: They propose a benchmark for score-level musical understanding across textual and visual modalities.
Outcome: The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others.
A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality (2025.emnlp-main)

Copied to clipboard

Challenge: Privacy-sensitive users require deploying large language models within their own infrastructure (on-premises) vulnerabilities in local environments can lead to unauthorized access and potential model theft.
Approach: They propose a framework that secures a few bottom layers in a secure environment . they propose metric to optimize trade-off between protection and customization flexibility .
Outcome: The proposed framework outperforms baselines on five models with 1.3B to 70B parameters.
A Lifelong Multilingual Multi-granularity Semantic Alignment Approach via Maximum Co-occurrence Probability (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to mask and predict tokens in multilingual text limit multilingual interaction .
Approach: They propose a lifelong multilingual multi-granularity semantic alignment approach which continuously extracts massive aligned linguistic units from noisy data via a maximum co-occurrence probability algorithm.
Outcome: The proposed approach improves translation performance on WMT14 18 benchmarks in twelve directions.
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)

Copied to clipboard

Challenge: Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data.
Approach: They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs.
Outcome: The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements .
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Semi-Supervised Lexicon Learning for Wide-Coverage Semantic Parsing (C18-1)

Copied to clipboard

Challenge: Semantic parsers rely on accurate and high-coverage lexicons, but they often use annotated logical forms to learn the lexic.
Approach: They propose a semi-supervised learning framework that makes use of large text corpora and lexical resources.
Outcome: The proposed framework improves on two benchmarks: Webquestions and Free917.
AdaSwitch: Adaptive Switching between Small and Large Agents for Effective Cloud-Local Collaborative Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large language models have been remarkable . users face a choice between using cloud-based LLMs for generation quality or local-based ones for lower computational cost .
Approach: They propose a new LLM utilization paradigm that facilitates collaborative operation . they evaluate AdaSwitch across 7 benchmarks and compare it to other LLMs .
Outcome: The proposed model improves performance of local and cloud agents across 7 benchmarks . it achieves competitive results compared to the cloud agent while utilizing less computational overhead.
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience.
Approach: They propose a new algorithm that uses a random sampling algorithm to control risk.
Outcome: The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms.
Prototype Tuning: A Meta-Learning Approach for Few-Shot Document-Level Relation Extraction with Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Few-Shot Document-Level Relation Extraction (FSDLRE) aims to develop models capable of generalizing to new categories with minimal support examples.
Approach: They propose a meta-training approach to train Large Language Models to improve their ICL capabilities . they construct simulated episodes using relation types that do not overlap with test corpus .
Outcome: Experimental results show that the proposed approach outperforms baseline models on few-shot tasks.
Model-Free Context-Aware Word Composition (C18-1)

Copied to clipboard

Challenge: Word composition models do not take ambiguity of words and context into consideration for learning representations, and thus suffer from the inaccurate representation of semantics.
Approach: They propose a model-free context-aware word composition model which takes the latent semantic information as global context for learning representations.
Outcome: The proposed model improves on existing composition models at different granularities and shows that it can be used to learn semantics.
Breaking the Boundaries: A Unified Framework for Chinese Named Entity Recognition Across Text and Speech (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to Named Entity Recognition (NER) tasks are limited by the complexity of the data and the potential connections between tasks.
Approach: They propose a task to break the boundaries between different modal NER tasks by using a unified data format for inputs from different modalités.
Outcome: The proposed task breaks the boundaries between different modal NER tasks and is a unified implementation of them.
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement (2024.findings-emnlp)

Copied to clipboard

Challenge: Using advanced Large Language Models, instructors can improve training of smaller models by analyzing their own model's errors.
Approach: They propose a framework that leverages advanced Large Language Models to enhance training of smaller target models.
Outcome: The proposed framework outperforms ChatGPT on multiple benchmarks and shows that it improves on both in-domain and out-of-domain benchmarks.
Emergence of Abstract State Representations in Embodied Sequence Modeling (2023.emnlp-main)

Copied to clipboard

Challenge: Sequence modeling is a simple yet versatile task that can be applied to more complex decision-making domains.
Approach: They build a sequence modeling Transformer which takes a language instruction, actions, and environmental observations as inputs and then trains a model to reconstruct environmental layouts.
Outcome: The proposed model can reconstruct environmental layouts from the inputs of the model and language instructions play a role in the reconstruction accuracy.
Towards Verifiable Text Generation with Evolving Memory and Self-Reflection (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often produce factually incorrect information, also known as hallucination.
Approach: They propose a framework for verifiable text generation with evolving memory and self-reflection that incorporates long-term memory to retain documents and recent documents.
Outcome: The proposed framework outperforms baselines on five datasets across three knowledge-intensive tasks.
OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation (2026.acl-long)

Copied to clipboard

Challenge: evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user.
Approach: They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions.
Outcome: The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user.
Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across various vision reasoning tasks.
Approach: They propose a unified formal language that integrates plane and solid geometry, comprehensively covering geometric structures and semantic relations.
Outcome: The proposed language achieves state-of-the-art parsing performance and significantly boosts MLLMs’ capabilities for downstream geometry reasoning tasks.
EUSP: An Easy-to-Use Semantic Parsing PlatForm (D19-3)

Copied to clipboard

Challenge: Semantic parsing aims to map natural language utterances into structured meaning representations.
Approach: They propose a modular platform that allows developers to build semantic parser from scratch.
Outcome: The proposed platform achieves competitive performance on semantic parsing task and improves performance of a business search engine.
Knowledge Representation Learning with Contrastive Completion Coding (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge representation learning methods suffer from immaturity on tackling potentially-imperfect knowledge graphs and highly-imbalanced positive-negative instances during training.
Approach: They propose a framework for knowledge representation learning that incorporates two functional components to achieve robust embedding for each entity/relation.
Outcome: The proposed framework achieves better convergence against state-of-the-art methods on several benchmarks.
Retrieved In-Context Principles from Previous Mistakes (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in in-context learning (ICL) have limited customization and inadequate error coverage.
Approach: They propose a method to retrieve in-context principles from mistakes to improve model performance.
Outcome: The proposed framework enhances model performance when applied to various prompting strategies.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have evaluated and shown limitations in specific capabilities such as visual understanding, but a systematic evaluation of VLMs’ fundamental WM abilities remains absent.
Approach: They propose a framework that assesses perception and prediction to provide an atomic evaluation of VLMs as WMs.
Outcome: The proposed framework assesses perception and prediction abilities on 15 latest VLMs and compares them to human-level models.
RoChBert: Towards Robust BERT Fine-tuning for Chinese (2022.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models (e.g., BERT) have been proved vulnerable to adversarial texts.
Approach: They propose to fuse Chinese phonetic and glyph features into pre-trained models by using a more comprehensive adversarial graph.
Outcome: The proposed framework outperforms existing methods in significant ways on a wide range of tasks while remaining accurate on benign texts.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.
EchoMLLM: Incentivizing Echocardiographic Video Understanding with Keyframe Grounding and Report Generation (2026.findings-acl)

Copied to clipboard

Challenge: Echocardiography analysis requires a dual capability: rigorous quantitative keyframe localization and comprehensive qualitative synthesis.
Approach: They propose a unified framework designed for real-world echocardiography video understanding.
Outcome: a new framework is designed to support real-world echocardiography video understanding . it reduces temporal grounding errors by up to 76% and improves report generation quality by 65% .
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence.
Approach: They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics .
Outcome: The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate .
Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models have been criticized for lack of integration of bilingual lexical information into the neural architecture.
Approach: They propose a neural architecture to incorporate bilingual dictionaries into Neural Machine Translation models by introducing three new components: Pointer, Disambiguator, and Copier.
Outcome: The proposed method achieves the following merits inherently compared with previous efforts: (1) Pointer leverages the semantic information from bilingual dictionaries, for the first time, to better locate source words whose translation in dictionary can potentially be used; (2) Disambiguator synthesizes contextual information from source view and target view, both of which contribute to distinguishing translation of a specific source word from multiple candidates in dicaries; (3) Copier systematically connects Pointer and Disambiguators based on a hierarchical
BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Safety backdoors in large language models can be triggered while evading detection during normal interactions.
Approach: They propose a bi-level optimization method that uses a key insight: backdoor triggers induce a uniform drift in the model’s embedding space . inner level identifies universal perturbations to the decoder’s embedded spaces that steer the model towards defender-defined unwanted behaviors; outer level fine-tunes the model to reinforce safe behaviors against these perturbations.
Outcome: The proposed mitigation method reduces the success rate of safety backdoor attacks from over 95% to 1% for general harmful behaviors and from 47% to 0% for Sleeper Agents, without compromising the model’s usefulness.
Accurate Text-Enhanced Knowledge Graph Representation Learning (N18-1)

Copied to clipboard

Challenge: Existing representation learning methods for knowledge graph representation do not consider the ambiguity of relations and entities.
Approach: They propose a text-enhanced knowledge graph representation learning method which exploits the entity descriptions and triple-specific relation mention to enhance representations.
Outcome: The proposed method outperforms existing representation learning models on link prediction and triple classification tasks and significantly outperformed existing models.
Global and Local Hierarchical Prompt Tuning Framework for Multi-level Implicit Discourse Relation Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Recent methods to recognize hierarchical discourse relations without explicit connectives are inefficient and ignore the utilization of the output probability distribution information of the verbalizer.
Approach: They propose a global and local hierarchical prompt tuning framework which leverages top-up propagated probability as the global hierarchy to inject it into multi-level verbalizer.
Outcome: The proposed framework achieves competitive results on two benchmacks.
Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Document retrieval in real-world scenarios faces significant challenges due to diverse document formats and modalities.
Approach: They propose a visual-textual embedding framework that integrates textual and visual features for robust document representation.
Outcome: The proposed visual-textual embedding framework surpasses existing methods while preserving semantic fidelity.
Better Pre-Training by Reducing Representation Confusion (2023.findings-eacl)

Copied to clipboard

Challenge: Existing methods to improve pre-trained language models address information confusion in position encoding and model representations.
Approach: They propose two techniques to improve pre-trained language models by decoupling directions and auxiliary regularizers.
Outcome: The proposed techniques can improve pre-trained language models on GLUE benchmarks.
DNASpeech: A Contextualized and Situated Text-to-Speech Dataset with Dialogues, Narratives and Actions (2025.acl-long)

Copied to clipboard

Challenge: Existing TTS datasets lack situated descriptive prompts aligned with speech data.
Approach: They propose a contextualized and situated text-to-speech task to promote more accurate and customized speech generation using DNA prompts.
Outcome: The proposed task promotes more accurate and customized speech generation using DNA prompts.
Speak No Evil, Just Prompt: Low-resource Multilingual Toxic Speech Detection with Audio Language Model (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for toxic speech detection rely on high-resource languages and lack acoustic cues.
Approach: They propose a prompt-based adaptation framework that performs end-to-end toxicity detection without ASR.
Outcome: The proposed framework achieves a micro-averaged ROC-AUC of 98.07% on polySpeechTox . it is based on a frozen audio language model and can perform end-to-end toxicity detection without ASR .
ModularMoE: Fast LLM Customization with Parameter-Sharing Mixture-of-Experts for Low-Resource Settings (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models impose significant computational and storage burdens on personal devices . existing customization approaches incur excessive computational costs or lead to suboptimal performance .
Approach: They propose a training framework that converts pre-trained LLMs into parameter-sharing MoE models for lightweight deployment.
Outcome: The proposed training framework outperforms state-of-the-art training frameworks at the same sparsity level while delivering up to 2.71 inference speedup.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations