Papers by Bo Dai
DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt-based methods have shown their efficacy in transferring general knowledge within pre-trained language models (PLMs) however, when applied to zero-shot entity and relation extraction, they struggle with the limited coverage of verbalizers to labels and the slow inference speed. |
| Approach: | They propose a method which reformulates zero-shot tasks into token discrimination tasks without having to construct verbalizers. |
| Outcome: | The proposed method outperforms baselines on two zero-shot entity recognition datasets with higher inference speed and achieves 7.5% improvement over previous state-of-the-art models on Wiki-ZSL and FewRel. |
SMARTAVE: Structured Multimodal Transformer for Product Attribute Value Extraction (2022.findings-emnlp)
Copied to clipboard
Qifan Wang, Li Yang, Jingang Wang, Jitin Krishnan, Bo Dai, Sinong Wang, Zenglin Xu, Madian Khabsa, Hao Ma
| Challenge: | Existing methods for product attribute value extraction are noisy and incomplete with missing values for most retailers. |
| Approach: | They propose a Structure Mltimodal trAnsformeR for producT Attribute Value Extraction which jointly encodes the structured product information from multiple modalities. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two multimodal product datasets. |
Context as a Tool: Context Management for Long-Horizon SWE-Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models rely on append-only context maintenance or passively triggered compression heuristics, leading to context explosion, semantic drift, and degraded reasoning in long-running interactions. |
| Approach: | They propose a new context management paradigm that elevates context maintenance to a callable tool . they propose 'cat' framework that injects context-management actions into complete interaction trajectories . |
| Outcome: | The proposed model outperforms ReAct-based agents and static compression baselines on SWE-Verified tests. |
Musical Score Understanding Benchmark: Evaluating Large Language Models’ Comprehension of Complete Musical Scores (2026.acl-long)
Copied to clipboard
Congren Dai, Yue Yang, Krinos Li, Huichi Zhou, Shijie Liang, Zhang Bo, Enyang Liu, Ge Jin, Hongran An, Haosen Zhang, Peiyuan Jing, KinHei Lee, Zhenxuan Zhang, Xiaobing Li, Maosong Sun
| Challenge: | Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores. |
| Approach: | They propose a benchmark for score-level musical understanding across textual and visual modalities. |
| Outcome: | The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others. |
A Lifelong Multilingual Multi-granularity Semantic Alignment Approach via Maximum Co-occurrence Probability (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to mask and predict tokens in multilingual text limit multilingual interaction . |
| Approach: | They propose a lifelong multilingual multi-granularity semantic alignment approach which continuously extracts massive aligned linguistic units from noisy data via a maximum co-occurrence probability algorithm. |
| Outcome: | The proposed approach improves translation performance on WMT14 18 benchmarks in twelve directions. |
Named Entity Recognition for Social Media Texts with Semantic Augmentation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for named entity recognition suffer from data sparsity problems when conducted on short and informal texts. |
| Approach: | They propose a neural-based approach to named entity recognition for social media texts . they obtain augmented semantic information from a large-scale corpus and encode it . |
| Outcome: | The proposed approach outperforms existing approaches on three social media datasets. |
Domain-aware and Co-adaptive Feature Transformation for Domain Adaption Few-shot Relation Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction focus on the source domain, which makes it difficult to accurately transfer useful knowledge to the target domain. |
| Approach: | They propose a domain-aware and co-adaptive feature transformation approach to address these issues by leveraging the target domain distribution features to guide the domain-based feature transformations. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance on a benchmark dataset. |
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for evaluation of dialog systems are expensive and not scalable . a framework for estimating human evaluation scores is proposed to bridge this gap . |
| Approach: | They propose a framework for estimating human evaluation scores based on off-policy evaluation . they use language quality metrics for single-turn response generation given a fixed context . |
| Outcome: | The proposed framework outperforms existing methods in terms of correlation with human evaluation scores. |
MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples (2025.coling-main)
Copied to clipboard
Shuo Xie, Fangzhi Zhu, Jiahui Wang, Lulu Wen, Wei Dai, Xiaowei Chen, Junxiong Zhu, Kai Zhou, Bo Zheng
| Challenge: | Existing preference optimization methods such as DPO and KTO are inherently derived from PPO, requiring a reference model that adds GPU memory resources and relies heavily on abundant preference data. |
| Approach: | They propose an algorithm that leverages the average likelihood of model responses to fit the reward function and maximizes the utilization of preference data. |
| Outcome: | The proposed algorithm outperforms DPO, ORPO, and SimPO on MT-Bench and Arena-Hard. |
StableMoE: Stable Routing Strategy for Mixture of Experts (2022.acl-long)
Copied to clipboard
| Challenge: | Existing learning-to-route methods suffer from the routing fluctuation issue . with the model scale growing, training speed will go slower and memory requirements are heavy . |
| Approach: | They propose a Mixture-of-Experts technique that can scale up the model size of Transformers with an affordable computational overhead. |
| Outcome: | The proposed method outperforms existing learning-to-route methods on language modeling and multilingual machine translation. |
Improving Retrospective Language Agents via Joint Policy Gradient Optimization (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have sparked interest in creating autonomous agents. |
| Approach: | They propose a framework that jointly optimizes both task-planning and self-reflective evolution capabilities in language agents. |
| Outcome: | The proposed framework improves task planning and self-reflective evolution capabilities in language agents. |
On Domain-Adaptive Post-Training for Multimodal Large Language Models (2025.findings-emnlp)
Copied to clipboard
Daixuan Cheng, Shaohan Huang, Ziyu Zhu, Xintong Zhang, Xin Zhao, Zhongzhi Luan, Bo Dai, Zhenliang Zhang
| Challenge: | Adapting general multimodal large language models to specific domains is important for practical applications. |
| Approach: | They investigate domain adaptation of multimodal large language models via post-training . they develop a generate-then-filter pipeline that curates diverse visual instruction tasks . |
| Outcome: | The proposed model outperforms existing models in domain adaptation by combining data from open-source models with training pipelines. |
On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Visually-rich document entity retrieval (VDER) is an important topic in industrial NLP applications. |
| Approach: | They propose a task-aware meta-learning framework to tackle the problem of visually-rich document entity retrieval (VDER) they adopt a hierarchical decoder and employ contrastive learning to achieve this goal. |
| Outcome: | The proposed framework significantly improves the robustness of popular meta-learning baselines. |