Papers by Bo Ren
Grafting Pre-trained Models for Multimodal Headline Generation (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to generate video headlines with pre-trained language models are labor intensive and impractical. |
| Approach: | They propose to graft the encoder from the pre-trained video-language model on the generative pre-trainer model and propose a consensus fusion mechanism for the integration of different components. |
| Outcome: | The proposed model achieves strong results on a brand-new dataset collected from real-world applications. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
KCAT: A Knowledge-Constraint Typing Annotation Tool (P19-3)
Copied to clipboard
Sheng Lin, Luye Zheng, Bo Chen, Siliang Tang, Zhigang Chen, Guoping Hu, Yueting Zhuang, Fei Wu, Xiang Ren
| Challenge: | Recent years Natural Language Processing community has seen a surge of interest in fine-grained entity typing (FET) given an entity mention (i.e. a sequence of token spans representing an entity), FET aims at uncovering its contextdependent type. |
| Approach: | They propose an efficient Knowledge Constraint Fine-grained Entity Typing Annotation Tool which further improves the entity typing process through entity linking together with some practical functions. |
| Outcome: | The proposed tool improves the entity typing process by linking the candidate types with some practical functions. |
Leveraging Key Information Modeling to Improve Less-Data Constrained News Headline Generation via Duality Fine-Tuning (2022.aacl-main)
Copied to clipboard
| Challenge: | Recent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive and would be small-scale. |
| Approach: | They propose a novel duality fine-tuning method to capture more information from limited data and build connections between tasks. |
| Outcome: | The proposed method can capture more information from limited data, build connections between separate tasks, and is suitable for less-data constrained generation tasks. |
Social Welfare Function Leaderboard: On the Emergence of LLM Agents as the Welfare Dictator (2026.findings-acl)
Copied to clipboard
Zhengliang Shi, Ruotian Ma, Jen-tse Huang, Xinbei Ma, Xingyu Chen, Mengru Wang, Qu Yang, Yue Wang, Fanghua Ye, Ziyang Chen, Shanyi Wang, Cixing LI, Wenxuan Wang, Zhaopeng Tu, Xiaolong Li, Zhaochun Ren, Liefeng Bo
| Challenge: | Large language models (LLMs) are increasingly entrusted with high-stakes decisions that affect human welfare. |
| Approach: | They evaluate 20 state-of-the-art Large language models (LLMs) and 20 LLM dictators to create a social welfare function benchmark. |
| Outcome: | The proposed model creates dilemma between maximizing collective efficiency and ensuring distributive fairness. |
Semantic-Preserving Abstractive Text Summarization with Siamese Generative Adversarial Net (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on attention mechanism, but they are not suitable for abstractive text summarization. |
| Approach: | They propose a siamese generative adversarial net for abstractive text summarization which preserves the main semantics of the source text and the target summary. |
| Outcome: | The proposed model can preserve the main semantics of the source text and target summary. |
Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering (N19-1)
Copied to clipboard
| Challenge: | Existing studies have addressed this problem with partial-label loss, but they suffer from confirmation bias, which means the classifier fit a pseudo data distribution given by itself. |
| Approach: | They propose to regularize distantly supervised models with Compact Latent Space Clustering to bypass this problem and effectively utilize noisy data yet. |
| Outcome: | The proposed model outperforms state-of-the-art models on standard benchmarks on fine-grained entity typing (FET) by a significant margin. |
Entity-Aware Abstractive Multi-Document Summarization (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for multidocument summarization do not focus on explicitly modeling the underlying semantic information across documents. |
| Approach: | They propose an entityaware model for abstractive multi-document summarization that augments the classical Transformer-based encoder-decoder framework with a heterogeneous graph consisting of text units and entities as nodes. |
| Outcome: | The proposed model can deal with saliency and redundancy issues explicitly and can be used with pre-trained language models, arriving at improved performance. |
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)
Copied to clipboard
Chenji Lu, Zhuo Chen, Hui Zhao, Zhiyuan Zeng, Gang Zhao, Junjie Ren, null Lihaoran, Songyan Liu, Pengjie Wang, Chuan Yu, Jian Xu, Bo Zheng
| Challenge: | E-commerce search relevance is a critical component of retrieval systems. |
| Approach: | They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies. |
| Outcome: | The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain. |
RAAT: Relation-Augmented Attention Transformer for Relation Modeling in Document-Level Event Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods focus on sentencelevel event extraction (SEE), but they are inconsistent with actual situations. |
| Approach: | They propose a document-level event extraction framework which can model relation dependencies by a relation-augmented Attention Transformer. |
| Outcome: | The proposed framework can achieve state-of-the-art performance on two public datasets. |
RTCFake: Speech Deepfake Detection in Real-Time Communication (2026.findings-acl)
Copied to clipboard
Jun Xue, Zhuolin Yi, Yihuan Huang, Yanzhen Ren, Yujie Chen, Cunhang Fan, Zicheng Su, Yongcheng Zhang, Bo Cai
| Challenge: | Existing detection studies focus on offline simulations and struggle to cope with complex distortions introduced during RTC transmission. |
| Approach: | They propose a large-scale speech deepfake dataset tailored for RTC scenarios . the dataset is constructed by transmitting speech through multiple social media and conferencing platforms . |
| Outcome: | The proposed dataset is constructed by transmitting speech through multiple mainstream social media and conferencing platforms, enabling precise pairing between offline and online speech. |
CoCGAN: Contrastive Learning for Adversarial Category Text Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results on synthetic and real category text generation datasets demonstrate that CoCGAN can achieve significant improvements over the baseline category text generators. |
| Approach: | They propose to incorporate contrastive learning into adversarial category text generation by using a discriminator to optimize a contrastive learn objective to capture more flexible data-to-class relations and data- to-data relations among training samples. |
| Outcome: | The proposed model improves on synthetic and real category text generation datasets. |
Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations . |
| Approach: | They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations. |
| Outcome: | The proposed framework improves on real-world HMTC datasets with significant improvements over baselines. |
GMN: Generative Multi-modal Network for Practical Document Information Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world. |
| Approach: | They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module. |
| Outcome: | The proposed method can deal with complex documents that are hard to serialize into sequential order. |
SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network (2024.acl-long)
Copied to clipboard
| Challenge: | SpikeVoice performs high-quality Text-To-Speech (TTS) via SNN . major obstacle to using SNN for such generative tasks lies in the demand for models to grasp long-term dependencies. |
| Approach: | They propose a brain-inspired Spiking Neural Network (SNN) which performs high-quality Text-To-Speech (TTS) via SNN and explores the potential of SNN to "speak". |
| Outcome: | The proposed model achieves comparable results to Artificial Neural Networks (ANN) with only 10.5% energy consumption of ANN. |