Papers by Daiting Shi

9 papers
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach: They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome: Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.
RACQC: Advanced Retrieval-Augmented Generation for Chinese Query Correction (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit remarkable capabilities across many tasks, but face critical challenges in the CSC scenario: (1) poor generalization to rare entities in open-domain searches; and (2) failure to adapt to temporal entity variations due to static parameters, resulting in serious over-correction issues.
Approach: They propose a Chinese Spelling Check system with RAG and multi-task learning that integrates dynamic knowledge retrieval and entity-centric RAG to address rare entities.
Outcome: The proposed system outperforms existing baselines in the CSC task and achieves a maximum improvement of +9.92% on the search scenario benchmark and +3.2% on the general-domain dataset.
Agentic-R: Learning to Retrieve for Agentic Search (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrievers for single-turn retrieval-augmented generation (RAG) rely on similarity-based retrievers, but similar passages are not always useful for final answer generation.
Approach: They propose a retrieval-augmented-generation retriever that integrates reasoning with retrieval . they use local query-passage relevance and global answer correctness to measure passage utility .
Outcome: The proposed retriever outperforms existing retrievers on QA benchmarks on seven single-hop and multi-hop searches.
ReflectRM: Boosting Generative Reward Models via Self-Reflection within a Unified Judgment Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating reward models focus on outcome-level supervision, neglecting analytical process quality, which constrains their potential.
Approach: They propose a novel reward model that leverages self-reflection to assess analytical quality and enhance preference modeling.
Outcome: The proposed model improves performance on four benchmarks and significantly mitigates positional bias.
ConsistRM: Improving Generative Reward Models via Consistency-Aware Self-Training (2026.acl-long)

Copied to clipboard

Challenge: ConsistRM is a self-training framework that enables effective and stable GRM training without human annotations.
Approach: They propose a self-training framework that enables effective and stable GRM training without human annotations.
Outcome: The proposed framework outperforms vanilla Reinforcement Fine-Tuning (RFT) by 1.5% on five benchmark datasets.
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation (2022.emnlp-industry)

Copied to clipboard

Challenge: Pre-trained language models have been a key part of ranking systems . knowledge distillation is widely used to maintain high performance while keeping efficient computations.
Approach: They propose an algorithm to combine knowledge from multi-teachers and label information to achieve competitive performance in offline and online experiments.
Outcome: The proposed method has been deployed in a real-world commercial search system.
UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle (2024.findings-naacl)

Copied to clipboard

Challenge: Existing paradigms for pre-training and fine-tuning have limitations . knowledge rekindle aims to break through performance upper bounds of experts without introducing additional annotated data.
Approach: They propose a new paradigm for pre-training and fine-tuning that aims to re-incorporate the fine- tuned expert model into the training cycle and break through performance upper bounds of experts.
Outcome: The proposed model breaks through performance upper bounds of experts without additional annotated data.
UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing alignment paradigms for creative writing use static reward signals and supervised data.
Approach: They propose a constraint-aware reward model that synthesizes query-specific criteria to provide fine-grained preference judgments.
Outcome: The proposed framework aligns models with human preferences across content quality and structural paradigms without supervised fine-tuning and ground-truth references.
Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on large language models for document utility annotations have shown that they improve retrieval performance and RAG outcomes compared to models trained on human annotations.
Approach: They propose a model that maximizes their summed marginal likelihood to annotate document utility on multiple positive samples per query.
Outcome: The proposed model maximizes the marginal likelihood of multiple positive samples per query.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations