Papers by Yuanjie Lyu
Think Wider, Detect Sharper: Reinforced Reference Coverage for Document-Level Self-Contradiction Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to document-level contradiction detection (DSCD) only gain marginal improvement and often introduce inconsistencies across repeated responses. |
| Approach: | They propose a method that combines supervised fine-tuning and reinforcement learning to enhance document-level contradiction detection (DSCD) they propose to use a task-specific reward function to expand the model’s reasoning scope, boosting both accuracy and consistency. |
| Outcome: | The proposed method significantly boosts Llama 3.1-8B-Instruct’s accuracy from 38.5% to 51.1%, and consistency from 59.6% to76.2%. |
Streamlining the Collaborative Chain of Models into A Single Forward Pass in Generation-Based Tasks (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in "Chain of Models" approach increase resource demands as each model must be deployed separately. |
| Approach: | They propose a prompt-tuning method that enables models to share hidden states . they modify input and attention masks during training to eliminate redundant forward passes . |
| Outcome: | Empirical results show that FTHSS matches the performance of traditional model chains while improving inference efficiency. |
Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) often produce factual errors due to limited internal knowledge. |
| Approach: | They propose a retrieval-augmented generation framework that generates plan tokens to guide subsequent generation. |
| Outcome: | The proposed framework improves the accuracy of large language models with external knowledge sources. |
Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Existing agentic training data are narrow in task variety and easily solved . real-world APIs lack diversity and are unstable for large-scale reinforcement learning rollout processes. |
| Approach: | They propose a framework that synthesizes diverse tool-use training data and simulates complete environments. |
| Outcome: | The proposed framework synthesizes diverse tool-use training data and simulates complete environments. |
AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Use (2026.acl-industry)
Copied to clipboard
| Challenge: | Modern industrial applications increasingly demand language models capable of multi-step reasoning and tool use in real-world settings. |
| Approach: | They propose a model family that trains via multi-round reinforcement learning on synthetic data and open-source data. |
| Outcome: | The proposed model train on synthetic and open-source data achieves strong performance on multiple agentic benchmarks and in an industrial agent system. |