Papers by Jun Shen

23 papers
A Deep Learning-Based System for PharmaCoNER (D19-57)

Copied to clipboard

Challenge: Efficient access to mentions of clinical entities is very important for using clinical text.
Approach: They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 .
Outcome: The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2.
Experience-driven Multi-turn Reinforcement Learning for GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: GUI agents have demonstrated remarkable progress in automating complex user interface interactions . training such agents for long-horizon tasks remains challenging due to limited rewards and prohibitive costs.
Approach: They propose a method that leverages expert trajectories as environment experiences for on-policy multi-turn training.
Outcome: The proposed method achieves significant gains over the base model with 1K public trajectories as RL experiences . it achieves competitive performance against strong baselines such as UI-TARS-7B and GPT-4o .
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval.
Approach: They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs).
Outcome: The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models.
DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent text-to-SQL systems that use large language models struggle with complex database structures and domain-specific queries.
Approach: a framework that aligns large language models with database knowledge is proposed . DB-Explore constructs database graphs to capture complex relational schemas .
Outcome: a new framework outperforms existing text-to-SQL systems by outperforming existing systems.
MAPS: Motivation-Aware Personalized Search via LLM-Driven Consultation Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing personalized product search methods assume that users’ query fully captures their real motivation, but in practice, user's queries do not always articulate the requirements.
Approach: They propose a Motivation-Aware Personalized Search method that embeds queries and consultations into a unified semantic space via LLMs and utilizes a Mixture of Attention Experts (MoAE) to prioritize critical semantics.
Outcome: Extensive experiments on real and synthetic data show that the proposed method outperforms existing methods in retrieval and ranking tasks.
TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities (2024.emnlp-main)

Copied to clipboard

Challenge: Current datasets cater to user-led systems and are limited to predefined specific scenarios and slots.
Approach: They propose to use a Chinese dialogue dataset to train a model that authentically simulates human-computer dialogues in 30 popular life service scenarios.
Outcome: The proposed model achieves a joint accuracy of 75.09% in out-of-domain evaluations . it also achieves notable abilities in slot filling and questioning .
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions.
Approach: They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification.
Outcome: The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% .
Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citation (2025.findings-acl)

Copied to clipboard

Challenge: citation generation and retrieval-augmented generation are still lacking in large language models due to hallucinations.
Approach: They propose a retrieval-augmented citation generation task that requires models to generate citations considering both external and internal knowledge while providing trustworthy references.
Outcome: The proposed method achieves better performance across scenarios compared to baselines . retrieval quality, question types, and model knowledge influence trustworthiness .
AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarification (2025.emnlp-main)

Copied to clipboard

Challenge: Existing tools for ambiguous and incomplete queries are limited by manual construction and lack of error correction mechanisms during multi-turn clarification.
Approach: They propose a framework that exploits the mapping between queries and their tool invocation solutions by removing key parameters from queries while retaining them as ground truth.
Outcome: The proposed framework outperforms existing methods while maintaining high accuracy in tool invocation.
CoVerRL: Breaking the Consensus Trap in Label-Free Reasoning via Generator-Verifier Co-Evolution (2026.acl-long)

Copied to clipboard

Challenge: Label-free reinforcement learning enables large language models to improve reasoning capabilities . but as training maximizes self-consistency, output diversity collapses, authors say . authors propose a framework where a single model alternates between generator and verifier roles .
Approach: They propose a framework where a model alternates between generator and verifier roles, bootstrapping each other.
Outcome: Experiments show that CoVerRL outperforms label-free baselines on reasoning benchmarks . the framework can be used to improve reasoning abilities without ground-truth supervision .
CiteLab: Developing and Diagnosing LLM Citation Generation Workflows via the Human-LLM Interaction (2025.acl-demo)

Copied to clipboard

Challenge: Existing frameworks for enabling Large Language Models to generate citations are lacking . however, they can still produce hallucinated responses that are non-factual or irrelevant to the input.
Approach: They propose an open-source and modular framework for enabling LLMs to generate citations in Question-Answering tasks.
Outcome: The proposed framework is extensible and paired with a visual interface, Citefix, facilitating case study and modification of existing citation generation methods.
Select and Attend: Towards Controllable Content Selection in Text Generation (D19-1)

Copied to clipboard

Challenge: Recent neural network models conflate content selection and surface realization into a black-box architecture, resulting in content to be described in text cannot be explicitly controlled.
Approach: They propose to decouple content selection from the decoder to allow finer-grained control over the generation.
Outcome: The proposed model can be trained end-to-end without human annotations and achieves promising results in data-totext and headline generation tasks.
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)

Copied to clipboard

Challenge: Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B.
Approach: They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation.
Outcome: The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model.
LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models (2026.acl-long)

Copied to clipboard

Challenge: Masked diffusion language models have achieved significant progress in language modeling . however, the systematic analysis and empirical validation of their alignment on general tasks remains underexplored.
Approach: They propose a framework that analyzes the bias and variance of preference optimization loss and gradient based on Direct Preference Optimization.
Outcome: The proposed model outperforms its SFT-only predecessor on general benchmarks . it consistently outperformed other strong language models and ARMs on general tasks .
On the Step Length Confounding in LLM Reasoning Data Selection (2026.findings-acl)

Copied to clipboard

Challenge: Existing pipelines generate long reasoning data from more capable Large Language Models (LLMs) and apply manually heuristic or naturalness-based selection methods to filter high-quality samples.
Approach: They propose to use supervised fine-tuning to generate long reasoning data from more capable Large Language Models and apply manually heuristic or naturalness-based selection methods to filter high-quality samples.
Outcome: Experiments on four LLMs and five evaluation benchmarks show that the proposed approach is effective in mitigating step length confounding problem.
STaR-SQL: Self-Taught Reasoner for Text-to-SQL (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for generating step-by-step “chain-of-thought” rationales are limited to text-to-SQL.
Approach: They propose a method that prompts SQL query generation to produce reasoning steps for SQL queries and fine-tunes it on rationales that lead to correct outcomes.
Outcome: The proposed method outperforms agent-like prompting methods on the Spider benchmark.
Meeseeks: A Feedback-Driven, Iterative Self-Correction Benchmark evaluating LLMs’ Instruction Following Capability (2026.findings-acl)

Copied to clipboard

Challenge: Existing models lack the ability to adhere to instructions, resulting in suboptimal performance.
Approach: They propose an automated iterative instruction-following benchmark with integrated feedback mechanism.
Outcome: The proposed benchmark identifies erroneous components in model responses and provides feedback accurately.
Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewards (2026.acl-long)

Copied to clipboard

Challenge: Existing agentic training data are narrow in task variety and easily solved . real-world APIs lack diversity and are unstable for large-scale reinforcement learning rollout processes.
Approach: They propose a framework that synthesizes diverse tool-use training data and simulates complete environments.
Outcome: The proposed framework synthesizes diverse tool-use training data and simulates complete environments.
DICP: Deep In-Context Prompt for Event Causality Identification (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing prompt-learning-based methods concatenate in-context examples only at the input layer, limiting the model’s ability to capture abstract semantic cues necessary for identifying complex causal relationships.
Approach: They propose a model that injects in-context examples into the deeper layer of a pre-trained language model (PLM) this model leverages hierarchical semantic representations formed in deeper layers, thereby enhancing its capacity to learn high-level causal abstractions.
Outcome: The proposed model improves on two widely used datasets and shows that it can learn high-level causal abstractions.
Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives (2024.acl-long)

Copied to clipboard

Challenge: Recent research indicates without external feedback, LLM’s intrinsic reflection is unstable.
Approach: They propose a method that combines self-evaluated and external feedback to improve LLM's reflection.
Outcome: The proposed method improves the quality of self-evaluated feedback and can catalyze more accurate and stable reflection.
Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results prove that language models can learn from human feedback better, irrespective of sequence length . emergence of length bias often induces the model to favor longer outputs .
Approach: They propose to separate reward modeling from the influence of sequence length by using the Product-of-Experts technique.
Outcome: The proposed approach shows that language models perform better regardless of sequence length . the main expert is focused on understanding human intents, while the biased expert targets the identification and capture of length bias.
When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Personalization can inadvertently distort factual reasoning when faced with factual queries.
Approach: They propose a lightweight inference-time approach that mitigates personalization-induced factual distortions while preserving personalized behavior.
Outcome: Experiments across multiple LLM backbones and personalization methods show that FPPS significantly improves factual accuracy while maintaining personalized performance.
Similarity = Value? Consultation Value-Assessment and Alignment for Personalized Search (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods rely on semantic similarity to align historical consultations with current queries due to the absence of ‘value’ labels, but this lacks exploration of needs in user consultations.
Approach: They propose a consultation value assessment framework that evaluates historical consultations from three novel perspectives: (1) Scenario Scope Value, (2) Posterior Action Value, and (3) Time Decay Value.
Outcome: The proposed model outperforms baselines on public and commercial datasets on both retrieval and ranking tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations