Papers by Junru Wu

6 papers
Tell Me What You Don’t Know: Enhancing Refusal Capabilities of Role-Playing Agents via Representation Space Analysis and Editing (2025.findings-acl)

Copied to clipboard

Challenge: Role-playing Agents (RPAs) struggle to recognize and respond to hard queries that conflict with their role-play knowledge.
Approach: They propose a lightweight representation editing approach that conveniently shifts conflicting requests to the rejection region, thereby enhancing the model’s refusal accuracy.
Outcome: The proposed model improves RPAs’ refusal ability of conflicting requests while maintaining their general role-playing capabilities.
Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels (2024.naacl-short)

Copied to clipboard

Challenge: Existing pointwise LLMs provide noisy or biased answers for documents that are partially relevant to the query.
Approach: They propose to incorporate fine-grained relevance labels into the LLM prompt . they propose to better differentiate between documents with different levels of relevance .
Outcome: The proposed model can differentiate between documents with different levels of relevance to the query and derive a more accurate ranking.
C²RBench: A Chinese Complex Reasoning Benchmark for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks often fail to capture complex multi-step reasoning demands inherent in real-world scenarios.
Approach: They propose a benchmark to evaluate multi-step, multimodal advanced reasoning of large language models.
Outcome: The proposed benchmark exceeds existing benchmarks in cognitive complexity and accuracy by over 90% . it features 1,115 carefully curated Chinese tasks organized into eight domain-specific subsets . evaluations of 20 LLMs and 24 multimodal large language models reveal critical performance gaps .
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
LiPO: Listwise Preference Optimization through Learning-to-Rank (2025.naacl-long)

Copied to clipboard

Challenge: Recent work on language models with curated feedback provides promising alternatives to RLHF . multiple responses can be ranked by reward models or AI feedback, but there is no study on directly fitting upon a list of responses.
Approach: They propose a method that aligns language models with curated human feedback . they propose SLiC and DPO as promising alternatives to traditional RLHF .
Outcome: The proposed method outperforms DPO and SLiC on several preference alignment tasks with curated and real rankwise preference data.
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to rank documents using large language models do not understand these challenging ranking formulations.
Approach: They propose to use Pairwise Ranking Prompting to improve ranking performance . they propose to outperform fine-tuned baseline rankers on benchmark datasets .
Outcome: The proposed technique outperforms supervised baselines on benchmark datasets and outperformed other LLM-based solutions by over 10% on average.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations