Papers by Junyu Yang

12 papers
PclGPT: A Large Language Model for Patronizing and Condescending Language Detection (2024.findings-emnlp)

Copied to clipboard

Challenge: Patronizing and condescending language is an essential branch of toxic language . pre-trained language models perform poorly in detecting PCL due to its implicit toxicity traits .
Approach: They propose a novel LLM benchmark for patronizing and condescending language . they use a dataset to analyze the toxicity of patronizing condescending languages .
Outcome: The proposed model can detect patronizing and condescending language (PCL) the model can be used to analyze the toxicity of the language and to improve the detection.
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences.
Approach: They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference .
Outcome: The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks.
Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on evaluating large language models' ability to handle disagreement cases.
Approach: They evaluate the performance of large language models in detecting offensive language at varying levels of agreement.
Outcome: The proposed model improves detection accuracy and model alignment with human judgment by using disagreement samples in training.
STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detection (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on Chinese hate speech detection lack span-level fine-grained annotations.
Approach: They construct a Span-level target-aware Toxicity Extraction dataset and evaluate existing models for Chinese hateful slang.
Outcome: The proposed dataset is the first span-level Chinese hate speech dataset and evaluates the ability of existing models to understand hate semantics.
SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluations of large language models fail to reflect fine-grained capabilities . existing benchmarks are manually curated or domain-generic, limiting scalability and alignment with real use cases.
Approach: They propose a framework that allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific scientific capabilities in LLMs.
Outcome: The proposed framework reveals fine-grained differences in scientific capabilities that standard benchmarks overlook . it allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific capabilities in LLMs.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Commonality and Individuality! Integrating Humor Commonality with Speaker Individuality for Humor Recognition (2025.naacl-long)

Copied to clipboard

Challenge: Current methods for humor recognition focus on one aspect of humor commonalities, ignoring the multifaceted nature of humor.
Approach: They propose a commonality and individuality incorporated network for humor recognition that integrates multifaceted humor commonalities with speaker individuality.
Outcome: The proposed model integrates multifaceted humor commonalities with speaker individuality to deepen the understanding of humor expressions.
Efficient Data Labeling by Hierarchical Crowdsourcing with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Large language models (LLMs) have been gaining attention for their impressive performance in in-context dialogues.
Approach: They propose a hierarchical framework that leverages multiple LLMs for efficient data labeling under budget constraints.
Outcome: The proposed framework outperforms human labelers and GPT-4 in terms of accuracy and efficiency.
Take Its Essence, Discard Its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to mitigate lexical bias in toxic language detection (TLD) do not exploit the “useful” and “misleading” impact of the bias.
Approach: They propose a counterfactual Causal Debiasing Framework to mitigate lexical bias in toxic language detection (TLD) it preserves the “useful impact” of lexical bias and eliminates the "misleading impact" they propose to use the same framework to analyze the causal effect of a sentence and bias tokens .
Outcome: The proposed framework preserves the “useful impact” of lexical bias and eliminates the ‘misleading impact’ Empirical evaluations show that the proposed model outperforms current debiased models for out-of-distribution data.
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years, but there is a notable lack of effective and specialized multimodal evaluation datasets in the financial domain.
Approach: They introduce FinMME, a multimodal large language model with 11,000 financial research samples and 20 annotators.
Outcome: The proposed model performs better than state-of-the-art models, highlighting its challenging nature.
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks (2023.acl-long)

Copied to clipboard

Challenge: Existing datasets suffer from a lack of fine-grained annotations, such as the toxic type and expressions with indirect toxicity.
Approach: They propose a benchmark model to detect toxic language by incorporating lexical features into a Chinese dataset to facilitate fine-grained annotations.
Outcome: The proposed model is based on insulting vocabulary containing implicit profanity and is able to detect toxic language with lexical features.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations