Papers by Qianyu He

14 papers
Can Pre-trained Language Models Interpret Similes as Smart as Human? (2022.acl-long)

Copied to clipboard

Challenge: Simile interpretation is a crucial task in natural language processing.
Approach: They propose a task to let PLMs infer the shared properties of similes by probing textual corpora and human-designed questions.
Outcome: The proposed task outperforms pre-trained language models on simile interpretation tasks while still underperforming humans.
Reason from Fallacy: Enhancing Large Language Models’ Logical Reasoning through Logical Fallacy Understanding (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but struggle with some more complex reasoning tasks including logical reasoning.
Approach: They propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW to evaluate LLMs’ capability of logical fallacy understanding.
Outcome: The proposed dataset can be used to evaluate LLMs’ LFU capability and to fine-tune LLM models to obtain significantly enhanced performance on logical reasoning.
Order Doesn’t Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation (2025.emnlp-main)

Copied to clipboard

Challenge: Logical reasoning is essential for large language models (LLMs) to ensure accurate and coherent inferences.
Approach: They propose an order-centric data augmentation framework based on commutativity in logical reasoning that randomly shuffles independent premises to introduce condition order augmentation.
Outcome: The proposed framework improves LLMs’ reasoning performance and adaptability to diverse logical structures.
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation (2023.acl-long)

Copied to clipboard

Challenge: Similes are a crucial part of creative writing, but there is still a lack of evaluation metrics for simile generation.
Approach: They propose to use similes as a tool to evaluate simile generation metrics . they propose to combine five criteria and automatic metrics for each criterion .
Outcome: The proposed metrics are significantly more correlated with human ratings from each perspective compared with prior automatic metrics.
Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases (2024.findings-emnlp)

Copied to clipboard

Challenge: Definition bias is a negative phenomenon that can mislead models.
Approach: They propose a framework that measures definition bias, bias-aware fine-tuning and task-specific bias mitigation to mitigate definition bias in information extraction.
Outcome: The proposed framework mitigates definition bias in information extraction tasks by measuring definition bias, bias-aware fine-tuning, and task-specific bias mitigation.
ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)

Copied to clipboard

Challenge: LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints.
Approach: They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks.
Outcome: The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration.
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) follow instructions with elaborate requirements, yet it remains under-explored how to enhance their ability to follow complex instructions with multiple constraints.
Approach: They propose a method to obtain and utilize effective training data to enhance LLMs' ability to follow complex instructions with multiple constraints.
Outcome: The proposed framework improves models' ability to follow instructions generally and generalize effectively across out-of-domain, in domain, and adversarial settings while maintaining general capabilities.
Metaphor Reasoning is Meta-reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing work on metaphor reasoning's impact on reasoning abilities is limited.
Approach: They propose a system for synthesizing metaphorical riddles that satisfy five quality dimensions: diverse, balanced, reasoning-oriented, challenging, and verifiable.
Outcome: The proposed system improves reasoning abilities across six domains using only thousands of metaphorical riddles.
How do Language Models Reshape Entity Alignment? A Survey of LM-Driven EA Methods: Advances, Benchmarks, and Future (2025.emnlp-main)

Copied to clipboard

Challenge: Entity alignment (EA) is critical for knowledge graph (KG) integration.
Approach: They propose a taxonomy that categorizes methods in three stages: data preparation, feature embedding, and alignment.
Outcome: The proposed taxonomy categorizes methods in three key stages: data preparation, feature embedding, and alignment.
Step-by-Step Mastery: Enhancing Soft Constraint Following Ability of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: In real-world scenarios, user instructions often contain soft constraints, which are semantically related and cannot be rule-based verified, posing challenges for large language models.
Approach: They propose a pipeline to construct datasets with high-quality outputs for instructions containing soft constraints automatically and use Direct Preference Optimization (DPO) as the training method.
Outcome: The proposed model improves the LLMs' soft constraint following ability by using direct preference optimization (DPO) and constraint quantity.
Instructions are all you need: Self-supervised Reinforcement Learning for Instruction Following (2026.acl-long)

Copied to clipboard

Challenge: Existing reinforcement learning approaches suffer from dependency on external supervision and sparse reward signals from multi-constraint tasks.
Approach: They propose a self-supervised reinforcement learning framework that eliminates dependency on external supervision by deriving reward signals directly from instructions and generating pseudo-labels for reward model training.
Outcome: The proposed framework achieves strong improvements across 3 in-domain and 5 out-of-domain datasets while maintaining computational efficiency.
What Makes an Ideal Quote? Recommending “Unexpected yet Rational” Quotations via Novelty (2026.acl-long)

Copied to clipboard

Challenge: Prior systems focus on topical relevance and overlook what makes quotes memorable.
Approach: They propose a system that maps quotations and contexts into deep-meaning labels for label-enhanced retrieval.
Outcome: The proposed system can recommend quotations that are contextually novel while semantically coherent.
Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Multi-Modal Knowledge Graphs (MMKGs) are knowledge graphs that integrate and align information from diverse modalities (e.g., text and images).
Approach: They propose a framework that integrates image-text pairs of long-tailed entities and a concept guidance module that offers explainability and enables human verification.
Outcome: The proposed framework improves the accuracy of recognizing long-tailed image-text pairs compared to baselines and also offers flexibility and explainability.
Order Matters: Investigate the Position Bias in Multi-constraint Instruction Following (2025.findings-acl)

Copied to clipboard

Challenge: Existing large language models struggle to follow multi-constraint instructions in real-world applications.
Approach: They propose to quantify the difficulty distribution of constraints by a novel Difficulty Distribution Index (CDDI) they find that LLMs are more performant when presented with constraints in a “hard-to-easy” order.
Outcome: The proposed model is more performant when presented with constraints in a “hard-to-easy” order, compared with existing models with different architectures and sizes of parameters.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations