Papers by Chenyu Wang

14 papers
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
From Synthesis to Clinical Assistance: A Strategy-Aware Agent Framework for Autism Intervention based on Real Clinical Dataset (2026.acl-long)

Copied to clipboard

Challenge: Applied Behavior Analysis (ABA) is the gold standard for clinical intervention, but large language models struggle to adhere to its standardized procedures.
Approach: They propose a strategy-aware framework to unify high-fidelity intervention dialogue synthesis and clinical decision support.
Outcome: Experiments show that ASDAgent achieves nearly 80% strategic consistency with human experts.
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)

Copied to clipboard

Challenge: Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process .
Approach: They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment.
Outcome: The proposed paradigm outperforms existing methods in compositional editing tasks.
DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing detectors are limited in their ability to detect large language models generated content in multilingual environments.
Approach: They propose a multilingual benchmark to evaluate advanced detectors across 8 dimensions to better align with real-world applications.
Outcome: The proposed benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse.
Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language (2025.acl-long)

Copied to clipboard

Challenge: Existing datasets for instruction-following are monolingual and centered on English . existing data are unable to capture linguistic and cultural subtle differences .
Approach: They propose an extension of IFEval to a localized multilingual version called Marco-Bench-MIF . their benchmark addresses linguistic constraints and cultural references via translation and verification .
Outcome: The proposed extension of IFEval to a localized multilingual version covers 30 languages with varying levels of localization.
Semantic Consistency-Based Uncertainty Quantification for Factuality in Radiology Report Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Radiology report generation has shown great potential in assisting radiologists . generative medical Vision Large Language Models (VLLMs) are prone to hallucinations and can produce inaccurate diagnostic information.
Approach: They propose a framework that provides both report-level and sentence-level uncertainties.
Outcome: The proposed method improves factuality scores by 10% by rejecting 20% of reports on the MIMIC-CXR dataset.
ExpanRL: Hierarchical Reinforcement Learning for Course Concept Expansion in MOOCs (2020.aacl-main)

Copied to clipboard

Challenge: Existing methods for concept expansion in MOOCs are inefficient because of the diversity of MOOC courses and rapid updates.
Approach: They propose an end-to-end hierarchical reinforcement learning (HRL) model for concept expansion in MOOCs that employs a two-level mechanism of seed selection and concept expansion.
Outcome: The proposed model improves on nine real MOOC datasets and maintains competitive performance under different settings.
MOOCCube: A Large-scale Data Repository for NLP Applications in MOOCs (2020.acl-main)

Copied to clipboard

Challenge: Massive open online courses (MOOCs) are a popular educational platform for advanced research.
Approach: They propose to use MOOCCube to build a large-scale data repository of over 700 MOOC courses, 100k concepts, 8 million student behaviors with an external resource.
Outcome: The proposed datasets show that they can facilitate research in MOOCs.
ASD-iLLM:An Intervention Large Language Model for Autistic Children based on Real Clinical Dialogue Intervention Dataset (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, leveraging large language models (LLMs) for autism intervention is a significant yet challenging task, especially when directly employing LLMs as an intervention doctor.
Approach: They propose a framework for training LLMs to conduct dialogue interventions in accordance with the principles of Applied Behavior Analysis (ABA) they also propose 'role-play' strategy in which LLM act as autistic children to comprehensively evaluate the doctor model's capabilities at the dialogue level.
Outcome: The proposed framework outperforms existing models in both automatic and human evaluation, with intervention strategies and dialogue style more closely resembling those of clinical intervention doctors.
Joint Pre-Encoding Representation and Structure Embedding for Efficient and Low-Resource Knowledge Graph Completion (2024.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge graph completion models require longer training and inference times as well as increased memory usage.
Approach: They propose to encode textual descriptions into semantic representations before training and integrate structural embedding with pre-encoded semantic description to improve model's prediction performance on 1-N relations.
Outcome: The proposed model increases inference speed by 30x and reduces training memory by approximately 60% on the WN18RR and UMLS datasets.
RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation (2025.findings-emnlp)

Copied to clipboard

Challenge: Using reinforcement learning from human feedback, large language models perform poorly when applied to colloquial subtitle translation tasks.
Approach: They propose an adversarial training framework that iteratively updates the offline reward model and the online LLM to improve training outcomes.
Outcome: The proposed training framework significantly improves upon translation baselines.
Course Concept Expansion in MOOCs with External Knowledge and Interactive Game (P19-1)

Copied to clipboard

Challenge: Existing methods to expand course concepts in MOOCs suffer from semantic drifts and lack of knowledge guidance.
Approach: They propose to use a boundary search method to search for new concepts via external knowledge base and then use heterogeneous features to verify the results.
Outcome: The proposed method improves on the datasets from Coursera and XuetangX.
Navigating the OverKill in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have highlighted a tendency among large language models to refuse to answer benign queries.
Approach: They propose a model-agnostic approach to reduce excessive attention to harmful words like ‘kill’ and a method to decode the next-token predictions by contrastive decoding.
Outcome: The proposed approach reduces the refusal rate by 20% while having little impact on safety.
LADDER: Language-Driven Slice Discovery and Error Rectification in Vision Classifiers (2025.findings-acl)

Copied to clipboard

Challenge: Current slice discovery methods in computer vision rely on converting input images into sets of attributes and testing hypotheses about configurations of pre-computed attributes associated with elevated error patterns.
Approach: They propose a method to identify systematic biases in the mistakes of pre-trained vision models by converting input images into sets of attributes and testing hypotheses about configurations of these attributes.
Outcome: The proposed method outperforms existing methods on 3 natural and 3 medical imaging datasets and generates pseudo-labels for each identified bias.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations