Papers by Yuxuan Huang

43 papers
TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators (2025.findings-acl)

Copied to clipboard

Challenge: Triton is a high-level Python-like programming language for building efficient GPU kernels.
Approach: They propose a TritonBench benchmark that provides a comprehensive evaluation of Tritonic operators on widely deployed GPUs.
Outcome: The proposed benchmarks show that current LLMs struggle to generate efficient Triton operators on widely deployed GPUs aligned with industry applications.
Spiral of Silence in Large Language Model Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing theories of Spiral of Silence do not apply to large language models .
Approach: They propose an evaluation framework for examining SoS in large language models . they consider four controlled conditions that vary the availability of "History" and "Persona" signals .
Outcome: The proposed framework examines the SoS-like dynamics in large language models . it shows that history and persona together produce strong majority dominance .
Each graph is a new language: Graph Learning with LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Natural language is used to describe graphs, but graph descriptions become verbose and only relying on attribute embeddings limits LLM’s ability to capture adequate graph structural information.
Approach: They propose a graph-defined language for large language model that translates the graph into a corpus instead of graph descriptions and pre-trains LLMs on this corpus to adequately understand the graph.
Outcome: Experiments on five datasets show that the proposed framework outperforms description-based and embedding-based baselines by efficiently modeling different orders of neighbors.
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are a promising alternative to expensive human evaluations.
Approach: They propose a framework that iteratively aligns LLM-based evaluators with human preference . they decompose a given evaluation task into finer-grained criteria .
Outcome: The proposed framework iteratively aligns LLM-based evaluators with human preference . it decomposes a given evaluation task into finer-grained criteria . the framework is efficient to train and more explainable than relying solely on prompts .
MAGI: Multi-Agent Guided Interview for Psychiatric Assessment (2025.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) do not align with psychiatric diagnostic protocols.
Approach: They propose a framework that transforms the Mini International Neuropsychiatric Interview into automatic computational workflows through coordinated multi-agent collaboration.
Outcome: The proposed framework transforms the gold-standard Mini International Neuropsychiatric Interview (MINI) into automatic computational workflows through coordinated multi-agent collaboration.
PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Large language models demonstrate remarkable capabilities across various domains, including mathematics and logic reasoning.
Approach: They propose a physics-based reasoning benchmark that includes physics theorems and constraints and a Physics Solution Auto Scoring Framework to evaluate physics based reasoning in large language models.
Outcome: The proposed framework enables models to achieve less than 60% on answer-level evaluation, with performance dropping from knowledge questions (75.11%) to hard problems (31.99%).
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research.
Approach: They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication.
Outcome: The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication.
Three Sentences Are All You Need: Local Path Enhanced Document Relation Extraction (2021.acl-short)

Copied to clipboard

Challenge: Document-level relation extraction (RE) is more challenging than sentence RE as it often requires reasoning over multiple sentences.
Approach: They propose a method to heuristically select evidence sentences for document-level relation extraction.
Outcome: The proposed method can be easily combined with BiLSTM to achieve good performance on benchmark datasets even better than fancy graph neural network based methods.
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: LogicAsker examines and improves the reasoning abilities of large language models such as ChatGPT and GPT-4.
Approach: They propose a set of atomic reasoning skills grounded in propositional and predicate logic to examine and improve the reasoning abilities of large language models such as ChatGPT and GPT-4.
Outcome: The proposed approach improves reasoning abilities in large language models such as ChatGPT and GPT-4 by up to 5%.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
ToolPRM: Fine-Grained Inference Scaling of Structured Outputs for Function Calling (2026.acl-long)

Copied to clipboard

Challenge: Existing research on inference scaling focuses on unstructured output generation tasks, such as mathematical problems.
Approach: They propose an inference-scaling framework that combines fine-grained beam search with ToolPRM, a process reward model scoring each intra-call decision.
Outcome: The proposed framework outperforms outcome and coarse-grained reward models in predictive accuracy and yields consistent test-time gains on multiple function-calling benchmarks.
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models (2026.acl-long)

Copied to clipboard

Challenge: Recent studies observe a phenomenon where reward models achieve high accuracy on static datasets but fail to generalize effectively during RLHF.
Approach: They propose a method that combines rationale consistency with outcome accuracy to improve performance on RM-Bench and JudgeBench.
Outcome: The proposed method surpasses baselines on RM-Bench and JudgeBench by an average of 5% and improves creative writing tasks by 7%.
Democratizing Reasoning Ability: Tailored Learning from Large Language Model (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature.
Approach: They propose a tailored learning approach to distill the exclusive reasoning ability to smaller LMs to facilitate democratization.
Outcome: The proposed approach enables the democratization of the exclusive reasoning ability by leveraging the black-box model as a reasoning teacher.
Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systems (2026.acl-long)

Copied to clipboard

Challenge: Rapid urbanization and surging vehicle ownership intensify congestion . rapid urbanization drives crash rates, slow emergency response, and burden transit-poor communities .
Approach: They introduce a 3B-parameter foundation model with human-like reasoning for Traffic signal control (TSC) they use reinforcement learning and network communication to convert LLM into a traffic-control model that operates like a human traffic agent.
Outcome: The proposed model outperforms baselines and training-intensive RL controllers on a simulated traffic environment and reduces queue lengths by more than 5%.
SocialEval: Evaluating Social Intelligence of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing work on LLMs does not address their social intelligence (SI) and their discrepancy with humans.
Approach: They propose a script-based bilingual SI benchmark that integrates outcome-oriented goal achievement evaluation and process-oriented interpersonal ability evaluation by manually crafting narrative scripts.
Outcome: The proposed model is based on a script-based bilingual evaluation paradigm that integrates outcome- and process-oriented evaluation by manually crafting narrative scripts.
Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intents (2026.acl-long)

Copied to clipboard

Challenge: Tool-calling agents are increasingly deployed in real-world customer-facing workflows . but most studies on tool-callers focus on idealized settings with general, fixed, and well-specified tasks.
Approach: They propose a tool-calling agent-based data pipeline that converts trajectories into user-facing tasks with controlled intent adaptations.
Outcome: The proposed pipeline can be used to study tool use under three scenarios.
TestAgent: An Adaptive and Intelligent Expert for Human Assessment (2025.findings-acl)

Copied to clipboard

Challenge: Existing adaptive testing methods face several challenges due to mechanized nature of most algorithms and noisy response data.
Approach: They propose to use large language models to enhance adaptive testing through interactive engagement to capture test-takers’ responses and anomalies.
Outcome: The proposed agent achieves more accurate results with 20% fewer questions than state-of-the-art baselines and testers preferred it in speed, smoothness, and other dimensions.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes .
Approach: They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering.
Outcome: The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability.
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation .
Approach: They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input.
Outcome: The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions.
MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to visual chain-of-thought are limited by external tools or fail to generate high-fidelity diagrams.
Approach: They propose a framework to enable large multimodal models with VCoT capabilities . they pre-train a model on a 15.2M-pair corpus and teach it how to leverage visual aids .
Outcome: The proposed framework unlocks complex, human-like visual reasoning in large language models . it pre-trains the model on a 15.2M-pair corpus and fine-tunes it on MathCanvas-Instruct .
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios .
Approach: They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios.
Outcome: The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm.
FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling (2025.acl-long)

Copied to clipboard

Challenge: Speculative sampling is an efficient way to accelerate the auto-regressive generation process of large language models.
Approach: They propose a frequency-ranked speculative sampling framework that optimizes draft candidate selection through vocabulary space compression.
Outcome: Experiments show that FR-Spec reduces LM Head computation overhead by 75% while ensuring the equivalence of the final output distribution.
Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Data (2026.acl-long)

Copied to clipboard

Challenge: Recent research shows that LLM Agents can generate “believable” human behaviors via prompt-only methods, leaving open questions of whether they can accurately generate step-by-step actions in multi-turn interaction tasks.
Approach: They propose to use shopping data to evaluate LLMs' ability to accurately generate step-by-step actions in a multi-turn interaction task.
Outcome: The proposed model achieves 17.26% action generation accuracy and 33.86% F1 score on final purchase prediction, representing improvements of 5.4% and 13.85% over baselines.
OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation (2026.acl-long)

Copied to clipboard

Challenge: evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user.
Approach: They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions.
Outcome: The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user.
Why Machine Reading Comprehension Models Learn Shortcuts? (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies show that many MRC models learn shortcuts to outwit benchmarks, but the performance is unsatisfactory in real-world applications.
Approach: They propose to use shortcut questions to analyze learning difficulty of MRC models . they propose to analyze the learning difficulty regarding shortcut and challenging questions .
Outcome: The proposed methods show that a large proportion of shortcut questions in training data make models rely on shortcut tricks excessively.
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies.
Approach: They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation.
Outcome: The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios .
ATLAS: Agent Tuning via Learning Critical Steps (2025.findings-acl)

Copied to clipboard

Challenge: Existing agent tuning approaches employ supervised finetuning on entire expert trajectories, but behavior-cloning of full traitories introduces expert bias and weakens generalization to states not covered by the expert data.
Approach: They propose a method that finetunes LLMs on critical steps in expert trajectories and identifies and finetuns them on these steps with reduced costs.
Outcome: The proposed method outperforms existing methods and open-source LLM agents on only 30% critical steps in extensive experiments.
SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering? (2026.findings-acl)

Copied to clipboard

Challenge: Evaluating software engineering capabilities is a core component of large language models (LLMs).
Approach: They propose a benchmark to evaluate LLM-generated test suites that introduces mutated solutions that attempt to "fool" them.
Outcome: The proposed test suites are based on 2,636 mutated variants derived from 800 original instances and include a multilingual subset spanning nine programming languages.
Length Controlled Generation for Black-box LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach: They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome: The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.
GraphAgent: Agentic Graph Language Assistant (2025.emnlp-main)

Copied to clipboard

Challenge: Real-world data combines structured and unstructured formats, capturing explicit relationships and implicit semantic interdependencies.
Approach: They propose GraphAgent, an automated agent pipeline addressing both explicit and implicit graph-enhanced semantic dependencies for predictive and generative tasks.
Outcome: Extensive experiments on diverse datasets validate GraphAgent’s effectiveness in graph-related predictive and text generative tasks.
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit severe hallucinations, which undermine reliability of automated scientific document understanding systems.
Approach: They propose a framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization.
Outcome: The proposed framework significantly reduces hallucination rates and improves overall accuracy on the MeasEval benchmark.
Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play (2026.acl-long)

Copied to clipboard

Challenge: Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes.
Approach: They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer.
Outcome: The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks.
Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions (2026.acl-long)

Copied to clipboard

Challenge: Existing reinforcement learning methods are expensive due to high latency and sample inefficiency . Currently, RL is limited to one-to-one state-action pairs .
Approach: They propose a framework that shifts the training paradigm to Single State Multiple Actions and introduce a group-wise advantage estimator based on the averaged critic outputs.
Outcome: The proposed framework achieves 7.5% and 8.3% success rate improvements on AndroidLab and AndroidWorld over UI-TARS-1.5-7B and attains 1.4x higher training efficiency than existing methods.
Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing "LLM-as-a-judge" evaluation frameworks are limited by persona descriptions and are not generalizable to other tasks.
Approach: They propose a framework that can automatically construct multiple evaluator personas with distinct dimensions from relevant text documents and instantiate LLM agents with the persona.
Outcome: The proposed framework can believably simulate human evaluators . it extracts stakeholders' diverse perspectives from the provided research papers and constructs personas for the agents .
Calibrating LLM-Based Evaluator (2024.lrec-main)

Copied to clipboard

Challenge: Existing models for large language models lack the ability to calibrate their outputs towards human preference.
Approach: They propose a multi-stage, gradient-free approach to calibrate an LLM-based evaluator toward human preference.
Outcome: The proposed approach improves correlation with expert evaluation on multiple text quality evaluation datasets.
Event Detection from Social Media for Epidemic Prediction (2024.naacl-long)

Copied to clipboard

Challenge: Social media is an easy-to-access platform providing timely updates about societal trends and events.
Approach: They propose a framework to extract epidemic-related events from social media posts to provide early warnings.
Outcome: The proposed framework can detect epidemic events for three unseen epidemics of Monkeypox, Zika, and Dengue while existing models fail miserably.
Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to cognitive restructuring (CR) are limited by entrenched cognitive distortions, emotional resistance, and individual differences.
Approach: They propose a framework that structures CR as theory-grounded multi-stage multi-turn dialogue and a multi-channel loop mechanism to account for diverse individual distortions.
Outcome: The proposed framework integrates supportive strategies for emotional management and a multi-channel loop mechanism to account for diverse individual distortions.
Learning Fine-Grained Grounded Citations for Attributed Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: despite impressive performance, large language models still struggle with hallucinations . current approaches suffer from suboptimal citation quality due to reliance on in-context learning .
Approach: They propose a framework that teaches large language models to generate fine-grained citations.
Outcome: The proposed framework outperforms all baselines on the ALCE benchmark and achieves an average improvement of 14.21% in citation quality.
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing models for visual information extraction suffer from limitations in scale and realism . ReceiptBench is a large-scale, human-annotated benchmark for receipts .
Approach: They propose a large-scale, human-annotated benchmark for visual information extraction . the method organizes information extraction into four hierarchical sub-tasks .
Outcome: The proposed method surpasses proprietary models on complex reasoning tasks.
SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding.
Approach: They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality.
Outcome: The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet.
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing.
Approach: They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations.
Outcome: The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks.
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models (2021.naacl-main)

Copied to clipboard

Challenge: Pre-trained language models process text as a sequence of characters, ignoring more coarse granularity, e.g., words.
Approach: They propose a new pre-training paradigm for Chinese that incorporates word representations along with characters and can model a sentence in a multi-granular manner.
Outcome: The proposed model can bring an average increase of 1.5% under the 12-layer setting, which achieves new state-of-the-art among base-size models on the CLUE benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations