Papers by Zirui Zhao

6 papers
AssistedDS: Benchmarking How External Domain Knowledge Assists LLMs in Automated Data Science (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have advanced the automation of data science workflows, yet it remains unclear whether they can critically leverage external domain knowledge as human data scientists do in practice.
Approach: They propose a benchmark to evaluate how large language models handle external domain knowledge in tabular prediction tasks.
Outcome: The proposed model evaluates whether it can critically leverage external domain knowledge as human data scientists do in practice.
Mitigating Shortcuts in Language Models with Soft Label Encoding (2024.lrec-main)

Copied to clipboard

Challenge: Recent studies have shown that large language models rely on spurious correlations in the data for natural language understanding (NLU) tasks.
Approach: They propose a framework for debiasing shortcuts and a dummy class to encode shortcuts into a model and use it to generate soft labels.
Outcome: The proposed framework significantly improves out-of-distribution generalization while maintaining satisfactory in-district accuracy.
On the Empirical Complexity of Reasoning and Planning in LLMs (2024.findings-emnlp)

Copied to clipboard

Challenge: Evidence shows that the relative performance of CoT, ToT, and their variants may vary from task to task.
Approach: They propose to use chain-of-thought (CoT), tree-of thought (ToT), and related techniques to solve complex reasoning tasks with Large Language Models.
Outcome: The proposed methods outperform the linear structure of CoT on hard reasoning tasks.
Walk in Others’ Shoes with a Single Glance: Human-Centric Visual Grounding with Top-View Perspective Transformation (2025.acl-long)

Copied to clipboard

Challenge: Existing VLMs are insensitive to information differences induced by slight perspective changes.
Approach: They propose a visual perspective-taking task that requires robots to interpret human-centric instructions and identify corresponding objects from robot perspectives.
Outcome: The proposed method improves performance by up to 18% and generalizes effectively to robotic and dynamic scenarios.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations