Papers by Shuai Guo

15 papers
RETAIL: Towards Real-world Travel Planning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing travel planning systems assume users provide explicit queries, limiting their practical utility.
Approach: They propose a dataset RETAIL which supports decision-making for implicit queries while covering explicit queries.
Outcome: The proposed model achieves a 1.0% pass rate, suggesting real-world travel planning remains challenging.
Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding (2025.findings-naacl)

Copied to clipboard

Challenge: Existing chart-related training methods lack capabilities in information extraction, mathematical reasoning, and understanding of multiple chart types.
Approach: They propose a two-stage training strategy and method for jointly training a vision encoder tailored for multi-type charts to address the deficiencies in chart types and limited scope of chart tasks in existing datasets.
Outcome: The proposed dataset includes 21 diverse chart types and tasks, including data retrieval and mathematical reasoning.
UniLG: A Unified Structure-aware Framework for Lyrics Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing works ignore musical attributes hidden behind lyrics and structure of lyrics . existing works ignore structure of generated lyrics and do not consider structure of songs .
Approach: They propose a framework for conditional lyrics generation that considers structure and relationship between lyrics and music.
Outcome: The proposed framework improves the structure modeling and unifies different conditions for different types of lyrics generation.
ReACC: A Retrieval-Augmented Code Completion Framework (2022.acl-long)

Copied to clipboard

Challenge: Recent work has shown that statistical language modeling with transformers can greatly improve the performance in code completion tasks.
Approach: They propose a retrieval-augmented code completion framework that combines a source code retriever and an auto-regressive language model for programming language.
Outcome: The proposed framework achieves state-of-the-art on CodeXGLUE benchmark.
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained language representation models (PLMs) capture sentiment information from word-level while under-considering sentence-level information.
Approach: They propose a Sentiment-aware pre-trained language model with combined Word-level and Sentence-level Pre-training tasks that enhance the PLM’s knowledge about sentiment words.
Outcome: The proposed model achieves state-of-the-art on various sentence-level and aspect-level sentiment classification benchmarks.
P2P: A Poison-to-Poison Remedy for Reliable Backdoor Defense in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Defending Large Language Models (LLMs) against backdoors has long been trapped in a "cat-and-mouse" dilemma where defenders passively react to ever-shifting attack strategies.
Approach: They propose a general and effective defense algorithm that implants benign triggers to reshape the model’s decision boundary.
Outcome: The proposed defense algorithm can neutralize malicious backdoors while preserving task performance.
MaskTab: Scalable Masked Tabular Pretraining with Scaling Laws and Distillation for Industrial Classification (2026.findings-acl)

Copied to clipboard

Challenge: Tabular data is high-dimensional, riddled with missing entries, and rarely labeled at scale.
Approach: They propose a unified pre-training framework for industrial-scale tabular data . MaskTab encodes missing values via dedicated learnable tokens .
Outcome: The proposed framework outperforms XGBoost and MaskTab-L on industrial-scale . it achieves +5.04% AUC and +8.28% KS over prior art under rigorous scaling .
UniXcoder: Unified Cross-Modal Pre-training for Code Representation (2022.acl-long)

Copied to clipboard

Challenge: Pre-trained models for programming languages have demonstrated great success on code intelligence . however, such pre-tried models are sub-optimal for auto-regressive tasks .
Approach: They propose a unified cross-modal pre-trained model for programming language that leverages cross-module contents like AST and code comment to enhance code representation.
Outcome: The proposed model achieves state-of-the-art on most code-related tasks and compares with existing models on zero-shot code-to-code search.
SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) improves LLMs but faces high prefill latency during long contexts.
Approach: They propose a method that uses deep-layer hidden-state norms to guide token selection . they propose to use deep-layered hidden-status norms as a proxy to guide the token selection.
Outcome: The proposed SpecCache outperforms state-of-the-art (SOTA) benchmarks.
Improving Deep Embedded Clustering via Learning Cluster-level Representations (2022.coling-1)

Copied to clipboard

Challenge: Existing efforts to learn meaningful representations at the instance level are limited.
Approach: They propose a deep embedded clustering model with cluster-level representation learning to jointly learn cluster and instance level representations.
Outcome: The proposed model produces meaningful clusters on real-world short text datasets.
Hierarchical Reinforcement Learning with Augmented Step-Level Transitions for LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing Large language model agents rely on increasingly long interaction histories, resulting in high computational cost and limited scalability.
Approach: They propose a hierarchical reinforcement learning framework that enables step-level learning by conditioning only on single-step transitions rather than full interaction histories.
Outcome: The proposed framework outperforms baselines on ScienceWorld and ALFWorld benchmarks in terms of performance and generalization while reducing token usage.
RISK: A Framework for GUI Agents in E-commerce Risk Management (2026.acl-long)

Copied to clipboard

Challenge: RISK is a framework designed to automate multi-step web interactions in e-commerce risk management.
Approach: a new framework is designed to build and deploy GUI agents for e-commerce risk management . RISK-R1 provides a scalable, domain-specific solution for automating complex web interactions .
Outcome: RISK provides a scalable, domain-specific solution for automating complex web interactions in e-commerce risk management.
AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models (2024.findings-naacl)

Copied to clipboard

Challenge: Traditional benchmarks for evaluating foundation models often fail to accurately represent their general abilities for human-centric tasks.
Approach: They propose a bilingual benchmark to assess foundation models in the context of human-centric standardized exams such as college entrance exams, law school admission tests, and math competitions.
Outcome: The proposed benchmark exceeds the average human performance on SAT, LSAT, and math competitions with 95% accuracy and 92.5% on the Chinese college entrance English exam.
ProMedTS: A Self-Supervised, Prompt-Guided Multimodal Approach for Integrating Medical Text and Time Series (2025.findings-acl)

Copied to clipboard

Challenge: Large language models excel at processing unstructured data, but integrating time series data with text remains a challenge.
Approach: They propose a self-supervised multimodal framework that uses prompt-guided learning to unify heterogeneous data types.
Outcome: The proposed framework outperforms state-of-the-art approaches on disease diagnosis tasks using real-world datasets.
HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs).
Approach: They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other.
Outcome: The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations