Papers by Zihao Guo

12 papers
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques.
Approach: They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning.
Outcome: The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning.
The Illusion of Randomness: How LLMs Fail to Emulate Stochastic Decision-Making in Rock-Paper-Scissors Games? (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior research indicates that large language models articulate the theoretical probability distributions associated with optimal strategic choices, but their actual decision-making diverges from these prescriptions.
Approach: a systematic evaluation of 20 state-of-the-art LLMs reveals a cognitive bias gap . intrinsic biases inherited from pre-training corpora alone are insufficient to explain deviations . a semantic-free paradigm strips away intrinsic bias to isolate pure positional bias .
Outcome: a systematic evaluation of 20 state-of-the-art LLMs shows that intrinsic biases are insufficient to explain deviations.
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)

Copied to clipboard

Challenge: a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities .
Approach: They present a comparative analysis to identify and distinguish LLM activities from human activities.
Outcome: The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities.
RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have exhibited significant proficiency in code debugging, especially in automatic program repair.
Approach: They propose a repository-level code debugging dataset with 22 subtypes of errors that supports 8 commonly used programming languages and 3 debug tasks.
Outcome: The proposed dataset supports 8 commonly used programming languages and 3 debugging tasks.
ToolSpectrum: Towards Personalized Tool Utilization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on functional tool selection following user instructions while overlooking the critical role of context-aware personalization in tool selection.
Approach: They propose a benchmark to evaluate LLMs’ capabilities in personalized tool utilization.
Outcome: The proposed benchmark evaluates LLMs' capabilities in personalized tool utilization.
RouteRAG: Efficient Retrieval-Augmented Generation from Text and Graph via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing graph-based or hybrid systems lack the ability to integrate supplementary evidence as reasoning unfolds.
Approach: They propose a framework that integrates non-parametric knowledge into Large Language Models . they use a RL-based framework to optimize the entire generation process via RL .
Outcome: The proposed framework outperforms existing RAG frameworks in five question answering benchmarks.
MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models have shown immense potential in multimodal applications, but convergence between textual and musical domains remains unexplored.
Approach: They propose a system that aligns music representations with a frozen LLM . they train the system on an extensive music caption dataset and fine-tune it with instructional data .
Outcome: The proposed system bridges the gap between music audio and textual contexts by combining music captions with a frozen model . it performs well in generating music caption and composing music-related Q&A pairs . the proposed system is available for free download at http://www.musilingo.com/ .
Reading Between the Tweets: Deciphering Ideological Stances of Interconnected Mixed-Ideology Communities (2024.findings-eacl)

Copied to clipboard

Challenge: Existing studies treat ideology as a liberal/conservative binary and fail to capture the spectrum of ideologies that may organically emerge in interconnected online communities.
Approach: They propose a method that uses finetuning language models to probe nuanced ideologies of online communities by analyzing discussions of the 2020 election on Twitter.
Outcome: The proposed approach shows higher alignment than baselines for the proposed approach.
Community-Cross-Instruct: Unsupervised Instruction Generation for Aligning Large Language Models to Online Communities (2024.emnlp-main)

Copied to clipboard

Challenge: Social scientists use surveys to learn opinions and beliefs of populations, but these methods are slow, costly, and prone to biases.
Approach: They propose a framework for aligning large language models to online communities by finetuning instruction-output pairs by an advanced LLM to elicit their beliefs.
Outcome: The proposed framework enables cost-effective and automated surveying of diverse online communities.
Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing frameworks that focus on static tools and static assets are ineffective for self-evolving agents.
Approach: They propose a paradigm of co-evolutionary Capability Expansion and Experience Distillation that leverages accumulated experience to guide dynamic creation of assets.
Outcome: The proposed framework improves performance in single-task and cross-task settings by 18.53% over standard LLMs, 11.80% over agents evolving solely through experience, and 6.46% over those evolving solelly through asset creation.
Fine-grained Artificial Neurons in Audio-transformers for Disentangling Neural Auditory Encoding (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies treat each transformer encoding layer as a single artificial neuron . layer-level embeddings aggregate multiple types of contextual attention captured by multiple head modules .
Approach: They propose to embed each transformer encoding layer as a single artificial neuron . they propose to couple those ANs with their biological-neuron counterparts in the human brain .
Outcome: The proposed models can be used to link representations to brain activity, the authors say . their results show that the proposed models carry meaningful neurolinguistic information .
Whose Emotions and Moral Sentiments do Language Models Reflect? (2024.findings-acl)

Copied to clipboard

Challenge: Existing research has focused on positional alignment, which measures how closely the models mimic the opinions and stances of different social groups.
Approach: They define the problem of affective alignment, which measures how LMs’ emotional and moral tone represents those of different groups.
Outcome: The results show that the models represent the perspectives of some social groups better than others, suggesting a systemic bias within LMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations