Papers by Yuyang Zhang

19 papers
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach: They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome: The proposed model achieves comparable performance to standard dense models with more parameters.
IS-CoT: Breaking the Long-form Generation Collapse via Interleaved Structural Thinking (2026.acl-long)

Copied to clipboard

Challenge: Existing models with reasoning capabilities suffer from a severe length collapse in open-ended writing .
Approach: They propose a framework that embeds a dynamic plan-write-reflect cycle into the generation process and train a model with interleaved reasoning traces.
Outcome: The proposed framework achieves state-of-the-art performance on long-form benchmarks compared to other models on the same dataset.
Detecting Spoilers in Movie Reviews with External Movie Knowledge and User Networks (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models focus on the textual content of the review, while spoiler detection requires putting the review into the context of facts and knowledge regarding movies.
Approach: They propose a network-based spoiler detection model that takes into account external knowledge about movies and user activities on movie review platforms.
Outcome: The proposed model takes into account external knowledge about movies and user activities on movie review platforms while incorporating user networks.
DUAL RM: Beyond Rule-based Preference Reward Modeling via Meta-Reward (2026.acl-long)

Copied to clipboard

Challenge: Existing preference-based reward modeling methods face a recursive dependency where each verifier requires a meta-verifier, leading to continuous and costly dependence on human annotation.
Approach: They propose a dual RM that couples discriminative and generative reward models under a non-parametric meta-reward.
Outcome: The proposed model achieves strong performance across major preference benchmarks and even when trained exclusively on language modality, it exhibits robust cross-modal transfer on Omni-RewardBench.
Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve the mathematical reasoning capabilities of Large Language Models (LLMs) are limited due to the proprietary nature of the data.
Approach: They propose a data synthesis method that generates large-scale mathematical reasoning datasets using lightweight 7B-scale models.
Outcome: The proposed method outperforms existing open-source datasets in both in-domain and out-of-domain evaluations and shows improvements in code reasoning tasks.
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons.
Approach: They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation .
Outcome: The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation .
SelfMix: Robust Learning against Textual Label Noise with Self-Mixup Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to handle label noise in text classification tasks are limited to visual data.
Approach: They propose a method to handle label noise in text classification tasks using a Gaussian Mixture Model.
Outcome: The proposed method outperforms baselines on three types of text classification tasks on visual and textual data.
MolErr2Fix: Benchmarking LLM Trustworthiness in Chemistry via Modular Error Detection, Localization, Explanation, and Correction (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown growing potential in molecular sciences, but they often produce chemically inaccurate descriptions and struggle to recognize or justify potential errors.
Approach: They propose a benchmark to assess LLMs on error detection and correction in molecular descriptions.
Outcome: The proposed benchmark targets LLMs on error detection and correction in molecular descriptions.
CMD: a framework for Context-aware Model self-Detoxification (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods of text detoxification fail to achieve a decent balance between effectiveness and generation quality.
Approach: They propose a text detoxification framework that pays attention to both context and detoxification process.
Outcome: Experiments on various LLMs show that the proposed framework can yield the best performance compared to baselines.
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosure (2026.acl-demo)

Copied to clipboard

Challenge: FinReporting is an agentic workflow for localized cross-jurisdiction financial reporting . existing approaches assume a single-market setting and overlook structural differences across jurisdictions .
Approach: They propose a workflow that decomposes financial reporting into auditable stages . they use Large Language Models to extract and summarize corporate disclosures .
Outcome: The proposed system decomposes reporting into auditable stages . it improves consistency and reliability under heterogeneous reporting regimes.
Jellyfish: Instruction-Tuning Local Large Language Models for Data Preprocessing (2024.emnlp-main)

Copied to clipboard

Challenge: Until 2021, most efforts were concentrated on one or two specific tasks such as error detection (ED) and data imputation (DI).
Approach: They propose to instruction tune local LLMs as universal DP task solvers that operate on a local, single, and low-priced GPU, ensuring data security and enabling further customization.
Outcome: The proposed models deliver competitiveness and generalizability to unseen tasks while barely compromising the base models’ abilities in NLP tasks.
UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing query augmentation methods face knowledge update lag and hallucinations in large language models (LLMs) Existing methods face two key challenges: (1) separation of query augmented and encoding tasks, which hinders information sharing and introduces cumulative errors; (2) difficulty of selecting optimal augmentation strategy for different scenarios.
Approach: They propose a unified framework for query understanding in RAG that integrates internal and external knowledge to enhance query augmentation and encoding tasks.
Outcome: The proposed framework outperforms traditional query augmentation methods in five knowledge-intensive benchmark tasks in both closed and open domain question answering.
Rethinking Negative Instances for Generative Named Entity Recognition (2024.findings-acl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) models are constrained by a pre-defined label set and require extensive human annotations, which limits their flexibility and adaptability to unseen tasks.
Approach: They propose a Generative NER system that shows improved zero-shot performance across unseen entity domains by introducing contextual information and delineating label boundaries.
Outcome: The proposed model outperforms state-of-the-art methods in zero-shot evaluation.
SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) lack structural information and semantic context to infer missing entities . large language models often lack structural signals to infuse missing entities into knowledge graphs .
Approach: a modular framework integrates structural information and semantic context into a frozen LLM backbone for link prediction.
Outcome: a new framework integrates KG-derived structural information and semantic context to infer missing entities.
MLAlgo-Bench: Can Machines Implement Machine Learning Algorithms? (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, the top-performing models achieve a 48.8% task completion rate on realizing machine learning algorithms .
Approach: They propose a benchmark to test machine learning's ability to generate ML code for humans . they propose an automatic evaluation framework with metrics such as task pass rate and time overhead .
Outcome: The proposed benchmark is unique in its focus on interpreting complex human instructions and producing multi-step, high-complexity code.
Improving Few-Shot Relation Classification by Prototypical Representation Learning with Definition Text (2022.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to few-shot relation classification have limited labeled examples . a prototype encoder from definition and an instance is needed to learn relation instance classification .
Approach: They propose to learn a prototype encoder from relation definition in a way that is useful for relation instance classification.
Outcome: The proposed encoder outperforms state-of-the-art methods on several datasets.
Escaping the Echo Trap: On Credit Assignment Failure in Multi-turn LLM Self-Reflection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for multi-turn self-reflection are limited by the Echo Trap problem . the model is limited by its inherent capabilities and repeats earlier reflections to preserve reward signals .
Approach: They propose a tree-structured extension of GRPO for multi-turn self-reflection which enables more accurate advantage estimation.
Outcome: The proposed method mitigates behavior collapse and improves performance across benchmarks.
ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents (2026.acl-long)

Copied to clipboard

Challenge: Rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support.
Approach: They propose a peer review benchmarking tool based on paper-specific rubrics and a rubric-guided framework that decomposes reviewing into drafting and grounding stages.
Outcome: The proposed framework outperforms baselines with stronger/larger backbones in both alignment with human judgments and rubric-based review quality across 8 dimensions.
Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression (2026.findings-acl)

Copied to clipboard

Challenge: Despite advances in aligning LLMs with human values, current safety mechanisms remain vulnerable to jailbreak attacks.
Approach: They propose a black-box jailbreak method that uses logical expression translation to bypass LLM safety mechanisms.
Outcome: The proposed method exploits the distributional gap between alignment data and logic-expressed inputs while preserving the underlying semantic intent and readability while evading safety constraints.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations