Papers by Yuchen Tian

11 papers
Tree-of-Evolution: Tree-Structured Instruction Evolution for Code Generation in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Data synthesis is a key research area in large language models (LLMs).
Approach: They propose a framework that models code instruction synthesis process with a tree structure and optimization-driven evolution to alleviate constraints of unidirectional synthesis and randomness-driven generation.
Outcome: The proposed framework outperforms open-weight code LLMs on five widely-used benchmarks.
A Static Evaluation of Code Completion by Large Language Models (2023.acl-industry)

Copied to clipboard

Challenge: Large language models trained on code have shown great potential to increase productivity of software developers.
Approach: They propose a static evaluation framework to quantify static errors in Python code completions by leveraging Abstract Syntax Trees.
Outcome: The proposed framework is more efficient and applicable to code in the wild.
CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding? (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have showcased impressive code generation capabilities, primarily evaluated through language-to-code benchmarks.
Approach: They propose a benchmark to assess LLMs’ code understanding abilities from the perspective of code judging rather than code generation.
Outcome: The proposed benchmark evaluates 12 well-known large language models to determine the correctness of provided code solutions.
Intent-Aware and Hate-Mitigating Counterspeech Generation via Dual-Discriminator Guided LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Hate speech is an aggressive expression that incites hatred towards specific groups based on their group identity.
Approach: They propose an LLMs-based framework for counterspeech generation that uses intent-aware discriminators to decode intents of LLM models.
Outcome: The proposed framework matches intents with hate mitigation intents and performs well.
Token Alignment via Character Matching for Subword Completion (2024.findings-acl)

Copied to clipboard

Challenge: Generative models struggle with prompts corresponding to partial tokens due to tokenization, where partial token is out-of-distribution during inference.
Approach: They propose a method to alleviate tokenization artifact on text completion by backtracking to the last complete tokens and aligning subsequent generations to match with the prompt.
Outcome: The proposed method shows that it improves on partial token scenarios with only a minor time increase.
MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique (2025.findings-emnlp)

Copied to clipboard

Challenge: e MM-CRITIC is a holistic benchmark for evaluating the critique ability of Large Multimodal Models (LMMs) covering 8 main task types and over 500 tasks, covering 4471 samples.
Approach: They introduce a holistic benchmark for evaluating the critique ability of Large Multimodal Models across multiple dimensions: basic, correction, and comparison.
Outcome: The proposed benchmark covers 8 main task types and over 500 tasks and is composed of 4471 samples.
Battling against Tough Resister: Strategy Planning with Adversarial Game for Non-collaborative Dialogues (2025.acl-long)

Copied to clipboard

Challenge: Non-collaborative dialogue involves two participants with conflicting interests engaging in multiround dialogue to achieve their own goals.
Approach: They propose a Game-based Adversarial self-play InterActive training paradigm which constructs an adversarial two-player (a persuader and a resister) zero-sum game and guides the game to approximate Nash Equilibrium (NE) via reinforcement learning.
Outcome: The proposed model achieves state-of-the-art performance on three datasets.
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks .
Approach: They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience.
Outcome: The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning.
CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing code translation datasets focus on a single pair of programming languages . early software systems are developed using programming languages such as Fortran and COBOL .
Approach: They propose a large-scale comprehensive benchmark that supports the largest variety of programming languages for code translation.
Outcome: The proposed framework supports translations between multiple programming languages and a cross-framework dataset for deep learning code across different frameworks.
MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems (2024.findings-emnlp)

Copied to clipboard

Challenge: Programming often involves translating detailed and complex specifications into code . current state-of-the-art models struggle to solve these problems, a new study shows .
Approach: They propose a multi-modal coding dataset to evaluate algorithmic problem-solving skills in visually rich contexts.
Outcome: The proposed model lacks powerful vision-code models due to the extreme demand for reasoning abilities.
R3-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL (2024.findings-emnlp)

Copied to clipboard

Challenge: Adapting existing approaches for converting natural language to SQL encounters hurdles due to distinct nature of GQL compared to SQL.
Approach: They propose a method that integrates both small and large Foundation Models for ranking, rewriting, and refining tasks.
Outcome: The proposed approach integrates both small and large Foundation Models for ranking, rewriting, and refining tasks while capitalizing on the superior generalization and query generation prowess of larger models for the final transformation of natural language queries into GQL formats.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations