Papers by Lin Tian

40 papers
Tree-of-Evolution: Tree-Structured Instruction Evolution for Code Generation in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Data synthesis is a key research area in large language models (LLMs).
Approach: They propose a framework that models code instruction synthesis process with a tree structure and optimization-driven evolution to alleviate constraints of unidirectional synthesis and randomness-driven generation.
Outcome: The proposed framework outperforms open-weight code LLMs on five widely-used benchmarks.
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results .
Approach: They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method .
Outcome: The proposed methods outperform random selection on large datasets on large data pools.
Encoding Spreadsheets for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Spreadsheets are characterized by their extensive two-dimensional grids, flexible layouts, and varied formatting options, which pose significant challenges for large language models (LLMs).
Approach: They propose a structural-anchor-based compression, inverse index translation, and data-format-aware aggregation module to compress spreadsheets effectively.
Outcome: The proposed method outperforms the existing model in GPT4 and achieves a state-of-the-art 78.9% F1 score.
CriticBench: Benchmarking LLMs for Critique-Correct Reasoning (2024.findings-acl)

Copied to clipboard

Challenge: CriticBench is a benchmark designed to assess LLMs’ abilities to critique and refine their reasoning across a variety of tasks.
Approach: They propose a benchmark to assess LLMs' ability to critique and correct reasoning across a variety of tasks.
Outcome: The proposed benchmark examines the performance of 17 large language models in generation, critique, and correction reasoning.
Self-Evolving Multi-Agent Systems via Textual Backpropagation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have proven effective for addressing complex, high-dimensional tasks, but current approaches rely on static, manually engineered multi-agent configurations.
Approach: They propose a framework that conceptualizes multi-agent collaboration as a layered neural network architecture.
Outcome: The proposed framework surpasses leading multi-agent baselines under the same configurations, showing consistent performance improvements.
Q-TOD: A Query-driven Task-oriented Dialogue System (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pipelined task-oriented dialogue systems have difficulties adapting to unseen domains . end-to-end systems are plagued by large-scale knowledge bases in practice .
Approach: They propose a query-driven task-oriented dialogue system that extracts dialogue context information into a natural language query.
Outcome: The proposed system outperforms strong baselines and establishes a new state-of-the-art performance on three publicly available task-oriented dialogue datasets.
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding? (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have showcased impressive code generation capabilities, primarily evaluated through language-to-code benchmarks.
Approach: They propose a benchmark to assess LLMs’ code understanding abilities from the perspective of code judging rather than code generation.
Outcome: The proposed benchmark evaluates 12 well-known large language models to determine the correctness of provided code solutions.
GEMS: Generation-Based Event Argument Extraction via Multi-perspective Prompts and Ontology Steering (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for event argument extraction rely on a single prompt . existing methods ignore complex structural and dynamic interdependencies between event arguments .
Approach: They propose a multi-prompt learning framework that generates event arguments via multi-perspective prompts and ontology steering.
Outcome: The proposed framework captures interrelationships between arguments and ontology steering . it uses multiple unfilled prompts for each sentence to generate event arguments .
TMFN: A Target-oriented Multi-grained Fusion Network for End-to-end Aspect-based Multimodal Sentiment Analysis (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for multimodal aspect-based sentiment analysis focus on fusing image regional information and textual words.
Approach: They propose a multimodal aspect-based sentiment analysis method that integrates regional and global image information with global image data.
Outcome: Experiments show that the proposed method outperforms state-of-the-art methods on two benchmark datasets.
CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fingerprinting model ownership traces are vulnerable to illegal plagiarism and are not reliable.
Approach: They propose a rule-driven fingerprinting framework that encodes contextual correlations across multiple dialogue turns.
Outcome: The proposed framework achieves stronger stealth and robustness than previous work.
DUCK: Rumour Detection on Social Media by Modelling User and Comment Propagation Networks (2022.naacl-main)

Copied to clipboard

Challenge: Social media rumours can cause significant economic and social disruption.
Approach: They propose a rumour detection algorithm that leverages transformers and graph attention networks to jointly model social media conversations and the network of users who engaged in them.
Outcome: The proposed algorithm produces superior performance over four widely used benchmark rumour datasets in English and Chinese.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models face persistent challenges when handling long-context tasks . existing methods that reduce input have the risk of discarding key information .
Approach: To address this issue, we propose a multi-agent reasoning framework called Tree of Agents . the framework segments input into chunks processed by independent agents .
Outcome: The proposed model outperforms baseline models on long-context tasks.
Facilitating Long Context Understanding via Supervised Chain-of-Thought Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have enabled them to process increasingly longer sequences, ranging from 2K to 2M tokens and even beyond.
Approach: They propose a synthetic dataset in the financial domain that integrates Chain-of-Thought reasoning into LLMs in a supervised manner to facilitate effective long-context understanding.
Outcome: The proposed model outperforms standard GPT-4o-mini on the Loong benchmark and fine tunes LLaMA-3.1-8B-Instruct on the model, achieving a 28.0% gain on the financial subset.
PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation (2022.findings-aacl)

Copied to clipboard

Challenge: Experimental results show PLATO-XL achieves state-of-the-art results across multiple conversational tasks.
Approach: They propose to train PLATO-XL models with up to 11 billion parameters, trained on Chinese and English social media conversations.
Outcome: The proposed model achieves state-of-the-art on multiple conversational tasks, verifying its potential as a foundation model of conversational AI.
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies for visually-situated language understanding have shown shallow zero-shot visual text recognition ability when fed a low-resolution image with salient text information.
Approach: They propose a model for universal OCR-free visually-situated language understanding based on the Multimodal Large Language Model (MLLM) their model is jointly finetuned on a wide range of visually situated language understanding tasks via a unified instruction format.
Outcome: The proposed model achieves state-of-the-art ocr-free performance in 8 out of 10 visually-situated language understanding tasks across 5 domains: documents, tables, charts, natural images, and webpage screenshots.
SEE: Signal Embedding Energy for Quantifying Noise Interference in Large Audio Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on noise lack quantitative analysis and rely on intuition and empirical observation, thus failing to understand practical robustness.
Approach: They propose a method for quantifying the impact of noise intensity on LALM inputs by using a structured activation subspace derived from the model's internal representations.
Outcome: The proposed method outperforms existing denoising methods and demonstrates that noise is perceived more accurately than raw audio features.
Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Language (2026.findings-acl)

Copied to clipboard

Challenge: Current state-of-the-art LLMs exhibit clear limitations on multiple tasks, while performing well on tasks that involve contextual semantic understanding.
Approach: They propose a mouse-based benchmark to evaluate LLMs' performance on NLP tasks involving Chouxiang Language.
Outcome: The proposed benchmark evaluates the performance of LLMs on six NLP tasks involving Chouxiang Language.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Training Language Models to Critique With Multi-agent Feedback (2025.findings-emnlp)

Copied to clipboard

Challenge: utilizing human annotations can enhance critique ability, but model-generated critiques suffer from inherent flaws due to complexity of critique . a new framework that leverages multi-agent feedback improves critique ability .
Approach: They propose a framework that leverages multi-agent feedback to improve critique ability . they propose to use supervised fine-tuning and reinforcement learning to improve this capability .
Outcome: The proposed framework improves critique ability in both supervised fine-tuning and reinforcement learning stages.
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues (2022.acl-long)

Copied to clipboard

Challenge: Existing work in vision language cross-modal reasoning uses binary or multi-choice classification based on source image and textual query.
Approach: They propose a task where a textual premise is the background presumption on each source image.
Outcome: The proposed task is based on a dataset of 15,360 movie screenshots and human-curated premise templates from 6 pre-defined categories.
MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique (2025.findings-emnlp)

Copied to clipboard

Challenge: e MM-CRITIC is a holistic benchmark for evaluating the critique ability of Large Multimodal Models (LMMs) covering 8 main task types and over 500 tasks, covering 4471 samples.
Approach: They introduce a holistic benchmark for evaluating the critique ability of Large Multimodal Models across multiple dimensions: basic, correction, and comparison.
Outcome: The proposed benchmark covers 8 main task types and over 500 tasks and is composed of 4471 samples.
MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for text-to-audio-video (T2AV) generation are largely designed for human-recorded videos or single-speaker settings.
Approach: They propose a failure-driven diagnostic benchmark for multi-talker dialogue-centric audio-video generation.
Outcome: The benchmark evaluates multi-speaker dialogue generation at four levels: audio-visual signal fidelity, temporal attribute consistency, social interaction, and cinematic expression.
Task and Sentiment Adaptation for Appraisal Tagging (2023.eacl-main)

Copied to clipboard

Challenge: Appraisal framework in linguistics defines the framework for fine-grained evaluations and opinions.
Approach: They propose to use language models to automatically identify and annotate text segments for appraisal.
Outcome: The proposed model achieves superior performance than baseline adapter-based models and other neural classification models for cross-domain and cross-language settings.
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Positional biases in large language models hinder their ability to process long inputs.
Approach: They propose a benchmark to assess positional bias in large language models involving multiple pieces of relevant information.
Outcome: The proposed benchmark assesses the performance of long-context language models by examining their models with different input lengths and tasks.
FedCSR: A Federated Framework for Multi-Platform Cross-Domain Sequential Recommendation with Dual Contrastive Learning (2025.coling-main)

Copied to clipboard

Challenge: Existing federated frameworks for cross-domain sequential recommendation rely on user alignment, which increases communication costs and privacy risks.
Approach: They propose a federated cross-domain sequential recommendation framework that eliminates the need for user alignment between platforms.
Outcome: The proposed framework eliminates the need for user alignment between platforms.
Hint-Based Training for Non-Autoregressive Machine Translation (D19-1)

Copied to clipboard

Challenge: AutoRegressive Translation models have to generate tokens sequentially during decoding and thus suffer from high inference latency.
Approach: They propose to use hidden states and word alignments to help train NART models.
Outcome: The proposed model improves on the WMT14 En-De and De-En datasets but is faster in inference than the current models.
Enable Fast Sampling for Seq2Seq Text Diffusion (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing text generation methods use autoregressive (AR) methods, which generate tokens one by one, but are time-consuming.
Approach: They propose an efficient model FMSeq which utilizes flow matching to straighten the generation path, thereby enabling fast sampling for diffusion-based seq2seq text generation.
Outcome: The proposed model generates comparable quality to the SOTA diffusion-based DiffuSeq in just 10 steps, achieving a 200-fold speedup.
Semantic Role Labeling Guided Out-of-distribution Detection (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for identifying domain-shifted instances are prone to OOD and adversarial inputs.
Approach: They propose an unsupervised method that separates, extracts, and learns the semantic role labeling guided out-of-distribution Detection (SRLOOD) they propose a self-supervised approach to enhance global-local feature learning by predicting SRL extracted role.
Outcome: The proposed method achieves SOTA performance on four OOD benchmarks.
Generalized Category Discovery with Large Language Models in the Loop (2024.findings-acl)

Copied to clipboard

Challenge: Generalized Category Discovery (GCD) is a crucial task that aims to recognize both known and novel categories from a set of unlabeled data.
Approach: They propose a framework that introduces Large Language Models into the training loop to generate category names without human effort.
Outcome: The proposed framework outperforms SOTA models on three benchmark datasets and generates accurate category names for the discovered clusters.
DebugBench: Evaluating Debugging Capability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional coding capabilities, but their debugging capabilities remain relatively unexplored.
Approach: They propose a debugging benchmark consisting of 4,253 LLMs with four major bug categories and 18 minor types in C++, Java, and Python.
Outcome: The proposed benchmark covers four major bug categories and 18 minor types in C++, Java, and Python.
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks .
Approach: They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience.
Outcome: The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning.
Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images.
Approach: They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations.
Outcome: The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images.
Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: evolving generic Large Language Models into specialized Large Reasoning Models requires effective post-training.
Approach: They propose a plasticity-ceiling framework to harness expert trajectories . they establish the Sequential SFT-then-RL pipeline as the superior standard .
Outcome: The proposed framework overcomes stability and premature convergence deficits in synchronized approaches.
MingOfficial: A Ming Official Career Dataset and a Historical Context-Aware Representation Learning Framework (2023.emnlp-main)

Copied to clipboard

Challenge: In Chinese studies, understanding the nuanced traits of historical figures can be challenging due to the need for domain expertise, specialist knowledge, and context-specific insights.
Approach: They propose a large-scale multi-modal dataset for Chinese officials from the Ming Dynasty that integrates structured and text data to enable investigation of social structures.
Outcome: The proposed dataset could enable exploratory analysis of official identities and significantly boost performance in tasks such as identifying nuance identities from 24.6% to 98.2% F1 score in hold-out test set.
Multi-level Adaptive Contrastive Learning for Knowledge Internalization in Dialogue Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue generation models struggle with dull and repetitive outputs, a problem commonly termed as text degeneration.
Approach: They propose a framework that allows the model to "cheat" the objective by duplicating knowledge segments in a superficial pattern matching based on overlap.
Outcome: The proposed framework can be applied to a WoW dataset and shows that it works across models and decoding strategies.
DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-language models lack fine-grained classification, single-view imagery, and inaccurate metadata.
Approach: They propose a hierarchical, multi-view benchmark to evaluate VLMs across three levels of cognitive complexity.
Outcome: The proposed benchmark evaluates vision-language models across three levels of complexity . it systematically identifies five primary failure modes . the proposed benchmarks are available on https://github.com/meituan/DiningBench.
CMA-R: Causal Mediation Analysis for Explaining Rumour Detection (2024.findings-eacl)

Copied to clipboard

Challenge: Existing studies on explainable fake news or rumour detection by and large use attention weights as explanation, but the use of attention weighted explanations is problematic.
Approach: They propose a causal mediation analysis approach to explain the decision-making process of neural models for rumour detection on Twitter by identifying salient tweets that explain model predictions and highlighting causally impactful words in the tweets.
Outcome: The proposed approach shows strong agreement with human judgements for critical tweets determining the truthfulness of stories.
Who Wrote This Line? Evaluating the Detection of LLM-Generated Classical Chinese Poetry (2026.acl-long)

Copied to clipboard

Challenge: a recent study shows that large language models can generate text, but they can also fabricate large amounts of false or misleading content.
Approach: They propose a benchmark to detect LLM-generated classical Chinese poetry . they compare 12 different AI detectors to find out whether a poem is authored by AI .
Outcome: The proposed benchmark compared 12 AI detectors with a dataset of 30,664 Chinese poems . the results highlight the limitations of current Chinese text detectors .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations