Papers by Xing Tian

14 papers
FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning (2024.emnlp-industry)

Copied to clipboard

Challenge: Lowrank adaptation and its variants introduce significant latency in multi-tenant settings, hindering their applications in the industry.
Approach: They propose a framework to fine-tune LoRA modules on a large-scale instruction tuning dataset.
Outcome: The proposed framework outperforms existing PEFT methods and significantly reduces inference latency.
ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) like ChatGPT are only accessible through restricted APIs, which creates barriers to new research and advancements in the field.
Approach: They propose a framework to enhance and regulate the translation abilities during chat . they reformulate translation data into the instruction-following style and introduce a "Hint" field .
Outcome: The proposed framework enhances and regulates the translation abilities during chat . it reformulates translation data into the instruction-following style and introduces a "Hint" field .
Know Your Place: Diagnosing Implicit Social Adaptation Failures in Chinese Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing studies suggest that failures of large language models in social contexts are not due to limited linguistic competence, but to inappropriate recognition.
Approach: They propose a framework that decomposes social adaptation into three orthogonal dimensions and conduct controlled comparisons across multiple Chinese LLMs under implicit and explicit conditions.
Outcome: The proposed framework decomposes social adaptation into three orthogonal dimensions and conducts controlled comparisons across multiple Chinese LLMs under implicit and explicit conditions.
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: Low-rank adaptation and its mixture-of-experts (MOE) methods are highly effective but introduce significant latency in multi-tenant settings due to the LoRA modules and MOE routers added to multiple linear modules.
Approach: They propose a low-rank adaptation variant that considers each LoRA module as an expert and employs a prompt-aware routing mechanism.
Outcome: Extensive analysis on commonsense reasoning tasks and math reasoning tasks show that MiLoRA outperforms strong PEFT baselines with comparable tunable parameter budgets.
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed .
Approach: They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities.
Outcome: The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech .
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates.
Approach: They propose a ranking-oriented induction model to learn personalized mapping function for each word.
Outcome: The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages.
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Low-rank adaptation (LoRA) has demonstrated commendable performance as a popular method . however, it is implemented with a fixed intrinsic rank that might not be ideal for downstream tasks.
Approach: They propose a method that estimates the importance score of each LoRA rank and prunes abundant LoRA ranks to improve performance.
Outcome: The proposed method outperforms baselines on a variety of tasks with comparable parameters.
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate (2024.emnlp-main)

Copied to clipboard

Challenge: Modern large language models (LLMs) have shown remarkable performance on general language tasks but struggle on complex reasoning tasks.
Approach: They propose a multi-agent debate framework that encourages divergent thinking in LLMs . they propose to break debate and use a judge to obtain a final solution .
Outcome: The proposed framework encourages divergent thinking in large language models . it is able to generate novel thoughts even if initial stance is incorrect .
LongTableBench: Benchmarking Long-Context Table Reasoning across Real-World Formats and Domains (2025.findings-emnlp)

Copied to clipboard

Challenge: Evaluating 52 LLMs reveals that only the strongest models maintain robust performance under increasing context lengths and format diversity.
Approach: They propose a benchmark for evaluating long-context reasoning over semi-structured tables across diverse formats, tasks, and domains.
Outcome: The proposed model outperforms compression-based approaches on tasks requiring semantic integration.
A Generic Method for Fine-grained Category Discovery in Natural Language Texts (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-grained category discovery neglect semantic similarities of fine-grain categories.
Approach: They propose a method that detects fine-grained clusters of semantically similar texts guided by a novel objective function.
Outcome: The proposed method surpasses state-of-the-art methods on three benchmark tasks.
Addressing Entity Translation Problem via Translation Difficulty and Context Diversity (2024.findings-acl)

Copied to clipboard

Challenge: Neural machine translation systems often produce inadequate translations for named entities.
Approach: They propose a data augmentation strategy to enhance the accuracy of named entity translation by retraining the target named entity pair.
Outcome: The proposed method improves translation accuracy across test sets and terminology tests.
EvoMemKG: An Evolvable Memory Agent for Multi-hop Knowledge Graph Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs with large language models lack continuous learning capabilities.
Approach: They propose an agent framework with a dynamic, evolvable memory mechanism specifically designed for KG reasoning.
Outcome: EvoMemKG achieves state-of-the-art performance without training or tools . it achieves improvements of up to 20% over baseline on multi-hop queries .
Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for cross-lingual chain-of-thought (XCoT) with self-consistency are costly due to extensive sampling of full trajectories across languages.
Approach: They propose a cross-lingual chain-of-thought framework that minimizes redundancy in token usage and latency.
Outcome: Experiments on polymath show that UL-XCoT reduces decoding token costs and latency by 50% . UL XCot also aggregates remaining high-quality reasoning paths via voting .
SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench .
Approach: They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool .
Outcome: The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations