Papers by Jin Xiao

43 papers
Learning What to Share: Leaky Multi-Task Network for Text Classification (C18-1)

Copied to clipboard

Challenge: Existing approaches to multi-task learning suffer from the interference between tasks because they lack selection mechanism for feature sharing.
Approach: They propose a multi-task convolutional neural network with the Leaky Unit which has memory and forgetting mechanism to filter the feature flows between tasks.
Outcome: The proposed model can filter feature flows between tasks and improve performance on five datasets.
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data (2024.emnlp-industry)

Copied to clipboard

Challenge: Large language models exhibit significant performance discrepancies between high- and low-resource languages.
Approach: They present an open-source multilingual LLM with 8 billion parameters and a multilingual instruction dataset.
Outcome: The proposed model achieves consistent multilingual representations across languages.
Federated Document-Level Biomedical Relation Extraction with Localized Context Contrast (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on relation extraction focus on document-level training without sharing raw medical texts.
Approach: They propose a federated framework for relation extraction that enables collaborative training without sharing raw medical texts.
Outcome: The proposed framework extends document-level relation extraction to a federated environment.
TrInk: Ink Generation with Transformer Network (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for handwriting generation capture global dependencies and can generate high-quality handwritten samples.
Approach: They propose a Transformer-based model for ink generation, TrInk, which captures global dependencies.
Outcome: The proposed model reduces character error rate and word error rate by 35.56% on the IAM-OnDB dataset compared to previous models.
Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach: They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome: The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.
HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical Applications (2021.findings-acl)

Copied to clipboard

Challenge: Relation extraction (RE) is an essential topic in natural language processing and has attracted extensive attention.
Approach: They propose a case-oriented construction framework to build a hard case relation extraction dataset with 65,225 relational facts annotated from 9,231 documents.
Outcome: The proposed model achieves a high 96% F1 score on data quality and is far lower than humans.
MCapsNet: Capsule Network for Text with Multi-Task Learning (D18-1)

Copied to clipboard

Challenge: Multi-task learning has been frustrated by the interference among tasks.
Approach: They propose a capsule-based multi-task learning architecture which is unified, simple and effective.
Outcome: The proposed model can cluster features for each task in the network, which helps reduce the interference among tasks.
A Survey on Efficient Large Language Model Training: From Data-centric Perspectives (2025.acl-long)

Copied to clipboard

Challenge: achieving data-efficient post-training of Large Language Models is a key research question.
Approach: They propose a taxonomy of data-efficient LLM post-training methods from a data-centric perspective.
Outcome: The proposed methods cover data selection, data quality enhancement, synthetic data generation, data distillation and compression, and self-evolving data ecosystems.
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored.
Approach: They propose a survey structured around the pipeline to identify and improve MI models.
Outcome: The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency.
MccSTN: Multi-Scale Contrast and Fine-Grained Feature Fusion Networks for Subject-driven Style Transfer (2024.lrec-main)

Copied to clipboard

Challenge: Stylistic style transfer is an important part of the image processing field . due to the low semantic similarity between the original image and the style image, many fine-grained style features are discarded.
Approach: They propose a new style representation and transfer framework that can be adapted to existing image style transfers.
Outcome: The proposed framework can be adapted to existing image style transfers.
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions.
Approach: They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification.
Outcome: The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% .
A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for named entity recognition (NER) are based on large-scale labeled datasets, which always obtain using crowdsourcing.
Approach: They propose a CONfidence-based partial Label Learning method to integrate prior and posterior confidences for crowd-annotated named entity recognition models.
Outcome: The proposed model improves on real-world and synthetic datasets compared with baselines.
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation.
Approach: a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 .
Outcome: a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 .
InsLogicBench: An Argumentation Logic Grounded Benchmark for Complex Insurance Claims Adjudication (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for insurance claims adjudication are limited to information retrieval or simple multiple-choice setups.
Approach: They propose a benchmark that provides complete reasoning traces linking factual inputs, relevant policy clauses, and final verdicts.
Outcome: The proposed benchmark shows that models often produce correct decisions but fail to provide precise justifications, highlighting a critical discrepancy between decision accuracy and logical reasoning capabilities.
M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought (2024.acl-long)

Copied to clipboard

Challenge: MCoT requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning.
Approach: They propose a benchmark to address the challenges of MCoT, and evaluate it using vision large language models.
Outcome: The proposed benchmark addresses the above challenges and shows that current models still struggle to reason in M3CoT.
Joint Semantic and Strategy Matching for Persuasive Dialogue (2023.findings-emnlp)

Copied to clipboard

Challenge: Persuasive dialogue models rely on utterance semantic matching and a key aspect has been ignored . compared with utterrance semantics, conversation strategies are high-level concepts, which can be informative and provide complementary information to achieve effective persuation.
Approach: They propose to model conversation semantics and strategies to match them using a BERT-like module and an auto-regressive predictor.
Outcome: The proposed model improves state-of-the-art by 5% on a small and 37% on 'large' datasets.
End-to-End Conversational Search for Online Shopping with Utterance Transfer (2021.emnlp-main)

Copied to clipboard

Challenge: a new study proposes a conversational search system that integrates product attributes and dialog with search . but it faces two real world challenges: imperfect product schema/knowledge and lack of training dialog data .
Approach: They propose an end-to-end conversational search system that integrates search with text . they propose an utterance transfer approach that generates dialogue utterations from other domains .
Outcome: The proposed system outperforms the best tested baseline in a conversational search dataset for online shopping.
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport (2023.acl-long)

Copied to clipboard

Challenge: Open Information Extraction (OIE) aims to extract structured information from text without the limitations of close ontology.
Approach: They propose a method to assign ground truth labels to parallelly generated tuple proposals . they leverage intersection-over-union (IoU) as assignment quality measurement .
Outcome: The proposed method outperforms the state-of-the-art models on three benchmarks.
Improving Continual Relation Extraction through Prototypical Contrastive Learning (2022.coling-1)

Copied to clipboard

Challenge: Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks.
Approach: They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE.
Outcome: The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance.
Video Dialog via Progressive Inference and Cross-Transformer (D19-1)

Copied to clipboard

Challenge: Existing visual dialog methods use RNN to encode the dialog history as a vector representation . a new method for video dialog is proposed, which progressively updates query information based on dialog history and video content until the agent think the information is sufficient and unambiguous.
Approach: They propose a method which progressively updates query information based on dialog history and video content until the agent thinks it is sufficient and unambiguous.
Outcome: The proposed method can be used to infer video dialog answers on large-scale datasets.
Privacy Risks of Intermediate Representations: Attribute Inference in Distributed LLM Inference (2026.findings-acl)

Copied to clipboard

Challenge: Distributed LLMs avoid raw inputs by transmitting intermediate hidden states, a practice widely assumed to preserve privacy.
Approach: They propose a distributed inference framework that transmits intermediate hidden states to avoid sending raw inputs by exposing sensitive user attributes.
Outcome: The proposed approach achieves Top-1 accuracy of 0.997 on CMS, 0.980 on Skytrax, and 0.986 on ECHR.
Modeling Content Importance for Summarization with Pre-trained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies on content importance do not consider semantics and context when evaluating importance.
Approach: They apply information theory to pre-trained language models to define the concept of importance from the perspective of information amount.
Outcome: Experiments on CNN/Daily Mail and New York Times show that the proposed model can model the importance of content better than previous methods based on F1 and ROUGE scores.
Exploring Logically Dependent Multi-task Learning with Causal Inference (2020.emnlp-main)

Copied to clipboard

Challenge: Hierarchical multi-task learning models can utilize task dependencies by stacking encoders and outperform democratic ones.
Approach: They propose a model that utilizes the labels of all lower-level tasks and a Gumbel sampling model to deal with cascading errors.
Outcome: The proposed model outperforms democratic models on six out of seven subtasks and achieves state-of-the-art on the two English and one Chinese datasets.
Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluation methods are inadequate to evaluate large language models (LLMs).
Approach: They propose a fine-grained generative LLM evaluator with instance-level customazable evaluation criteria that can be used to evaluate large language models.
Outcome: The proposed model outperforms existing LLM evaluators and instruction-tuned LLMs on multiple benchmarks and sets new SOTA results.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)

Copied to clipboard

Challenge: LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints.
Approach: They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks.
Outcome: The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration.
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)

Copied to clipboard

Challenge: Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B.
Approach: They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation.
Outcome: The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model.
A Semantically Consistent and Syntactically Variational Encoder-Decoder Framework for Paraphrase Generation (2020.coling-main)

Copied to clipboard

Challenge: Paraphrase generation is a longstanding problem in natural language processing (NLP) Neural network-based methods have shown great progress on paraphrase generation.
Approach: They propose a framework that integrates variational inference on a target-related latent variable to introduce the diversity.
Outcome: The proposed framework outperforms baseline models on the metrics based on n-gram matching and semantic similarity, and it can generate multiple different paraphrases by assembling different syntactic variables.
Saber: Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model in Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Diffusion language models (DLMs) offer advantages in parallel generation and bidirectional context modeling, but they face a critical trade-off between inference speed and output quality for tasks with strict structural constraints such as code generation.
Approach: They propose an efficient sampling algorithm that reduces the number of tokens unmasked per step based on the model’s evolving confidence.
Outcome: The proposed method improves Pass@1 accuracy by 1.9% while achieving 251.4% inference speedup.
Multi-Task Label Embedding for Text Classification (D18-1)

Copied to clipboard

Challenge: Existing work treats labels of each task as independent and meaningless one-hot vectors, which cause a loss of potential label information.
Approach: They propose to combine multi-task learning with semantic vectors to convert labels into vectors . their results are based on extensive experiments on five benchmark datasets based in chinese .
Outcome: The proposed model can improve performance on five benchmark datasets on text classification tasks.
AgentReview: Exploring Peer Review Dynamics with LLM Agents (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods of peer review analysis do not address multivariate nature of the process, account for latent variables, and are constrained by privacy concerns due to the sensitive nature of data.
Approach: They propose a large language model based peer review simulation framework which effectively disentangles the impacts of multiple latent factors and addresses the privacy issue.
Outcome: The proposed framework disentangles the impacts of multiple latent factors and addresses privacy concerns.
Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies have focused on diagnosing LMs' reasoning abilities in natural language understanding tasks.
Approach: They propose a diagnostic method for first-order logic reasoning with a proposed benchmark, LogicNLI.
Outcome: The proposed method disentangles the target FOL reasoning from commonsense inference and can be used to diagnose LMs from four perspectives: accuracy, robustness, generalization, and interpretability.
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models.
Approach: This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy .
Outcome: The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications.
FashionKLIP: Enhancing E-Commerce Image-Text Retrieval with Fashion Multi-Modal Conceptual Knowledge Graph (2023.acl-industry)

Copied to clipboard

Challenge: Recent advances in visual-language pre-trained (VLP) models have greatly improved cross-modal retrieval performance . however, the fine-grained interactions between objects from different modalities are far from well-established . e-commerce domain lacks sufficient training data and fine-granular cross-modulal knowledge .
Approach: They propose a visual-language pre-trained (VLP) image-text retrieval model that integrates cross-modal knowledge into the model to improve performance.
Outcome: The proposed model improves performance on e-commerce image-text retrieval task by a large margin.
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge.
Approach: They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy.
Outcome: The proposed model protects private data while enhancing the model's knowledge.
Capturing Conversational Interaction for Question Answering via Global History Reasoning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing studies have studied history-dependent reasoning for question answering . utilizing global conversation history for enhancement is gaining interest .
Approach: They propose to establish long-distance dependency among global utterances in multi-turn conversation.
Outcome: The proposed method improves on QuAC by 1%, yielding the F1 score of 73.7%.
Dynamic Low-rank Estimation for Transformer-based Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: RankDyna is a matrix decomposition method that can be used to compress Transformer-based language models.
Approach: They propose a matrix decomposition method that enables dynamic rank resource allocation . they say it can outperform current SOTA methods under various parameter budget levels .
Outcome: The proposed method outperforms current SOTA methods under various budget levels . the proposed method is more efficient with higher compression rates .
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora (2022.naacl-main)

Copied to clipboard

Challenge: Pretrained language models are typically learned over a large, static corpus and fine-tuned for various downstream tasks.
Approach: They propose to continuously update a pretrained language model to adapt to emerging data and to keep track of the model's performance.
Outcome: The proposed model can adapt to new corpora while retaining knowledge in earlier domains.
What Makes an Ideal Quote? Recommending “Unexpected yet Rational” Quotations via Novelty (2026.acl-long)

Copied to clipboard

Challenge: Prior systems focus on topical relevance and overlook what makes quotes memorable.
Approach: They propose a system that maps quotations and contexts into deep-meaning labels for label-enhanced retrieval.
Outcome: The proposed system can recommend quotations that are contextually novel while semantically coherent.
LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) enhances the reasoning capabilities of Large Language Models (LLMs) however, traditional RAG attacks are difficult to pose an effective threat to GraphRAg systems.
Approach: They propose a novel attack framework that targets logical reasoning rather than injecting false contents into GraphRAG systems by grounding their responses in structured knowledge graphs.
Outcome: The proposed framework outperforms state-of-the-art attacks on GraphRAG systems in both effectiveness and stealth.
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)

Copied to clipboard

Challenge: Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice.
Approach: They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation.
Outcome: The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts.
Dynamics of Cognitive Heterogeneity: Investigating Behavioral Biases in Multi-Stage Supply Chains with LLM-Based Simulation (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) allow repeatable experiments in which individual characteristics can be precisely defined.
Approach: They propose a scalable experimental paradigm using Large Language Models to simulate multi-stage supply chain dynamics.
Outcome: The proposed model systematically replicates and validates the results of a behavioral simulation on agents in multi-stage supply chain dynamics.
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization (2023.acl-long)

Copied to clipboard

Challenge: Existing adversarial training methods require multi-step gradient ascents or word substitutions to obtain adversarials, which impairs the effectiveness of adversariarial training.
Approach: They propose a procedure for instead adversarial training with only clean data that estimates the adversarials loss by perturbing the input data’s probability distribution rather than their embeddings.
Outcome: The proposed procedure reduces time consumption by up to 70% compared to current best-performing adversarial training methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations