Papers by Zixia Jia
Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Context faithfulness is essential for reliable reasoning in context-dependent scenarios. |
| Approach: | They propose a method that identifies and fine-tunes context-faithful experts . they propose 'context-faither fine- tuning' which selectively fine- tunes them . |
| Outcome: | The proposed method identifies experts with specialization in context utilization and improves context grounding. |
SHARP: Search-Based Adversarial Attack for Structured Prediction (2022.findings-naacl)
Copied to clipboard
| Challenge: | SHARP is a new attack method for structured prediction models that solves several challenges. |
| Approach: | They propose a black-box adversarial attack method that uses a search-based optimization problem to attack adversarials. |
| Outcome: | The proposed method performs more potent attack than pioneer arts on two structured prediction tasks. |
Adaptive Preference Optimization with Uncertainty-aware Utility Anchor (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Offline preference optimization methods are efficient for large language models (LLMs) alignment. |
| Approach: | They propose an offline preference optimization framework that estimates uncertainties from preference data . the method enables training even in scenarios where the data is unpaired . |
| Outcome: | The proposed method enables training even in scenarios where the data is unpaired . |
LangSuit·E: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have shown inspiring achievements in constructing autonomous agents that rely on language descriptions as inputs. |
| Approach: | They propose a flexible and simulation-free testbed that simulates 6 representative embodied tasks in textual embodies. |
| Outcome: | The proposed testbed offers adaptability to diverse environments without multiple simulation engines and allows easy customization of communication and action strategies. |
ReflectEvo: Improving Meta Introspection of Small LLMs by Learning Self-Reflection (2025.findings-acl)
Copied to clipboard
Jiaqi Li, Xinyi Dong, Yang Liu, Zhizhuo Yang, Quansen Wang, Xiaobo Wang, Song-Chun Zhu, Zixia Jia, Zilong Zheng
| Challenge: | ReflectEvo-460k is a large-scale, comprehensive, self-generated reflection dataset with broadened instructions and diverse multi-domain tasks. |
| Approach: | They propose a pipeline that iteratively generates self-reflection for self-training and a large-scale reflection dataset with broadened instructions and diverse multi-domain tasks. |
| Outcome: | The proposed pipeline improves Llama-3 reasoning ability by up to 71.2% and Mistral by upto 44.4%. |
MMUIE: Massive Multi-Domain Universal Information Extraction for Long Documents (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing document-level information extraction systems operate at the sentence level or within narrow domains due to annotation constraints. |
| Approach: | They propose a large-scale universal dataset for multi-domain, document-level information extraction from long texts. |
| Outcome: | The proposed dataset integrates traditional knowledge bases with large language models to extract fine-grained entities, aliases, and relation triples across 34 domains. |
Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels (2024.acl-long)
Copied to clipboard
| Challenge: | Existing supervised learning methods rely on human annotations, but multi-label tasks pose challenges due to the specific domain knowledge and large class sets. |
| Approach: | They propose a framework that can be used to annotate a subset of positive classes from a multi-label dataset. |
| Outcome: | The proposed framework is generalized and effective across multiple tasks. |
Semi-Supervised Semantic Dependency Parsing Using CRF Autoencoders (2020.acl-main)
Copied to clipboard
| Challenge: | Semantic dependency parsing allows words to have multiple dependency heads, resulting in graph-structured representations. |
| Approach: | They propose an approach to semi-supervised learning of semantic dependency parsers based on the CRF autoencoder framework. |
| Outcome: | The proposed model improves over the baseline model and is arc-factored. |
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor (2021.acl-long)
Copied to clipboard
Xinyu Wang, Yong Jiang, Zhaohui Yan, Zixia Jia, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, Kewei Tu
| Challenge: | Knowledge distillation is a technique to transfer knowledge between models, typically from a large model (the teacher) to a more fine-grained one (the student). |
| Approach: | They propose a factorized form of the knowledge distillation objective for structured prediction which is tractable for many typical choices of the teacher and student models. |
| Outcome: | The proposed model is able to transfer knowledge between teacher and student models without loss of accuracy under four different scenarios. |
Varying Sentence Representations via Condition-Specified Routers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing sentences cannot account for different aspects of semantic similarity between two sentences. |
| Approach: | They propose a transformer-style framework that generates conditioned sentences . they propose 'conditional' STS, which measures similarity between two sentences based on condition sentences - a task that requires a sentence embedding model capable of generating distinct representations for the same sentence under different conditions. |
| Outcome: | The proposed framework is superior to existing models on two condition sentences . it can generate conditioned sentences while maintaining model parameters and computational efficiency . |
Modeling Instance Interactions for Joint Information Extraction with Neural High-Order Conditional Random Field (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to joint Information Extraction (IE) neglect cross-instance or cross-task dependencies. |
| Approach: | They propose a joint IE framework that formulates joint 'conditional random field' to model cross-instance interactions . they incorporate a high-order neural decoder that is unfolded from a mean-field variational inference method . |
| Outcome: | The proposed approach improves on three IE tasks compared with baseline and prior work. |
ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work on Multi-modal Named Entity Recognition (MNER) relies on image information to model interactions between image and text representations. |
| Approach: | They propose to align image features into the textual space to better utilize attention mechanisms . they use regional object tags, captions and optical characters as visual contexts . |
| Outcome: | The proposed model can achieve state-of-the-art accuracy on multi-modal Named Entity Recognition datasets even without image information. |
An Empirical Study of Pipeline vs. Joint approaches to Entity and Relation Extraction (2022.aacl-short)
Copied to clipboard
| Challenge: | Entity and Relation Extraction tasks are often compared to pipeline approaches . a recent study shows that joint approaches can produce comparable results . |
| Approach: | They propose to use two approaches to the Entity and Relation Extraction task to compare their performance. |
| Outcome: | The proposed approach outperforms the best pipeline model but improperly designed approaches may have poor performance. |
Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) is a task that aims to extract relations from a long context. |
| Approach: | They propose an automated annotation method that integrates an LLM and a natural language inference module to generate relation triples. |
| Outcome: | The proposed method can extract relations from document-level relation datasets with minimal human effort. |
Look Both Ways and No Sink: Converting LLMs into Text Encoders without Training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for converting large language models into powerful text encoders require extensive training on large datasets. |
| Approach: | They propose a training-free approach that enables bidirectional attention and suppresses the attention sink phenomenon, resulting in superior performance. |
| Outcome: | The proposed approach enables bidirectional attention and suppresses the attention sink phenomenon, resulting in superior performance. |
Reinforced Query Reasoners for Reasoning-intensive Retrieval Tasks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for retrieval of information excel at textual and semantic matching but struggle in reasoning-intensive retrieval tasks. |
| Approach: | They propose a family of small-scale language models for query reasoning and rewriting in reasoning-intensive retrieval. |
| Outcome: | The proposed model outperforms existing models on a BRIGHT benchmark with BM25 retrievers. |