Papers by Xiaoqi Jiao
Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigm (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on individual quality and do not assess the value of training data. |
| Approach: | They propose a choice-based sample selection framework that evaluates sample quality . they use LLMs to evaluate the value of each option during the selection process . |
| Outcome: | The proposed model outperforms the full dataset and recent studies on a larger medical dataset. |
Convolutional Neural Network for Universal Sentence Embeddings (C18-1)
Copied to clipboard
| Challenge: | Recent studies show that averaging word embeddings is effective for NLP but these models represent a sentence only in terms of features of words or uni-grams. |
| Approach: | They propose a CNN-based model that uses both features of words and n-grams to encode sentences. |
| Outcome: | The proposed model performs better than existing models in transfer learning setting and exceeds state of the art in supervised learning setting by initializing the parameters with the pre-trained sentence embeddings. |
VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing question-answering benchmarks fail to evaluate SLMs’ knowledge understanding due to their inability to support end-to-end speech evaluation and account for varied input audio conditions. |
| Approach: | They propose a new question-answering benchmark that assesses SLMs’ knowledge understanding through pure speech interactions. |
| Outcome: | The proposed benchmark maintains speech format for both inputs and outputs, evaluates model robustness across diverse input audio conditions, and pioneers the assessment of complex tasks like mathematical reasoning in spoken format. |
DGLF: A Dual Graph-based Learning Framework for Multi-modal Sarcasm Detection (2024.emnlp-main)
Copied to clipboard
Zhihong Zhu, Kefan Shen, Zhaorun Chen, Yunyan Zhang, Yuyan Chen, Xiaoqi Jiao, Zhongwei Wan, Shaorong Xie, Wei Liu, Xian Wu, Yefeng Zheng
| Challenge: | Existing methods for multimodal sarcasm detection neglect high-order relationships and underestimate high-frequency messages. |
| Approach: | They propose a Dual Graph-based Learning Framework to capture inter-modal inconsistencies . they propose combining a hypergraph and a vanilla graph to achieve enhanced propagation . |
| Outcome: | The proposed model outperforms existing state-of-the-art methods on two benchmark datasets. |
Recent Advances in Speech Language Models: A Survey (2025.acl-long)
Copied to clipboard
Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, Ziqiao Meng, Guangyan Zhang, Qichao Wang, Steven Y. Guo, Irwin King
| Challenge: | Text-based Large Language Models (LLMs) are a promising solution for end-to-end speech interaction. |
| Approach: | They propose to build a framework that allows users to input text and translate it into speech . they propose to use a text-only LLM and a "textto-speech" framework to generate a response based on this transcription . |
| Outcome: | The survey offers an overview of recent approaches to building SpeechLMs . it outlines core architectural components, training methodologies, evaluation strategies and challenges . |
CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Developing long-context LLMs with robust long-text capabilities is underdeveloped due to a lack of benchmarks. |
| Approach: | They propose a Chinese benchmark for evaluating long-context LLMs with Chinese capabilities. |
| Outcome: | The proposed model is based on 6 open-source LLMs and 2 commercial ones. |
TinyBERT: Distilling BERT for Natural Language Understanding (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models are computationally expensive and difficult to efficiently execute on resource-restricted devices. |
| Approach: | They propose a Transformer distillation method that performs Transformer distillations at pre-training and task-specific learning stages. |
| Outcome: | The proposed method accelerates inference and reduces model size while maintaining accuracy. |