Papers by Xiaomo Liu
“What is the value of templates?” Rethinking Document Information Extraction Datasets for LLMs (2024.findings-emnlp)
Copied to clipboard
Ran Zmigrod, Pranav Shetty, Mathieu Sibue, Zhiqiang Ma, Armineh Nourbakhsh, Xiaomo Liu, Manuela Veloso
| Challenge: | Existing work on prompt-response datasets for visually rich document understanding (VRDU) is labor-intensive. |
| Approach: | They propose a set of questions that are transformed from a key information extraction template to a prompt-response format using a plethora of bespoke templates. |
| Outcome: | The proposed datasets are compared with baseline models on K2Q with zero-shot prompting. |
DocLLM: A Layout-Aware Generative Language Model for Multimodal Document Understanding (2024.acl-long)
Copied to clipboard
Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, Xiaomo Liu
| Challenge: | Documents with rich layouts are a significant portion of enterprise corpora and document AI is still a challenge. |
| Approach: | They propose a lightweight extension to traditional large language models for reasoning over visual documents that takes into account both textual semantics and spatial layout. |
| Outcome: | The proposed model outperforms existing large language models on 14 out of 16 datasets and generalizes well to 4 out of 5 previously unseen datasets. |
ExStrucTiny: A Benchmark for Schema-Variable Structured Information Extraction from Document Images (2026.eacl-long)
Copied to clipboard
Mathieu Sibue, Andrés Muñoz Garza, Samuel Mensah, Pranav Shetty, Zhiqiang Ma, Xiaomo Liu, Manuela Veloso
| Challenge: | Existing models for structured information extraction are limited by narrow entity ontologies, simple queries, or homogeneous document types. |
| Approach: | They propose a benchmark dataset for structured Information Extraction (IE) from document images . they analyze open and closed VLMs on this benchmark . |
| Outcome: | The proposed model can perform fine-grained structured extraction across document types and schemas. |
Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Tasks (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent large language models such as ChatGPT and GPT-4 have shown exceptional capabilities of generalist models . however, their applicability and effectiveness in specific domains like finance needs a better understanding . |
| Approach: | They conduct empirical studies to compare the performance of ChatGPT and GPT-4 on financial text analytical problems using eight benchmark datasets from five categories of tasks. |
| Outcome: | The proposed models outperform the state-of-the-art models on a wide range of financial text analytical tasks. |
Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Language models can memorize detailed information and patterns, but raise privacy concerns . ANADP reduces the performance gap between regular and DP fine-tuning while maintaining the privacy constraints. |
| Approach: | They propose an algorithm that allocates additive noise based on the importance of model parameters to reduce the performance gap between regular fine-tuning and traditional DP fine- tuning. |
| Outcome: | The proposed algorithm narrows the performance gap between regular fine-tuning and traditional DP fine- tuning while maintaining privacy constraints. |
CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generation (2025.acl-long)
Copied to clipboard
Santosh T.y.s.s, Youssef Tarek Elkhayat, Oana Ichim, Pranav Shetty, Dongsheng Wang, Zhiqiang Ma, Armineh Nourbakhsh, Xiaomo Liu
| Challenge: | LLMs can provide key benefits to the Legal domain, but their adoption has been hindered by their tendency to generate unfaithful, ungrounded, or hallucinatory outputs. |
| Approach: | They propose a Confidence-guided copy-based decoding strategy that dynamically interpolates the model produced vocabulary distribution with a distribution derived based on copying from the context. |
| Outcome: | The proposed method outperforms existing context-aware decoding methods on five legal benchmarks. |
Distill and Align Decomposition for Enhanced Claim Verification (2026.findings-eacl)
Copied to clipboard
Jabez Magomere, Elena Kochkina, Samuel Mensah, Simerjot Kaur, Fernando Acero, Arturo Oncevay, Charese Smiley, Xiaomo Liu, Manuela Veloso
| Challenge: | Existing methods for complex claim verification struggle to align decomposition quality with verification performance. |
| Approach: | They propose a reinforcement learning approach that optimizes decomposition quality and verifier alignment using Group Relative Policy Optimization. |
| Outcome: | The proposed method outperforms prompt-based approaches and existing methods in six evaluation settings. |
The State of the Art of Large Language Models on Chartered Financial Analyst Exams (2024.emnlp-industry)
Copied to clipboard
Mahmoud Mahfouz, Ethan Callanan, Mathieu Sibue, Antony Papadimitriou, Zhiqiang Ma, Xiaomo Liu, Xiaodan Zhu
| Challenge: | Chartered Financial Analyst (CFA) program is widely recognized globally . study compares state-of-the-art large language models with open-source models . proprietary models pass levels I and II, but fail at level III due to essay questions . |
| Approach: | They benchmark five leading proprietary models and eight open-source models on mock CFA exams to provide an overview of their financial analysis capabilities. |
| Outcome: | The models on the mock CFA exams pass the highest scores, but fail at the lowest levels due to essay questions. |
The Impact of Domain-Specific Terminology on Machine Translation for Finance in European Languages (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing datasets for evaluating MT systems in this domain are limited. |
| Approach: | They propose to use a multi-parallel corpus from the European Central Bank to analyze the impact of domain-specific terminology on multilingual machine translation for finance. |
| Outcome: | The proposed method compares open-source multilingual MT systems with large language models (LLMs) that possess multilingual capabilities. |
Detecting Non-Membership in LLM Training Data via Rank Correlations (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are trained on increasingly vast and opaque text corpora. |
| Approach: | They propose a test that detects dataset-level non-membership using only grey-box access to model logits. |
| Outcome: | The proposed test detects dataset-level non-membership using only grey-box access to model logits. |