Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration

Challenge:	Existing approaches to synthesis of relational/structured tabular data lack effective feedback mechanism to optimize quality of generated data.
Approach:	They propose a relational data generator with dynamic guidance framework that uses chain-of-thought steps to generate tabular data for enhancing downstream imbalanced classification performance.
Outcome:	The proposed framework outperforms existing approaches in both data fidelity and downstream imbalanced classification performance on real and synthetic datasets.

Similar Papers

Overview

Challenge

Approach

Outcome

Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement (2025.acl-long)

Copied to clipboard

Maosongcao Maosongcao, Taolin Zhang, Mo Li, Chuyu Zhang, Yunxin Liu, Conghui He, Haodong Duan, Songyang Zhang, Kai Chen

Semantic Text Processing

Challenge:	Existing high-quality human-annotated SFT data is a bottleneck for Large Language Models (LLMs).
Approach:	They propose a two-stage synthetic data generation framework that incorporates World Knowledge Trees and Self-Reflection Refinement to produce high-quality SFT data at scale.
Outcome:	The proposed model fine-tuned on 20K condor-generated samples achieves superior performance compared to instruct model trained with RLHF.

SAGE: Sparse Adaptive Guidance for Dependency-Aware Tabular Data Generation (2026.acl-long)

Copied to clipboard

Shuo Yang, Zheyu Zhang, Bardh Prenkaj, Gjergji Kasneci

Multimodality

Challenge:	Recent approaches to generate tabular data are limited by their static dependences and lack of fidelity.
Approach:	They propose a novel LLM-based generation framework that enforces sparse and dynamic dependency guidance.
Outcome:	The proposed framework boosts F1 scores by 10% and reduces policy violations by one point.

TableDreamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning (2025.findings-acl)

Copied to clipboard

Mingyu Zheng, Zhifan Feng, Jia Wang, Lanrui Wang, Zheng Lin, Hao Yang, Weiping Wang

Multimodality

Challenge:	Existing methods for table instruction tuning are limited due to limited data diversity and lack of data quality.
Approach:	They propose a weakness-guided data synthesis framework for table instruction tuning that explores the vast input space of table understanding tasks and then iterates through the input space.
Outcome:	The proposed framework boosts the average accuracy of Llama3.1-8B-instruct by 11.62% with 27K GPT-4o synthetic data and outperforms state-of-the-art data synthesis baselines which use more training data.

AFT-Tab: Adversarial Fine-Tuning for Tabular Data Synthesis with Long Text Columns (2026.acl-long)

Copied to clipboard

Yuhao Zhang, Liang Yan, Shaoming Duan, Xinyu Zha, Jinhang Su, Peiyi Han, Chuanyi Liu

Multimodality

Challenge:	Existing tabular data synthesis methods fail to account for cross-modal heterogeneity of real-world tables, where structured continuous and discrete attributes coexist with unstructured long-text columns.
Approach:	They propose a framework that synergistically trains an LLM-based text generator and a deep-learning-based non-textual generator to quantify cross-modal semantic alignment.
Outcome:	The proposed framework outperforms state-of-the-art frameworks in fidelity, diversity, and task utility.

Reverse Constitutional AI: A Framework for Controllable Toxic Data Generation via Probability-Clamped RLAIF (2026.findings-acl)

Copied to clipboard

Yuan Fang, Yiming Luo, Aimin Zhou, Fei Tan

Robustness in NLP

Challenge:	Existing approaches to red teaming focus on searching for individual adversarial inputs.
Approach:	They propose a framework for automated adversarial data generation that inverts harmless constitution into constitution of toxicity and iteratively refining model outputs through critique–revision pipeline.
Outcome:	The proposed framework generates diverse, high-quality toxic data without human annotation and significantly improves semantic coherence without sacrificing adversarial strength.

TABGEN-ICL: Residual-Aware In-Context Example Selection for Tabular Data Generation (2025.findings-acl)

Copied to clipboard

Liancheng Fang, Aiwei Liu, Hengrui Zhang, Henry Peng Zou, Weizhi Zhang, Philip S. Yu

Multimodality

Challenge:	Existing approaches to tabular data generation require fine-tuning, which is computationally expensive.
Approach:	They propose a new in-context learning framework to prompt a fixed LLM with in-constitut examples to enhance the in-text learning ability of LLMs for tabular data generation.
Outcome:	The proposed framework outperforms random selection strategies on five real-world tabular datasets and reduces error rate by 42.2% on fidelity metric.

Quality Assessment of Tabular Data using Large Language Models and Code Generation (2025.emnlp-industry)

Copied to clipboard

Ashlesha Akella, Akshar Kaul, Krishnasuri Narayanam, Sameep Mehta

Multimodality

Challenge:	Data quality is vital for business decisions; poor data quality costs organizations an average of $12.9 million annually.
Approach:	They propose a framework that combines statistical inliner detection with LLM-driven rule and code generation.
Outcome:	The proposed framework produces semantically valid quality rules and validates them with retrieval-augmented generation (RAG) Extensive evaluations on benchmark datasets confirm the effectiveness of the proposed framework.

ToolFlow: Boosting LLM Tool-Calling Through Natural and Coherent Dialogue Synthesis (2025.naacl-long)

Copied to clipboard

Zezhong Wang, Xingshan Zeng, Weiwen Liu, Liangyou Li, Yasheng Wang, Lifeng Shang, Xin Jiang, Qun Liu, Kam-Fai Wong

Dialogue Systems & Conversational Agents

Challenge:	Large Language Models (LLMs) can be enhanced by using supervised fine-tuning . however, access to fine-timing data can be limited.
Approach:	They propose a Graph-based Sampling strategy and a Planned-generation strategy to enhance the coherence between dialogues by using 8,000 synthetic dialogues.
Outcome:	The proposed model achieves tool-calling performance comparable to or surpassing GPT-4 while maintaining strong general capabilities.

DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models (2025.findings-acl)

Copied to clipboard

Ying Zhou, Xinyao Wang, Yulei Niu, Yaojie Shen, Lexin Tang, Fan Chen, Ben He, Le Sun, Longyin Wen

Language Models

Challenge:	Recent advances in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis.
Approach:	They propose a controllable data synthesis framework based on variational autoencoder which leverages diffusion models to reserve more information of original distribution and format structure in the learned latent distribution.
Outcome:	The proposed framework generates high-quality data with performance exceeding that of real data by 2%–7% on seven real-world datasets.

Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)

Copied to clipboard

Jiaxi Yang, Binyuan Hui, Min Yang, Jian Yang, Junyang Lin, Chang Zhou

Programming Languages in NLP

Challenge:	a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs.
Approach:	They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model .
Outcome:	The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning.