Challenge: Currently, there are two mainstream methods for improving data integrity: data filtering and data augmentation.
Approach: They propose a method to improve data integrity by combining data filtering and data augmentation with LLMs.
Outcome: The proposed method surpasses the open-source chat version on HalluQA by 8.45 on the open source version.

Similar Papers

Leveraging Web-Crawled Data for High-Quality Fine-Tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: Currently, large language models are fine-tuned using expensive human-annotated data or GPT-4 generated data.
Approach: They propose to use web-crawled data to train a language model on a smaller set of data . their results show that the model can convert web data with irregular formats into high-quality ones .
Outcome: The proposed model outperforms open-source models larger than 32B and outperformed open-sourced models such as GPT-3.5.
GSM-Noise: Exploring and Enhancing Large Language Models’ Reasoning under Noisy Inputs (2026.findings-acl)

Copied to clipboard

Challenge: Large language models struggle when dealing with complex, ill-formed, or noisy inputs . open-source models are less robust, while closed-source ones are more robust .
Approach: They propose to use GSM-Noise to refine inputs before engaging in in-depth analysis to improve LLM robustness under noisy conditions.
Outcome: The proposed model can achieve consistent performance gains under noisy conditions with prompt engineering, supervised finetuning, and reinforcement learning.
Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice? (2024.emnlp-main)

Copied to clipboard

Challenge: Traditionally, success in multilingual machine translation depends on large volume, diverse directions, and high quality of training data.
Approach: They revisit the importance of large language models for translation by fine-tuning on 32 parallel sentences.
Outcome: The proposed model can be fine-tuned on as few as 32 parallel sentences . however, the choice of direction is critical to avoid misinterpretation, the authors say .
LLM-powered Data Augmentation for Enhanced Cross-lingual Performance (2023.emnlp-main)

Copied to clipboard

Challenge: Existing training data for multilingual commonsense reasoning datasets is limited.
Approach: They propose to use large language models for data augmentation in multilingual datasets . they use Dolly-v2, StableVicuna, ChatGPT, and GPT-4 to augment three datasets.
Outcome: The proposed model outperforms larger general-purpose, zero-shot models when training in smaller models.
Reformatted Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Current methods to improve data quality are labor-intensive or prone to factual errors caused by LLM hallucinations.
Approach: They propose a method which reformats the responses of instruction data into a format that better aligns with pre-established criteria and the collated evidence.
Outcome: The proposed approach minimizes human annotation, hallucination, and the difficulty in scaling, remaining orthogonal to existing alignment techniques.
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide (2026.tacl-1)

Copied to clipboard

Challenge: Pre-trained language models provide strong foundations, but effective adaptation under data scarcity requires efficient and efficient fine-tuning techniques.
Approach: They propose to review parameter-efficient fine-tuning techniques that lower training and deployment costs and domain and cross-lingual adaptation methods for both encoder and decoder models.
Outcome: The proposed techniques lower training and deployment costs, domain and cross-lingual adaptation methods, and model specialization strategies.
Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance (2023.findings-emnlp)

Copied to clipboard

Challenge: Pretrained Language Models (PLMs) are advanced but data labels are noisy due to the complex annotation process.
Approach: They propose a framework for fine-tuning PLMs using noisy labels that incorporates guidance from Large Language Models like ChatGPT.
Outcome: Experiments on synthetic and real-world noisy datasets show that the proposed framework outperforms the state-of-the-art framework.
Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods to improve robustness require changing the fine-tuning process or large-scale data augmentation, which are infeasible or cost prohibitive for closed-source models.
Approach: They propose to prioritize more complex examples or replace existing training examples with LLM-generated data to improve performance on OOD NLI datasets.
Outcome: The proposed methods improve performance on difficult OOD datasets while training with synthetic data leads to substantial improvements on easier OOD data.
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have shown unprecedented performance across various tasks.
Approach: They propose an easy-to-use framework that integrates adapters into LLMs . they evaluate adapters on 14 datasets from two different reasoning tasks .
Outcome: The proposed framework can be used to fine-tune open-access language models with task-specific data and instruction data.
Data Quality Enhancement on the Basis of Diversity with Large Language Models for Text Classification: Uncovered, Difficult, and Noisy (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for text classification based on large language models are difficult to apply directly to solve.
Approach: They propose a data quality enhancement method to improve LLMs' performance in classification tasks by using a greedy algorithm to select data and then performing fine-tuning.
Outcome: The proposed method improves the performance of large language models in text classification tasks and significantly improves training efficiency, saving nearly half of the training time.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations