Challenge: Existing methods to generate long-context instruction-tuning data are limited by poor quality and fewer than 35% of samples are multi-hop .
Approach: They propose a framework that integrates a quality verification agent, a single-hop question generation agent, and a multi-hop questions merger agent to enhance model performance.
Outcome: The proposed framework significantly improves data quality with high-quality, multi-hop, and diverse data.

Similar Papers

LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data (2025.findings-acl)

Copied to clipboard

Challenge: Long-context processing ability has emerged as a significant challenge for large language models.
Approach: They propose a pipeline for synthesizing faithful long-context reasoning instruction datasets . they integrate ground truth and citation-based reasoning prompts integrating them .
Outcome: The proposed pipeline eliminates distractions and improves reasoning chains.
The Data Frontier for Large Language Models: Selection, Synthesis, and Tools (2026.acl-tutorials)

Copied to clipboard

Challenge: acquiring and curating high-quality training data remains a significant bottleneck . acquiring such high-quality data is a key challenge for researchers and practitioners .
Approach: This tutorial provides a comprehensive and practical guide to the state-of-the-art in data research directions for LLMs.
Outcome: The tutorial covers methods for curating the most valuable information from vast, noisy datasets and the synthetic data revolution.
Making Long-Context Language Models Better Multi-Hop Reasoners (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in long-context modeling have enhanced language models for complex tasks, but they struggle with multi-hop reasoning and noisy contexts.
Approach: They propose an approach that prompts LMs to supply attributions for each assertion during reasoning.
Outcome: The proposed model achieves competitive performance on multi-hop reasoning benchmarks, closely paralleling proprietary LMs such as ChatGPT and Claude-instant.
We Are What We Repeatedly Do: Improving Long Context Instruction Following (2026.findings-eacl)

Copied to clipboard

Challenge: Large language model context lengths have increased by at least 1000 in the past seven years . however, longer contexts pose challenges to system instruction following .
Approach: They propose to formalize verifiable instructions to evaluate model compliance . they implement and evaluate six mitigation strategies to enhance instruction compliance in extended contexts.
Outcome: The proposed model performs better in long contexts than in natural language models.
Effective Long-Context Scaling of Foundation Models (2024.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are rapidly deployed and continue to evolve through scaling.
Approach: They propose a method to train strong long-context LLMs that are capable of utilizing massive context windows of up to 32,000 tokens.
Outcome: The proposed model can surpass gpt-3.5-turbo-16k's overall performance on long-context benchmarks with a cost-effective instruction tuning procedure that is free of expensive annotations.
Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai (2024.acl-srw)

Copied to clipboard

Challenge: Xue et al., 2024) have demonstrated that large language models can perform at human level across multitudes of tasks and domains.
Approach: They propose a seed-free framework for generating synthetic instruction-tuning data that incorporates fluency, diversity, and cultural context.
Outcome: The proposed framework achieves competitive performance using only 5,000 instructions compared to state-of-the-art Thai LLMs trained on hundreds of thousands of instructions.
LongAlign: A Recipe for Long Context Alignment of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies to build long context language models focus on context extension and continual training on long text.
Approach: They propose a recipe for instruction fine-tuning on input sequences of similar length . they adopt packing and sorted batching strategies to speed up supervised fine-uning .
Outcome: The proposed model outperforms existing recipes for LLMs in long context tasks by 30% while maintaining proficiency in handling short, generic tasks.
Demystifying Instruction Mixing for Fine-tuning Large Language Models (2024.acl-srw)

Copied to clipboard

Challenge: Instruction tuning is effective for aligning large language models with human instructions, but the procedure to optimizing the mixing of instruction datasets is still unclear.
Approach: They categorize instructions into three primary types: NLP downstream tasks, coding, and general chat.
Outcome: The proposed method improves performance of large language models (LLMs) but it is difficult to combine different instruction datasets to optimize overall performance.
Ensemble-Instruct: Instruction Tuning Data Generation with a Heterogeneous Mixture of LMs (2023.findings-emnlp)

Copied to clipboard

Challenge: Empirical studies with different instruction-tuned LMs show that our proposed method yields higher-quality instruction tuning data than Self-Instruct.
Approach: They propose to use in-context learning techniques to train strong conversational agents . they propose to categorize and simplify ICL templates to make prompt learning easier .
Outcome: Empirical results show that the proposed method yields higher-quality instruction tuning data than Self-Instruct and improves performance of both vanilla and instruction-tuned LMs.
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches (2024.findings-emnlp)

Copied to clipboard

Challenge: Long context capability is a crucial competency for large language models as it mitigates the human struggle to digest long-form texts.
Approach: They propose to evaluate 10+ state-of-the-art approaches for long context-capable LLMs.
Outcome: The proposed methods are compared against 10+ state-of-the-art approaches across seven categories of long context tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations