Challenge: Existing studies focus on dummy tokens but fail to leverage the inherent sentence-level structure of natural language.
Approach: They propose a method that inserts delimiters at sentence boundaries to enhance large language models' capabilities.
Outcome: The proposed method improves performance on 7B LLMs to 600B Deepseek-V3 with 7.7% gains on GSM8k and 12.5% on DROP.

Similar Papers

From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) follow instructions with elaborate requirements, yet it remains under-explored how to enhance their ability to follow complex instructions with multiple constraints.
Approach: They propose a method to obtain and utilize effective training data to enhance LLMs' ability to follow complex instructions with multiple constraints.
Outcome: The proposed framework improves models' ability to follow instructions generally and generalize effectively across out-of-domain, in domain, and adversarial settings while maintaining general capabilities.
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)

Copied to clipboard

Challenge: Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting.
Approach: They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content.
Outcome: The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning.
The Inner Monologue of Language Models: When Reasoning Traces Reveal More Than They Hide (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have enabled them to tackle complex tasks . a fundamental question is: are these models aware of what they "learn" and "think"?
Approach: They define three core competencies: awareness of learned latent policies, generalization of these policies across domains, alignment between internal reasoning traces and final outputs.
Outcome: The results show that RL-trained models exhibit stronger generalizability to novel tasks than SFT models but weak alignment between reasoning traces and final outputs.
Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit impressive performance across diverse tasks but struggle to accurately gauge their knowledge boundaries.
Approach: They propose Consistency-based Confidence Calibration (C3) which assesses confidence consistency through question reformulation to improve LLMs’ ability to recognize their knowledge gaps.
Outcome: The proposed method improves the unknown perception rate by 5.6% on NQ and 4.9% on HotpotQA.
Language Models Struggle to Use Representations Learned In-Context (2026.acl-long)

Copied to clipboard

Challenge: a recent study shows that large language models are capable of inducing rich representations of data that are seen in-context . a novel task, adaptive world modeling, shows that even the most performant LLMs cannot reliably leverage novel semantics defined in-constitut.
Approach: They propose to use in-context representations to induce rich representations of data . they also propose to probe models using a novel task to enable flexible deployment .
Outcome: The proposed model can use in-context representations to complete simple downstream tasks.
Enhancing LLM Capabilities Beyond Scaling Up (2024.emnlp-tutorials)

Copied to clipboard

Challenge: general-purpose large language models (LLMs) are expanding in scale and access to unpublic training data.
Approach: This tutorial aims to examine the capabilities of general-purpose large language models . authors discuss adaptation of LLMs to address conflicts, defense against attacks .
Outcome: This tutorial aims to examine the evolution of general-purpose large language models (LLMs) the authors argue that the evolution is dependent on the availability of training data and the scale of the models.
Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have focused on prompt engineering to extract sentence embeddings from large language models (LLMs) but these models are mostly decoder-only and the earlier tokens in the sentence cannot attend to the latter, resulting in biased encoding of sentence information and cascading effects on the final decoded token.
Approach: They propose a plug-and-play and training-free technique that prepends each layer’s decoded sentence embedding to the beginning of the sentence in the next layer’ s input.
Outcome: The proposed technique can significantly improve the performance of existing prompt-based sentence embedding methods across different LLMs while incurring negligible additional inference cost.
Scaling Sentence Embeddings with Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Current methods based on contrastive learning have generated high-quality sentence embeddings.
Approach: They propose a method to enhance LLM performance on sentence embeddings with a one-word limitation.
Outcome: The proposed method outperforms contrastive learning methods on sentence embeddings without fine-tuning and with fine-untun.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have explored compression and accumulation methods to compress contexts, but these methods lose useful context information during the compression process, leading to performance degradation.
Approach: They propose a method that allows LLMs to take a deep breath and insert a special token at the end of each chunk.
Outcome: Experiments on language modeling and out-of-domain tasks validate the superiority of the proposed method.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations