Challenge: Existing methods to mitigate label bias by leveraging in-domain data are often unavailable in real-world scenarios.
Approach: They propose a calibration method that generates synthetic in-domain data from a few in-context demonstrations and utilizes it for calibration.
Outcome: The proposed method reduces label bias by leveraging in-domain data from demonstrations.

Similar Papers

Mitigating Label Biases for In-context Learning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to categorize label biases in in-context learning (ICL) have not addressed all three types of label bias.
Approach: They propose a method that estimates a language model’s label bias using random in-domain words from the task corpus to categorize and detect label biases in ICL.
Outcome: The proposed method significantly improves the performance of GPT-J and GPT-3 on a wide range of tasks.
From Fake to Real: Mitigating Out-of-Distribution Bias in In-Context Learning via Feedback Supervision from Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: In-Context Learning (ICL) is one of the most common methods for complex Natural Language Understanding tasks.
Approach: They propose a method that uses model confidence and perturbation perplexity to enhance the quality of pseudo-labels.
Outcome: The proposed method reduces OOD biases by avoiding direct use of source data.
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs (2024.naacl-long)

Copied to clipboard

Challenge: Large language models exhibit undesirable preference toward predicting certain answers over others, despite their adaptability to diverse tasks.
Approach: They propose a label bias calibration method that outperforms recent calibration approaches for improving performance and mitigating label bias.
Outcome: The proposed method outperforms calibration approaches for improving performance and mitigating label bias.
Generative Calibration for In-context Learning (2023.findings-emnlp)

Copied to clipboard

Challenge: In-context learning is one of the most exciting features of large language models . performance is sensitive to various configurations of the prompt, such as the choice or order of the training examples.
Approach: They propose to calibrate the in-context predictive distribution by adjusting the label marginal . they find that the proposed method outperforms the ICL and state-of-the-art calibration methods .
Outcome: The proposed method outperforms state-of-the-art methods by 27% absolute in macro-F1.
Fill In The Gaps: Model Calibration and Generalization with Synthetic Data (2024.emnlp-main)

Copied to clipboard

Challenge: Existing calibration methods negatively impact model accuracy due to the lack of diversity of validation data.
Approach: They propose a calibration method that incorporates synthetic data without compromising accuracy.
Outcome: The proposed method improves model accuracy on real data and reduces calibration error by 34% on four different tasks.
Enhancing Input-Label Mapping in In-Context Learning with Contrastive Decoding (2025.acl-short)

Copied to clipboard

Challenge: Prior research has found that large language models overlook input-label mapping information in ICL, relying more on their pre-trained knowledge.
Approach: They propose a novel method that contrasts input-label mappings between positive and negative in-context examples to improve model performance.
Outcome: The proposed method improves performance on 7 natural language understanding tasks without additional training.
Addressing Bias and Hallucination in Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: This tutorial provides a comprehensive overview of two critical aspects of Large Language Models: bias and hallucination.
Approach: This tutorial provides an overview of two critical aspects of Large Language Models: bias and hallucination.
Outcome: This tutorial delves into the complex dimensions of Large Language Models (LLMs) it outlines ethical considerations pertinent to their development and discusses hallucination, a prevalent issue in generative AI systems such as LLMs.
The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection (2025.findings-naacl)

Copied to clipboard

Challenge: Recent research suggests using Large Language Models (LLMs) to automate the annotation process, reducing these costs while maintaining data quality.
Approach: They propose to use Large Language Models to automate annotation process and train classifiers on large datasets.
Outcome: The proposed model outperforms all of the annotator LLMs on two media bias benchmark datasets (BABE and BASIL) while maintaining data quality.
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions (2024.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that large language models are susceptible to societal biases due to their exposure to human-generated data.
Approach: They propose two strategies to mitigate implicit gender biases in large language models . they create scenarios where implicit gender is present and develop a metric to assess the presence of biase .
Outcome: The proposed methods mitigate implicit biases with self-reflection and fine-tuning.
Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable multilingual capabilities, making them promising tools in both high- and low-resource languages.
Approach: They use a multilingual LLM to generate synthetic datasets covering 11 languages and 4 classification tasks and use them to train smaller models.
Outcome: The proposed model outperforms the large generator in low-resource languages and tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations