Challenge: Prior work to mitigate fairness issues often employs subjective demonstration selection, leading to low controllability and limited stability across different models and tasks.
Approach: They propose to use in-context learning to insert social biases into large language models to create a structured and controllable representation of the relationship between sensitive attributes and predicted labels.
Outcome: Extensive experiments show that Fair-CCD consistently improves fairness metrics without degrading task accuracy.

Similar Papers

Strategic Demonstration Selection for Improved Fairness in LLM In-Context Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies highlight the effectiveness of using in-context learning (ICL) to steer large language models in processing tabular data.
Approach: They propose a method that uses clustering and evolutionary strategies to curate a representative sample set from training data.
Outcome: The proposed method significantly improves fairness across various metrics, showing its efficacy in real-world scenarios.
Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications (2024.naacl-long)

Copied to clipboard

Challenge: Recent studies suggest using large language models to make tabular classifications . however, LLMs have been shown to exhibit harmful social biases based on stereotypes and inequalities present in society.
Approach: They propose to use large language models to make tabular classifications . they show that LLMs inherit biases from their training data .
Outcome: The proposed models exhibit harmful biases that reflect stereotypes and inequalities in society.
Enhancing Input-Label Mapping in In-Context Learning with Contrastive Decoding (2025.acl-short)

Copied to clipboard

Challenge: Prior research has found that large language models overlook input-label mapping information in ICL, relying more on their pre-trained knowledge.
Approach: They propose a novel method that contrasts input-label mappings between positive and negative in-context examples to improve model performance.
Outcome: The proposed method improves performance on 7 natural language understanding tasks without additional training.
Fairness Evaluation and Inference Level Mitigation in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Large language models display undesirable behaviors embedded in their internal representations, undermining fairness, inconsistency drift, and the propagation of unwanted patterns during extended dialogues.
Approach: They propose a pruning-based framework that detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation.
Outcome: The proposed framework detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation.
Mitigating Label Biases for In-context Learning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to categorize label biases in in-context learning (ICL) have not addressed all three types of label bias.
Approach: They propose a method that estimates a language model’s label bias using random in-domain words from the task corpus to categorize and detect label biases in ICL.
Outcome: The proposed method significantly improves the performance of GPT-J and GPT-3 on a wide range of tasks.
Towards Universal Debiasing for Language Models-based Tabular Data Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing large language models have exacerbated fairness issues in tabular data generation . inherent historical biases in tabulated data cause LLMs to exacerbate fairness problems .
Approach: They propose a universal debiasing framework that minimizes group-level dependencies . it leverages the autoregressive structure and analytic sampling distributions of LLM-based tabular data generators .
Outcome: The proposed framework minimizes group-level dependencies while reducing mutual information between advantaged and protected attributes.
Toward Inclusive Language Models: Sparsity-Driven Calibration for Systematic and Interpretable Mitigation of Social Biases in LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: a new method to mitigate stereotypical bias in large language models is needed . inherent biases from training on vast Internet datasets can amplify harmful stereotypes .
Approach: They propose a method to identify stereotypical bias in decoder-only transformer models . they apply a localization mechanism that correlates internal activations with a new Context Influence score .
Outcome: The proposed method reduces stereotypical biases on BBQ, StereoSet, and CrowS-Pairs while improving reasoning performance on MMLU by 10%.
DeFrame: Debiasing Large Language Models Against Framing Effects (2026.findings-acl)

Copied to clipboard

Challenge: Existing debiasing methods improve overall fairness, but fail to reduce framing-induced disparities.
Approach: They propose a framing-aware debiasing method that encourages LLMs to be more consistent across frams.
Outcome: The proposed method reduces overall bias and improves robustness against framing disparities, enabling LLMs to produce fairer and more consistent responses.
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs (2024.naacl-long)

Copied to clipboard

Challenge: Large language models exhibit undesirable preference toward predicting certain answers over others, despite their adaptability to diverse tasks.
Approach: They propose a label bias calibration method that outperforms recent calibration approaches for improving performance and mitigating label bias.
Outcome: The proposed method outperforms calibration approaches for improving performance and mitigating label bias.
Contrastive Learning as a Polarizer: Mitigating Gender Bias by Fair and Biased sentences (2024.findings-naacl)

Copied to clipboard

Challenge: Recent studies have highlighted social biases inherent in training data can lead models to learn and propagate them.
Approach: They propose a contrastive learning method that uses anchor points to push further negatives and pull closer positives within the representation space.
Outcome: The proposed method achieves state-of-the-art in the ICAT score on the StereoSet, a benchmark for measuring bias in models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations