Constructing a Psychometric Testbed for Fair Natural Language Processing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Psychometric dimensions are important for understanding user behavior in various contexts including health, security, e-commerce, and finance. |
| Approach: | They propose to construct a corpus for psychometric natural language processing related to important dimensions such as trust, anxiety, numeracy, and literacy, in the health domain. |
| Outcome: | The proposed corpus includes 8,502 user-generated responses from 8,502-person survey datasets and includes self-reported demographic information, including race, sex, age, income, and education. |
Similar Papers
Assessment and manipulation of latent constructs in pre-trained language models using psychometric scales (2025.acl-long)
Copied to clipboard
Maor Reuben, Ortal Slobodin, Idan-Chaim Cohen, Aviad Elyashar, Orna Braun-Lewensohn, Odeya Cohen, Rami Puzis
| Challenge: | a recent study suggests that language models may be tricked into answering psychometric questionnaires, but they cannot be assessed because of inadequate psychometric methods. |
| Approach: | They propose to re-form standard psychological questionnaires into natural language inference prompts and a code library to support the psychometric assessment of arbitrary models. |
| Outcome: | The proposed model can be reformulated into natural language inference prompts and a code library to support the psychometric assessment of arbitrary models. |
Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Morality (2026.eacl-long)
Copied to clipboard
| Challenge: | Psychometric tests are increasingly used to assess psychological constructs in large language models (LLMs). |
| Approach: | They evaluate the reliability and validity of human psychometric tests on 17 LLMs for three constructs: sexism, racism, and morality. |
| Outcome: | The results show that the psychometric tests on 17 LLMs do not align, and in some cases negatively correlate with, model behavior in downstream tasks, indicating low ecological validity. |
On Measures of Biases and Harms in NLP (2022.findings-aacl)
Copied to clipboard
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
| Challenge: | Recent studies show that natural language processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. |
| Approach: | They propose a framework for harms and questions to help practitioners understand biases . they propose measurable measures to detect and mitigate biased groups . |
| Outcome: | The proposed framework provides a framework for harms and questions for practitioners to answer to guide the development of bias measures. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained Language Models (2022.naacl-main)
Copied to clipboard
| Challenge: | An increasing awareness of biased patterns in natural language processing resources such as BERT has motivated many metrics to quantify ‘bias’ and ‘fairness’. |
| Approach: | They combine literature survey, correlation analysis and empirical evaluations to evaluate compatibility of fairness metrics for pre-trained language models and their downstream tasks. |
| Outcome: | The proposed measures are not compatible with each other and highly depend on (i) templates, (ii) attribute and target seeds and (iv) the choice of embeddings. |
Towards a Gold Standard Corpus for Variable Detection and Linking in Social Science Publications (L18-1)
Copied to clipboard
| Challenge: | a new corpus for detecting and linking survey variables is being developed . the corpus is multilingual and includes manually curated word and phrase alignments . |
| Approach: | They propose to create a corpus for the evaluation of detecting and linking survey variables in social science publications. |
| Outcome: | The proposed corpus is the first gold standard for the variable detection and linking task. |
Preparing Data from Psychotherapy for Natural Language Processing (L18-1)
Copied to clipboard
| Challenge: | mental health care is a demanding occupation, resulting in a severe gap in patient-centered care . a recent study shows that natural language processing can extract certain aspects of human-human communication. |
| Approach: | They propose to use data from psychotherapy sessions to help improve quality of care . they use feedback and cooperation annotations to assess quality of therapy sessions . |
| Outcome: | The proposed method aims to analyse psychotherapy data and assess its quality . it aims at identifying what qualifies for good feedback or cooperation in therapy sessions . |
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing (2022.acl-long)
Copied to clipboard
| Challenge: | Using pre-trained language models, we evaluate performance group disparities while none of these techniques guarantee fairness, nor consistently mitigate group disparity. |
| Approach: | They present a benchmark suite of four datasets for evaluating the fairness of pre-trained language models and the techniques used to fine-tune them for downstream tasks. |
| Outcome: | The proposed methods show that performance group disparities are vibrant in many cases, while none of these techniques guarantee fairness, nor consistently mitigate group disparity. |
Quantifying Bias from Decoding Techniques in Natural Language Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Natural language generation (NLG) models can propagate social bias towards particular demography. |
| Approach: | They propose to examine whether bias metrics like toxicity and sentiment are impacted by decoding techniques that use stochastic decoding. |
| Outcome: | The proposed methods reveal the imperative of testing inference time bias and provide evidence on the usefulness of inspecting the entire decoding spectrum. |
Language (Technology) is Power: A Critical Survey of “Bias” in NLP (2020.acl-main)
Copied to clipboard
| Challenge: | 146 papers analyzing "bias" in NLP systems lack normative reasoning, we find . authors propose three recommendations for work analyzing “bias” in Nlp systems . |
| Approach: | They propose three recommendations for analyzing "bias" in NLP systems . they propose to focus on what kinds of system behaviors are harmful, in what ways, to whom, and why . |
| Outcome: | The proposed methods for measuring or mitigating “bias” are poorly matched to their motivations and do not engage critically with literature outside of NLP. |