Papers by Mojtaba Kolahdouzi
Quantifying Metric and Model Agreement in Bias Evaluation of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | a systematic way to measure agreement across bias metrics and models is lacking . a lack of agreement between metrics and model results may be a problem . |
| Approach: | They introduce Metric Agreement Score and Model Agreement Score to measure agreement across bias metrics and models. |
| Outcome: | The proposed measures show that metrics within the same category behave independently of each other. |