Papers with prompt-sensitive
Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender? (2024.acl-short)
Copied to clipboard
| Challenge: | We study whether large language models exhibit race- and gender-based name discrimination in hiring decisions . |
| Approach: | They propose templatic prompts to LLMs to write an email to a named job applicant informing them of a hiring decision. |
| Outcome: | The proposed model generates an acceptance or rejection email based on the applicant's first name . |
Collaborative Beam Search: Enhancing LLM Reasoning via Collective Consensus (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve the reasoning capabilities of large language models (LLMs) depend on domain-specific external verifiers or self-evaluation which is brittle and prompt-sensitive. |
| Approach: | They propose a framework that harnesses the collective intelligence of multiple large language models across both generation and verification stages. |
| Outcome: | The proposed framework outperforms singlemodel scaling and multi-model ensemble baselines on six tasks by over 4 percentage points in average accuracy. |