Papers with FRoG
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to enhance reasoning do not consistently improve performance in tasks involving fuzzy logic. |
| Approach: | They propose a benchmark for fuzzy reasoning that incorporates generalized quantifiers. |
| Outcome: | The proposed benchmark shows that existing methods do not improve on FRoG . strong mathematical reasoning skills are not indicative of success, the authors show . |