Papers by Marc-Lluís Vives
Large Language Models are biased to overestimate profoundness (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have been suggested to approach AI . however, it is still unclear whether LLMs possess similar reasoning abilities to humans . |
| Approach: | They evaluate GPT-4 and other LLMs in judging the profoundness of mundane statements . they find a significant correlation between the LLM and humans . |
| Outcome: | The proposed model overestimates the profoundness of nonsensical statements . the model overstates the profound nature of non-senior statements, the study finds . |