Papers by Niladri Chatterjee
Can LLMs replace Neil deGrasse Tyson? Evaluating the Reliability of LLMs as Science Communicators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and AI assistants are experiencing exponential growth in usage among expert and amateur users. |
| Approach: | They propose to assess the reliability of current Large Language Models as science communicators . they use a dataset comprising 742 Yes/No queries embedded in complex scientific concepts . |
| Outcome: | The proposed model outperforms open-access models in scientific question-answering tasks . the model outpersforms GPT-4 Turbo models in many evaluation aspects . |