| Challenge: | This tutorial bridges psychology and NLP to clarify cognitive effects and biases in large language models. |
| Approach: | This tutorial bridges psychology and NLP to clarify cognitive effects and biases in large language models. |
| Outcome: | This tutorial bridges psychology and NLP to clarify cognitive effects and biases in large language models. |
Similar Papers
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | NAACL 2021 tutorials session is a conference for researchers to present on a topic of importance . a total of 35 tutorial submissions were received, of which 6 were selected for presentation . |
| Approach: | NAACL 2021 tutorials session is organized to give conference attendees a comprehensive introduction from expert researchers to a topic of importance drawn from our research field. |
| Outcome: | the tutorials committee selected 6 tutorials for presentation at NAACL 2021 . the topics chosen this year range from transformers to crowdsourcing . |
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)
Copied to clipboard
Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan, Haidar Khan, Israt Jahan, Amran Bhuiyan, Chee Wei Tan, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty, Jimmy Huang
| Challenge: | Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains. |
| Approach: | They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks . |
| Outcome: | The proposed evaluations are reproducible, reliable, and robust. |
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorials (N19-5)
Copied to clipboard
| Challenge: | NAACL-HLT 2019 tutorials session is organized to give conference attendees a comprehensive introduction to a topic of importance drawn from our rapidly growing and changing research field from expert researchers. |
| Approach: | the tutorials committee at NAACL HLT 2019 received 46 tutorial submissions . 6 of the tutorial submission were selected for presentation at the conference . |
| Outcome: | the tutorials committee at NAACL-HLT 2019 received 46 submissions . 6 of the tutorial submissions were selected for presentation . |
On Measures of Biases and Harms in NLP (2022.findings-aacl)
Copied to clipboard
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
| Challenge: | Recent studies show that natural language processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. |
| Approach: | They propose a framework for harms and questions to help practitioners understand biases . they propose measurable measures to detect and mitigate biased groups . |
| Outcome: | The proposed framework provides a framework for harms and questions for practitioners to answer to guide the development of bias measures. |
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts) (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | NAACL 2024 tutorial sessions are a cornerstone event of the conference . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
| Approach: | NAACL 2024 will host a tutorial session featuring top-notch researchers . the tutorials aim to equip attendees with the latest tools and methodologies . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
| Outcome: | the tutorial sessions are a cornerstone event of the conference . the call, submission, reviewing, and selection of tutorials were coordinated . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview (2020.acl-main)
Copied to clipboard
| Challenge: | a growing number of studies address the effect of bias on predictions, but no unifying framework exists . a general phenomenon of biased predictive models in NLP is not recent, authors say . |
| Approach: | They propose a unifying framework for identifying and reducing bias in natural language processing . they propose to differentiate two consequences of bias and four potential origins of bias . |
| Outcome: | The proposed framework provides an overview of predictive bias in natural language processing . it differentiates two consequences of bias and four potential origins of bias: label bias, selection bias, model overamplification, and semantic bias. |
Proceedings of the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts) (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | NAACL 2025 tutorial sessions are a cornerstone event of the conference . tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Approach: | NAACL 2025 will host a tutorial session on computational linguistics and natural language processing . the tutorials are a cornerstone event of the conference . |
| Outcome: | the tutorial sessions at NAACL 2025 are a cornerstone event of the conference . each submission received a thorough evaluation by a panel of two to three reviewers . |
Addressing Bias and Hallucination in Large Language Models (2024.lrec-tutorials)
Copied to clipboard
Nihar Ranjan Sahoo, Ashita Saxena, Kishan Maharaj, Arif A. Ahmad, Abhijit Mishra, Pushpak Bhattacharyya
| Challenge: | This tutorial provides a comprehensive overview of two critical aspects of Large Language Models: bias and hallucination. |
| Approach: | This tutorial provides an overview of two critical aspects of Large Language Models: bias and hallucination. |
| Outcome: | This tutorial delves into the complex dimensions of Large Language Models (LLMs) it outlines ethical considerations pertinent to their development and discusses hallucination, a prevalent issue in generative AI systems such as LLMs. |
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) (2025.acl-tutorials)
Copied to clipboard
| Challenge: | ACL 2025 tutorial sessions are a cornerstone event of the conference . 76 tutorial submissions were received this year, many of which were very engaging . |
| Approach: | 76 tutorial submissions were received this year for the tutorial session at ACL 2025 . the tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Outcome: | the tutorial sessions at ACL 2025 will be held in london on november 8 . the conference received 76 tutorial submissions this year . |