Challenge: Large Language Models (LLMs) are increasingly used for knowledge-based reasoning tasks, yet understanding when they rely on genuine knowledge versus superficial heuristics remains challenging.
Approach: They propose to ask LLMs to compare numerical attributes to find out which country has the highest population, France or Germany.
Outcome: The proposed model comparisons show that heuristics override principled reasoning for larger models, while smaller models show no discrimination.

Similar Papers

Large Language Models Help Humans Verify Truthfulness – Except When They Are Convincingly Wrong (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used for accessing information on the web.
Approach: They conduct experiments with 80 crowdworkers to compare LLMs with search engines . they ask LLM to provide contrastive information to reduce over-reliance on LLM .
Outcome: The results show that LLMs can outperform search engines but not LLM explanations . the study shows that LMS explanations are not reliable replacements for reading retrieved passages compared to search engines alone.
To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have remarkable performance in a variety of tasks due to factual knowledge accumulated during pre-training.
Approach: They propose an evaluation protocol that disentangles knowing from applying knowledge and test state-of-the-art LLMs on 49 ambiguous entities.
Outcome: The proposed evaluation protocol disentangles knowing from applying knowledge and tests state-of-the-art LLMs on 49 ambiguous entities.
Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities in various tasks, but may rely on dataset biases as shortcuts for prediction.
Approach: They propose to use a test suite to evaluate the impact of shortcuts on LLMs' performance.
Outcome: The proposed test suite incorporates six shortcut types, five evaluation metrics, and four prompting strategies.
7 Points to Tsinghua but 10 Points to ? Assessing Large Language Models in Agentic Multilingual National Bias (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, but studies on risks associated with cross biases are limited to immediate context preferences.
Approach: They investigate multilingual bias in state-of-the-art Large Language Models by analyzing their responses to decision-making tasks across multiple languages.
Outcome: The proposed model can provide personalized advice across university applications, travel, and relocation scenarios.
Do Large Language Models Know How Much They Know? (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models are highly capable systems, but their capabilities and limitations are unclear.
Approach: They develop a benchmark that challenges LLMs to recall all information they possess on specific topics.
Outcome: The proposed model can recall excessive, insufficient, or the precise amount of information they possess on a given topic, indicating their awareness of how much they know about the given topic.
A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners (2024.emnlp-main)

Copied to clipboard

Challenge: a new hypothesis-testing framework is developed to assess whether large language models possess genuine reasoning abilities or primarily depend on token bias.
Approach: They propose a framework to assess whether large language models have genuine reasoning abilities or primarily depend on token bias.
Outcome: The proposed framework outlines a list of hypotheses where token biases are readily identifiable . the results suggest that most LLMs still struggle with logical reasoning .
Evaluating the Deductive Competence of Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Existing large language models have limited abilities to solve deductive reasoning problems . performance differences between conditions do not improve overall performance .
Approach: They investigate whether several large language models can solve a deductive reasoning problem in their conventional form.
Outcome: The proposed models can solve a classic type of deductive reasoning problem in their conventional form.
Towards Reasoning in Large Language Models: A Survey (2023.findings-acl)

Copied to clipboard

Challenge: Reasoning is a fundamental aspect of human intelligence that plays a crucial role in many intellectual activities.
Approach: They propose to improve LLMs' ability to elicit reasoning by providing exemplars or prompts to model reasoning.
Outcome: This paper provides a comprehensive overview of the state of knowledge on reasoning in large language models.
Defining Knowledge: Bridging Epistemology and Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing literature on large language models (LLMs) define knowledge as a fact if it correctly completes a cloze sentence . but the predictions of semantically equivalent clozing sentences are inconsistent .
Approach: They review standard definitions of knowledge in epistemology and formalize interpretations applicable to LLMs.
Outcome: The authors compare the preferences of philosophers and computer scientists in terms of knowledge definitions and evaluation protocols for testing knowledge in accordance with the most relevant definitions.
Factuality of Large Language Models: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios.
Approach: They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors .
Outcome: The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations