Papers by Shun Liao
What Are the Odds? Language Models Are Capable of Probabilistic Reasoning (2024.emnlp-main)
Copied to clipboard
Akshay Paruchuri, Jake Garrison, Shun Liao, John Hernandez, Jacob Sunshine, Tim Althoff, Xin Liu, Daniel McDuff
| Challenge: | Language models (LMs) are capable of remarkably complex linguistic tasks, but numerical reasoning is an area in which they struggle. |
| Approach: | They evaluate the probabilistic reasoning capabilities of language models using idealized and real-world statistical distributions. |
| Outcome: | The proposed model can make inferences about distributions, even if assumptions are incorrect or misspecified. |