factual

Novel Reframings Expose Lack of World Model

You can show LLMs don't model the world by asking questions they have not seen phrased that way before: disguising the Sleeping Beauty problem made GPT fail to recognize it, and burying the word 'yesterday' in a cast-iron-skillet question made GPT wrongly warn of burns -- evidence it tracks word co-occurrence rather than the structure of the situation.

factualpending

Speaker

Sean Carroll

Evidence Quote

“would I hurt myself if I used my bare hands to pick up a cast iron skillet that I used yesterday to bake a pizza in an oven at 500 degrees?”

Source

258 | Solo: AI Thinks Different— Sean Carroll's Mindscape
Created: 6/13/2026, 12:12:00 AM

Your notes

Loading notes...