When asked 'How many Rs are there in strawberry?', AI incorrectly answers 'two' with high confidence, and when pressed to verify, doubles down on the wrong answer and claims it would bet a million dollars on it, demonstrating that AI does not count letters but rather pattern-matches and picks up on word components like 'berry.'

factualpending

Speaker

Michael Wooldridge

Evidence Quote

“it's doing is basically pattern matching...Probably what it's doing here is just picking up on the word berry”

Source

This is not the AI we were promised | The Royal Society— The Royal Society
Created: 8/12/2026, 6:23:19 PM

Your notes

Loading notes...