subjective experience (Hinton's definition)
Talk about one's perceptual state via counterfactual claims about what would normally cause such perception in the external world; not access to special inner qualities but description of how the world would have to be
As defined in Geoffrey Hinton - Two Paths to Intelligence
Where it comes up · 1
Most important claims · 6 of 6Search all claims for “subjective experience (Hinton's definition)” →
- When I say 'I have subjective experience of little pink elephants,' I'm not describing an inner theater with little pink elephants made of 'qualia.' Instead, I'm using the concept of normal perception to describe what's going on in my perceptual system. I'm saying: given my perceptual state, what would have to be out there in the world for this to be normal perception? Answer: little pink elephants. But these 'elephants' are counterfactual, not made of spooky stuff.Geoffrey Hinton - Two Paths to Intelligence
- In this sense, I think these AI models can have subjective experience. Suppose we make a multimodal model with a camera. Without its knowledge we put a prism in front of the camera. Then we put an object in front of it and ask where the object is. It says the object is there (pointing). We say you're wrong, there's a prism. The system says 'I have subjective experience of the object being there.' This is the same use of subjective experience we use for people.Geoffrey Hinton - Two Paths to Intelligence
- Hinton classifies himself in the 'danenic camp' and believes people have completely misunderstood what the mind and consciousness are, contrary to dominant philosophical views.Geoffrey Hinton - Two Paths to Intelligence
- Many people believe we don't need to worry about superintelligent AI taking control because these systems don't have subjective experience, consciousness, or sentience. They're just dumb computers manipulating symbols without real experience—not like us. However, I believe people have misunderstood what consciousness is.Geoffrey Hinton - Two Paths to Intelligence
- Hinton formulated his philosophical theory of subjective experience (as counterfactual talk about perception) around age 19, but philosophy departments were not interested in exploring it, so he developed a grudge against academic philosophy.Geoffrey Hinton - Two Paths to Intelligence
- Hinton is using his good reputation to say one crazy thing (that AI systems could have subjective experience) and expects people to listen, but warns that saying two crazy things would cause people to dismiss him as simply crazy.Geoffrey Hinton - Two Paths to Intelligence