search space
The total set of possible solutions a problem-solving system must consider; it grows explosively as problems become more complex.
As defined in Thinking too logically can actually hold you back - Steve StouteFounder and CEO, UnitedMasters and Translation
Where it comes up · 2
- 280 | François Chollet on Deep Learning and the Meaning of Intelligence2 claims
- Thinking too logically can actually hold you back - Steve StouteFounder and CEO, UnitedMasters and Translation1 claim
Most important claims · 3 of 3Search all claims for “search space” →
- Symbolic AI worked well on simple toy problems but failed as problems grew complex because the search space of possible solutions became enormous; representing real-world problems as logic problems caused the systems to break down once they moved beyond toy cases.Thinking too logically can actually hold you back - Steve StouteFounder and CEO, UnitedMasters and Translation
- Real invention and creativity by an algorithm has historically occurred only when an open-ended search process operates over a relatively unconstrained search space; LLMs cannot invent anything because they are limited to interpolations, whereas genetic algorithms with the right search space and fitness function can invent entirely novel systems no human could anticipate—such as the famously novel antenna design.280 | François Chollet on Deep Learning and the Meaning of Intelligence
- Although intelligence was produced by evolution and could in theory be re-derived by a search algorithm, brute-forcing AGI via genetic search is a bad idea in practice: the required scale is excessive, humans already are general intelligence and are extremely effective at predicting which ideas to try, so outsourcing cheap ideation to a bad algorithm while leaving expensive evaluation to be done anyway is ineffective—and the search may not even contain the correct solution.280 | François Chollet on Deep Learning and the Meaning of Intelligence