“To get real creativity, you need to search through spaces of possibilities and find these hidden gems. That’s what creativity is. Current language models don’t really do that. They’re mimicking the data. They’re mimicking all the human ingenuity they’ve seen from all these internet data, which are originally derived from humans” (29).
– Shane Legg, cofounder of Google DeepMind
“The models are smaller than brains, so they need a lot more data. Or perhaps the analogy to the brain is not quite right or is breaking down. There’s some missing factor…It’s something we don’t quite understand. Humans see so little data and they still do fine” (45-46).
– Dario Amodei, CEO of Anthropic
in Dwarkesh Patel, The Scaling Era (2025)
brettworks 
Leave a comment