You Ask, I Answer: Can AI Truly Be Creative?

In today's episode, Paul asks the question can large language models come up with new ideas and innovate? If we're talking about divergent creative thinking, brainstorming and stuff, then here's my question. How does a human innovate? Human come up with new ideas. Right.

This is an important question. We should first know how humans create before we can answer whether machines are capable of it. There are no shortage of academic papers online that talk about creativity in humans and how it works in the brain. So I put took 30 of those papers on things like MRI brain scans of people who are doing creative tasks. I put them into a language model called Notebook LM, which is a free service by Google, and I asked the model, how do humans think creatively?

So here's the short version. In the right hemisphere of your brain, in the right prefrontal cortex, which is somewhere over here, is where ideas start, right? Where it and also this is where memory encoding tends to operate. Ideas are filtered then into the left dorsal, dorso lateral prefrontal cortex, which is over here, which is where we apply constraints, learned rules like language and short-term memory. So idea comes, starts here and then it comes over here, and we start modifying the idea and saying, okay, well, let's toss some things out.

Ideas then go to the medial prefrontal cortex, which is somewhere over here, um, to retrieve long term memories from long-term memory and make associations with the ideas. So from here to here to here, you're bouncing around, and then ideas go through this iterative loop in your brain, uh, getting more idea variations from over here, applying more or less rules over here, and then augmenting and and and building on the ideas in here. And all this is happening in the neural network that is our literal brains. Our brains are neural networks. You will hear that term in computing and in AI, but the OG neural network is between your ears.

And we don't even understand how memory works. Not really. We know where it's stored, but we're still very unfamiliar with just how memory works. But that's the general process that can be observed in humans. That should sound kind of familiar.

How does a language model generate ideas? Well, you first you prompt it and say, hey, I want to brainstorm something or other. That prompt is broken down into tokens and then embedded, and then that is sent by a portion of a language model called retrieval heads and bounces into the long-term memory of the model and it activates those memories. The model's memories kind of attach to this prompt, and then all that stuff gets sent to a decoder. The decoder takes the embeddings, the mathematical associations, and reassembles them back into words, concepts, and ideas.

Then it applies rules based on the model's environment, like things you're not allowed to say. And then that's dumped into short-term memory in the conversation. It's very similar conceptually to how humans do creativity. It is not that far off of, hey, I've got this thing, what things are like this? Um let me come up with things that are like this.

If I ask you to be creative about solving a problem, like how do we how do we get people to stop speeding? Um, or how do we get people to eat healthier foods? And you brainstorm, you are bouncing around ideas, looking for other things to latch on in your neural network, and you return those ideas, you know, either by writing them down or speaking them. Machines are very similar. Now there are differences, right?

So there's differences in the ways that machines work. Machines, for example, have way more long-term memory than you or I do. A model like uh today's Google Gemini 1.5 or Claude Sonnet 3.5 or GPT-4 Omni, these things have read every book available that's online and open to the public, right? Uh think about it. It has been a long time since I've read this.

I can't remember hardly anything in here. I can remember like to be and not to be, right? That's it. Uh I can I can recall accurately like 10 tokens, uh, you know, 15 words out of 800,000. If you were to ask a language model, recite part of uh Act Three Scene One from Midsummer Night's Dream, the model could do it with way more accuracy than you or I can.

So their memory is substantially better, and they have much more of it. Think about something like Project Gutenberg, the the open source free project to digitize and make freely available public domain books. AI has read all of it. You and I probably have read just a fraction of it. So a model's understanding of the world from an academic perspective is much more vast than you or I.

Second thing is machines don't have selective memory beyond what we provide in the prompt. Our memory association, yours and mine, particularly for long-term memory, are are rooted in emotions. We don't store data factually, we store data in emotions. And when we it's funny, when we recall memories, we're not actually bringing you know data out of storage. We are regenerating it for the first time based on what we remember and what we remember is rooted in emotion.

Machines don't have that. Machines don't have emotions, so they're their recall mechanism is very different. Think about this. You know this to be true. Think about think about that first date with that special someone, right?

Or think about that that dinner you had, that that amazing special occasion. You know the one. You just still you can you remember what it was. You can probably you know mentally recall the taste of it, like how how well the thing was cooked and what sauce was on the side and what the dessert was, but you can't remember what you had for lunch two weeks ago, right? Because what you had two weeks ago was not emotionally resonant.

Your brain didn't reach the activation levels that said, yeah, let's store this data. You're like, yeah, it was fine. Whatever it was, it was fine. Yeah, unless you got food poisoning that wasn't fine. Um, that's how much that's how our human brains work.

Machines do not work that way. Our memory is much more selective and it's rooted in emotion. Third, machines don't have sensory information. They have limited amounts of vision, they have a lot of understanding of text, they don't have auditory, not really. Um, and they don't understand, they don't perceive the world the same way we do.

Those perceptions change our associations, right? If you, if I give you a sniff of uh a perfume, and that perfume happens to have a an association with that special someone, past or present, suddenly all these other memories activate in your neural network, and you're like, oh yeah, I remember that, and I remember this thing, and I remember that dance we went to, or I remember this, you know, the that evening in the park. And a lot of data gets invoked from that sensory information. Machines have none of that. Machines, because they don't have that data, their understanding of the world is much narrower.

It's much more literal than what we have, which is much more sensory in nature. So our brainstorming will be different, but our brainstorming will not be better or worse than machines. It's just different. And that's what we conclude about AI and its ability to create to do creative thinking. If we're wondering which is better, human or machine for creative thinking, it depends on the task and the observed data.

Take something that is very heavily a language task, like corporate strategy. Can AI brainstorm corporate strategy? Sure. Absolutely. And it's going to do that way better than any human being because as long as your prompts are good, that's not a sensory task.

That is an academic task. That is a knowledge task. And it has read every strategy book on corporate strategy ever written. So it has more knowledge and more recall. It will crush that task.

It will blow way past us. Can AI brainstorm a new taste, a net new taste combination for a dish? Yeah, but not really, because that's a high sensory task. If you're trying something that's net new, a machine can't taste what you've created. It can infer based on its knowledge of ingredients and cookbooks and all this stuff, but it doesn't have the ability to stick its finger and go, hmm, nope, needs more salt.

That sensory data doesn't exist. And so a machine today cannot brainstorm and do creative thinking on high sensory stuff, high emotion stuff in the same way that you and I can. It's just not possible today. But that is changing. As robots go out into the world and start collecting sensory data and interacting with the world, there'll be that much more data from models to learn, and it will improve their ability to understand the world significantly better.

So, really good question. Thanks for asking. Talk to you on the next one. If you enjoyed this video, please hit the like button. Subscribe to my channel if you haven't already.

And if you want to know when new videos are available, hit the bell button to be notified as soon as new content is live.