Mind Readings: Recipes vs Learning How to Cook

In today’s episode, we tackle the age-old question: is it better to follow a recipe or learn to cook? Discover how this analogy applies to the world of generative AI and why understanding the “why” behind the tools is crucial for mastering them. You’ll learn how to develop a deeper understanding of AI principles through practice and experimentation, empowering you to create better prompts, troubleshoot issues, and ultimately become an AI chef!

https://youtu.be/7ZPBMRYGekg

Can’t see anything? Watch it on YouTube here.

Listen to the audio here:

Download the MP3 audio here.

Machine-Generated Transcript

What follows is an AI-generated transcript. The transcript may contain errors and is not a substitute for watching the video.

Christopher Penn: In today’s episode, Ashley asks, which is more viable or valid: just having the recipe and making the recipe, or deeply understanding the subject?

There are situations and times when you just want to get dinner on the table. If you’ve got a recipe, you can do that relatively quickly and mindlessly, especially if you’ve got a dozen other things going on—you’ve got to pick up your dog from daycare and all this stuff. Sometimes, you just want the recipe, just want to follow the recipe, mindlessly get the thing done, and you don’t care about the information in it or the complex—you want to make it so that in 30 minutes, there’s something to eat that isn’t frozen or takeout.

At the same time, if you only know the recipe, and you don’t know why something works, then you are limited to what that recipe can do. You’re limited to that recipe, maybe a few variations of it, but you don’t know why it works. So you can’t take those principles, those ideas, and extend them.

For example, tomatoes contain glutamic acid. If you add sodium to that, you end up creating essentially a variation of MSG, monosodium glutamate—sodium ions mixed with glutamic acid, which makes them taste better. Tomatoes always taste better with salt, period, end of story, no matter what kind of tomato it is. So if you are making tomato soup, you know you’ve got to add some salt to it to make it taste better. If you’re making pizza, if you’re making pasta, you’re making a crazy salad, anything with a tomato, you know you’ve got to add salt to it because it contains glutamic acid. If you understand that principle, you can spot the recipes that are bad because the recipes that are bad have tomatoes and don’t have salt. You understand the principle.

When it comes to things like generative AI, which is the topic of discussion initially about this, you should have recipes (aka prompts), but you should also understand why the prompts work, why they don’t work, and what are the guiding principles underneath that help you make better prompts.

For example, when it comes to using prompts and understanding the latent space (aka the long-term memory of a model), knowing that the model’s next choice of a word is going to be contingent not only on your prompt, but everything else it has already said about the question you asked, means that you know to ask better questions upfront and get more words—more relevant words—into the session. And this is why in the PAIR framework—if you go to TrustInsights.ai/pair, you can download this framework—one of the first steps in the framework is called “priming,” where you ask a model, “What do you know about this topic?” If I’m doing something on cooking pizza, “What do you know about best practices for cooking pizza?” When the model spits back a bunch of relevant words, now I’ve got the ability to make a really good prompt out of this. So, I can create a recipe, but I also know how the cooking works.

So, is it worth trying to learn generative AI? Is it worth trying to answer this, or are you just okay with the recipes? Well, it depends. If you just want to serve dinner quickly, then just have a collection of the recipes you love most, but know that it’ll take you longer to get success when things either go wrong, or when you need to make some substantial variations, than if you understand the principles.

Now, here’s the other thing that happens with recipes, and this is something I get from the martial arts. Do a recipe enough, and you study it enough, you take it apart, you experiment with it and things—you eventually learn the principles from it. If you cook pizza over and over again, you cook every possible pizza there is, eventually you understand what makes pizza work just by the sheer number of variations, the practice, the time put in to understand the recipe. You can get to the principles. And in fact, that sort of practical education is one of the better teaching methods to deeply learn a subject. You learn the recipe, you follow it rigorously, you start making variations, and eventually, you don’t need it anymore because you’ve learned all the major variations.

You’ve made pizza in squares and circles, put the cheese on top of the sauce, put the sauce on the cheese, you’ve tried the convection oven and the grill, the brick oven—you’ve done it all. Because you know that now, you have confidence in what you can and can’t do with pizza.

The same thing is true of generative AI. When you start working with prompts, and then varying those prompts and trying new things and different models and stuff, you do it long enough, eventually you have an understanding of how—what you need to do to make that tool work for you.

I’ve been working with generative AI since 2021, when GPT-3 became usable, and the GPT-J 6B model from EleutherAI was the first one that actually could write coherently. It didn’t write factually correct, but it was no longer putting words together that made no sense. It had grammar. So, a couple of years before ChatGPT came out, I was banging away on this thing, just trying to make it work. And understanding back then the severe limitations those early models had means that when the bigger, more competent models come out, I know what works in the bigger models because it’s the same technology.

The quality has improved, but the fundamentals, the mechanisms for how they work—those are the same.

If you enjoyed this video, please hit the like button. Subscribe to my channel if you haven’t already. And if you want to know when new videos are available, hit the bell button to be notified as soon as new content is live.

Mind Readings: Recipes vs Learning How to Cook

Machine-Generated Transcript

Comments

Leave a Reply Cancel reply

Pin It on Pinterest