Almost Timely News: Key Roles in Your Generative AI Pilot Team (2023-10-29) :: View in Browser
This newsletter is moving to Substack. If you’d like to move yourself, rather than wait, you can do so by visiting the new subscription page.
Content Authenticity Statement
100% of this newsletter was generated by me, the human. No AI was used to generate any part of this issue. Learn why this kind of disclosure is important.
Watch This Newsletter On YouTube 📺
What’s On My Mind: Key Roles in Your Generative AI Pilot Team
Today, let’s talk about who should be on your AI pilot team. Well, first, let’s talk about what an AI pilot team is. Many, many organizations right now have individual people trying out generative AI for all kinds of purposes, from drafting emails to content creation to coding. Very few of those uses are officially sanctioned, supervised, or audited, which can lead to some pretty big problems down the road – problems like data leakage.
This is really the heart of the matter: generative AI is a transformative technology. Like electricity or the Internet itself, generative AI changes everything it touches. And like electricity and the Internet, it can be used for great good or great harm. Clamping down on the use of generative AI with a bury-your-head policy and point of view handicaps your organization. More progressive, more risk-taking competitors will adopt generative AI while you hide from it and they’ll eat your lunch. They’ll be faster, cheaper, and better than you. That’s not a winning formula for success.
But a free-for-all, no-holds-barred approach isn’t a winning formula either. People will use it for tasks they shouldn’t – either because the task itself isn’t well suited for AI, or there’s substantial risk, like working with protected data in unprotected systems. For example, someone who uploads personally-identifying information into a system like ChatGPT is basically handing protected information to an unsanctioned third party. That’s not the right approach either.
The best choice is that centered approach – neither too risk averse, nor too reckless. But how do we get there? That’s the role of an AI pilot team. What is an AI pilot team? It’s a group of people selected to help build out use cases for generative AI, do small-scale pilot projects to validate the use cases, and help create standard operating procedures that enable AI without compromising safety or harming innovation.
To achieve this goal, an AI pilot team needs a very specific set of skills, skills that help achieve the overall goal of enabling AI in your organization. The right people with the right roles will quickly dispel misconceptions and roll out practical use cases for your organization to adopt generative AI.
What are these roles? In no particular order, you will need five major roles:
- Data expert
- Business expert
- Subject matter expert
- Technical expert
- Supervisory expert
Let’s step through what each of these roles do on an AI pilot team.
The Data Expert
The data expert’s role is very straightforward: to know what data is available within your organization, where it lives, who has access to it, how protected the data is, and how, if at all, that data can be surfaced for use with generative AI.
In the pilot team, the data expert is essential for knowing what data you’re allowed to work with and help develop use cases for generative AI with that data. This doesn’t necessarily have to be someone with a formal database or data engineering background, either – it just needs to be someone who knows where the data is and what you’re allowed to do with it.
The Business Expert
Someone on the pilot team has to ask the question that my partner and CEO Katie Robbert asks me all the time, which is, “So what?” What’s the purpose of any given use case? What does it do for the business, for your department, for the goals you’ve set out to achieve.
Generative AI is the shiny object of the moment and everyone’s still trying to figure out what it is and isn’t good at, but someone has to ask the So what? question on a regular and frequent basis so that the pilot projects make sense. Eventually, when you present your results to your stakeholders, they’ll ask the same question, so it’s easiest if you start with that question in mind.
The Subject Matter Expert
In many companies, the subject matter expert is not the business expert. How the company makes money is different from how the company does what it does. The lead food scientist is not the CFO or the COO, even though both are important. The subject matter expert’s role on the AI pilot team is to bring deep knowledge about the company and its core competencies, mapping what’s known about existing processes to generative AI capabilities.
For example, suppose you work at a bakery. The subject matter expert would be the head baker and would be able to help you understand how the existing recipes were developed. You’d use that knowledge to work with generative AI, maybe to create some new recipes, and then your subject matter expert would inspect the outputs and say yes, that’s feasible or no, that recipe won’t work because a large language model somehow assumed baking powder and baking soda are the same thing.
The Technical Expert
The technical expert’s role in an AI pilot project is clear: their job is to help manage the implementation and usage of generative AI. They provide knowledge about what AI can and cannot do, help map AI to current processes, and do the deployments of generative AI within pilot projects.
Here’s where we’re going to get a bit challenging. The technical expert, by definition, is the person or persons in your organization who have the most experience with generative AI specifically. Not a general technical expert necessarily, not an IT person, but the person who has the most hands on knowledge of generative AI.
That might very well be the most junior person on your team, or the janitor for all you know. But whoever it is, they need to be on the pilot team because they’ll be the best at helping bring use cases to life.
The Supervisor/Scientific Expert
It’s fine to tinker around with generative AI, to test out different things and see how things go. However, once you start building out an actual AI practice, winging it and tinkering are unsustainable strategies. It’s what companies did most wrong with the advent of smartphones in the workplace. Companies ignored them or tried to ban them and employees kept bringing them.
If we want to avoid the same mistake this time around, we need a scientifically-minded expert on our team, someone who can set up the testing and measurement of our pilot use cases, show meaningful and mathematically sound improvements, and critically ask the one question that is almost never asked enough in AI:
What could go wrong?
The scientifically minded expert knows to ask that question, knows to plan for all manner of scenarios going sideways, and knows to anticipate problems in advance when designing experiments and test cases.
Rolling Out the Roles
You might be saying to yourself right now, we don’t have nearly enough people to build out a team of five just for piloting AI. Or you might be in the opposite boat and saying a team of five isn’t nearly large enough to encapsulate all the different departments and roles and use cases in your mammoth organization. That’s why I call these roles instead of jobs. One person can play multiple roles in smaller organizations, and many people can participate in just one role in larger organizations.
For example, at my company, I play the role of the data expert and the technical expert. Sometimes I play the role of subject matter expert, sometimes not. Katie often plays the role of the scientific expert and the business expert. What matters is that someone’s fulfilling all five of the roles in some capacity so we don’t have a dangerous blind spot.
At a large enterprise, I could see each of these roles being part of a pilot team in every department. HR might have its own pilot team with one or more people in each role. Finance would have its own pilot team. Sales would have its own pilot team. Again, as with the small company, the key is to ensure you have all five roles covered in some capacity.
Your AI pilot team, properly staffed, will be the vanguard, the scouts ahead of the army who spot the obstacles and clear the path for everyone else. In a different issue, we’ll talk about the soft skills you need for each of the people on the pilot team, because there are some critical personality traits you do and don’t want on your AI pilot team. For now, start thinking about who your AI pilot team might want to have on it, and what roles they’ll play.
How Was This Issue?
Rate this week’s newsletter issue with a single click. Your feedback over time helps me figure out what content to create for you.
Share With a Friend or Colleague
If you enjoy this newsletter and want to share it with a friend/colleague, please do. Send this URL to your friend/colleague:
ICYMI: In Case You Missed it
Besides the newly-refreshed Google Analytics 4 course I’m relentlessly promoting (sorry not sorry), I recommend the piece on how generative AI will force a change in your PR strategy.
- Mind Readings: Flip Your PR Strategy in the Age of Generative AI
- Mind Readings: Stop Being an Hourly Knowledge Worker Business
- Mind Readings: Why AI Struggles With Sarcasm
- Almost Timely News, October 22, 2023: The Generative AI Beginner’s Kit
- You Ask, I Answer: Keys to B2B Influencer Marketing Success?
- You Ask, I Answer: Role of AI in B2B Influencer Marketing?
- You Ask, I Answer: Predictions for B2B Influencer Marketing in 2024?
- Now with More Games, Threads, and Fairness!
- In-Ear Insights: CMO Survey, AI, and 2024 Marketing Budgets
Skill Up With Classes
These are just a few of the classes I have available over at the Trust Insights website that you can take.
- 👉 Google Analytics 4 for Marketers
- 👉 Google Search Console for Marketers (🚨 just updated with AI SEO stuff! 🚨)
- ⭐️ The Marketing Singularity: How Generative AI Means the End of Marketing As We Knew It
- Powering Up Your LinkedIn Profile (For Job Hunters) 2023 Edition
- Measurement Strategies for Agencies
- Empower Your Marketing With Private Social Media Communities
- Exploratory Data Analysis: The Missing Ingredient for AI
- How AI is Changing Marketing, 2022 Edition
- How to Prove Social Media ROI
- Proving Social Media ROI
- Paradise by the Analytics Dashboard Light: How to Create Impactful Dashboards and Reports
Advertisement: Bring My AI Talk To Your Company
I’ve been lecturing a lot on large language models and generative AI (think ChatGPT) lately, and inevitably, there’s far more material than time permits at a regular conference keynote. There’s a lot more value to be unlocked – and that value can be unlocked by bringing me in to speak at your company. In a customized version of my AI keynote talk, delivered either in-person or virtually, we’ll cover all the high points of the talk, but specific to your industry, and critically, offer a ton of time to answer your specific questions that you might not feel comfortable asking in a public forum.
Here’s what one participant said after a working session at one of the world’s biggest consulting firms:
“No kidding, this was the best hour of learning or knowledge-sharing I’ve had in my years at the Firm. Chris’ expertise and context-setting was super-thought provoking and perfectly delivered. I was side-slacking teammates throughout the session to share insights and ideas. Very energizing and highly practical! Thanks so much for putting it together!”
Get Back to Work
Folks who post jobs in the free Analytics for Marketers Slack community may have those jobs shared here, too. If you’re looking for work, check out these recent open positions, and check out the Slack group for the comprehensive list.
- Analytics Engineer (Contract) at Harnham
- Data Analyst at Indeed.com
- Head Of Analytics & Data Science at Intrepid Digital
- Java Engineer at Save the Children UK
- Marketing Analytics Manager at Beyond Finance
- Marketing Operations Manager at Birdeye
- Marketing Research Sales Director at InsightsNow
- Senior Analytics Implementation Engineer at Sky
- Senior Analytics Manager – Digital Consumer Engagement (Dce) at LEGO
- Senior Data Analyst at Cox Careers
- Senior Manager, Marketing Analytics at Asurion
- Sr. Principal Customer Success Manager at Tealium
- Web Analytics & Search Specialist at Career Portal
What I’m Reading: Your Stuff
Let’s look at the most interesting content from around the web on topics you care about, some of which you might have even written.
Social Media Marketing
- HubSpot & TikTok Announce Partnership For B2B Lead Generation
- One year in: Inside X (formerly Twitter) and its complicated relationship with advertisers via Digiday
- Best LinkedIn analytics tools to maximize your marketing via Sprout Social
Media and Content
- The future of media relations: Navigating AIs impact on PR via PR Daily
- Unlocking the Taylor Swift PR Playbook to Build Your Brand
- As more brands use generative AI to create social content, agencies are changing how they measure its success via Digiday
SEO, Google, and Paid Media
- I Deleted the Content From Two Posts To See if Theyd Still Rank. Heres What Happened
- Technical SEO Tips for Black Friday & Cyber Monday 2023 via Website Intelligence
- Heres Why You Should Conduct an SEO Audit, and What You Can Learn From It
Advertisement: Business Cameos
If you’re familiar with the Cameo system – where people hire well-known folks for short video clips – then you’ll totally get Thinkers One. Created by my friend Mitch Joel, Thinkers One lets you connect with the biggest thinkers for short videos on topics you care about. I’ve got a whole slew of Thinkers One Cameo-style topics for video clips you can use at internal company meetings, events, or even just for yourself. Want me to tell your boss that you need to be paying attention to generative AI right now?
Tools, Machine Learning, and AI
- How the United States Air Force Accelerated AI Adoption via HBS Working Knowledge
- Top AI Shops Fail Transparency Test via IEEE Spectrum
- OpenAI forms new team to assess catastrophic risks of AI via The Verge
Analytics, Stats, and Data Science
- 22 Influencer Marketing Statistics for Your Brands Strategy in 2023 via Sprout Social
- A Step-by-Step Guide to PDF Chatbots with Langchain and Ollama via Analytics Vidhya
- How To Use Google Analytics 4 Events to Track Category Popularity in WordPress via Martech Zone
All Things IBM
- Architect to operationalize your sustainability goals via IBM Blog
- Unified Endpoint Management vs. device lifecycle management: what do they have in common? via IBM Blog
- This Brain-Like IBM Chip Could Drastically Cut the Cost of AI
Dealer’s Choice : Random Stuff
- The Junk Is Winning via The Atlantic
- Colleges Must Respond to Americas Skill-Based Economy via EdSurge News
How to Stay in Touch
Let’s make sure we’re connected in the places it suits you best. Here’s where you can find different content:
- My blog – daily videos, blog posts, and podcast episodes
- My YouTube channel – daily videos, conference talks, and all things video
- My company, Trust Insights – marketing analytics help
- My podcast, Marketing over Coffee – weekly episodes of what’s worth noting in marketing
- My second podcast, In-Ear Insights – the Trust Insights weekly podcast focused on data and analytics
- On Threads – random personal stuff and chaos
- On LinkedIn – daily videos and news
- On Instagram – personal photos and travels
- My free Slack discussion forum, Analytics for Marketers – open conversations about marketing and analytics
Advertisement: Ukraine 🇺🇦 Humanitarian Fund
The war to free Ukraine continues. If you’d like to support humanitarian efforts in Ukraine, the Ukrainian government has set up a special portal, United24, to help make contributing easy. The effort to free Ukraine from Russia’s illegal invasion needs our ongoing support.
Events I’ll Be At
Here’s where I’m speaking and attending. Say hi if you’re at an event also:
- DigitalNow, Denver, November 2023
- LPA, Boston, November 2023
- Social Media Marketing World, San Diego, February 2024
- MAICON, Cleveland, September 2024
Events marked with a physical location may become virtual if conditions and safety warrant it.
If you’re an event organizer, let me help your event shine. Visit my speaking page for more details.
Can’t be at an event? Stop by my private Slack group instead, Analytics for Marketers.
Events with links have purchased sponsorships in this newsletter and as a result, I receive direct financial compensation for promoting them.
Advertisements in this newsletter have paid to be promoted, and as a result, I receive direct financial compensation for promoting them.
My company, Trust Insights, maintains business partnerships with companies including, but not limited to, IBM, Cisco Systems, Amazon, Talkwalker, MarketingProfs, MarketMuse, Agorapulse, Hubspot, Informa, Demandbase, The Marketing AI Institute, and others. While links shared from partners are not explicit endorsements, nor do they directly financially benefit Trust Insights, a commercial relationship exists for which Trust Insights may receive indirect financial benefit, and thus I may receive indirect financial benefit from them as well.
Thanks for subscribing and reading this far. I appreciate it. As always, thank you for your support, your attention, and your kindness.
See you next week,
Christopher S. Penn
You might also enjoy:
- Do People Use Social Media During the Holidays?
- Transforming People, Process, and Technology
- Almost Timely News, December 3, 2023: AI Content Is Preferred Over Human Content
- Transforming People, Process, and Technology
- Almost Timely News, December 24, 2023: Why Mistral's Mixture of Experts is Such a Big Deal
Want to read more like this from Christopher Penn? Get updates here:
Get your copy of AI For Marketers