AI Roundtable: Tangible Takeaways to Help Leverage Artificial Intelligence

2023-08-03 00:53:08

Private equity insights for and with top business builders, including investors, operators, executives and industry thought leaders. The Karma School of Business Podcast goes behind the scenes of PE, talking about business best practices and real-time industry trends. You'll learn from leading professionals and visionary business executives who will help you take action and enhance your life, whether you’re at a PE firm, a portco or a private or public company. BluWave Founder & CEO Sean Mooney hosts the Private Equity Karma School of Business Podcast. BluWave is the business builders’ network for private equity grade due diligence and value creation needs. To learn more, visit: https://bit.ly/3oPBjs8

5Speaker 5
00:10.56 – 00:43.98

Welcome to the Karma School of Business, a podcast about the private equity industry, business best practices and real-time trends. This episode is a special presentation of a webinar we recorded with some of the very best experts in AI from our private equity client base and our business builder network. We've got some important precursor steps needed to adopt AI key technologies, things you can do right now and a lens into the future of AI. This episode is brought to you today by Bluewave. I'm Sean Mooney, Bluewave's founder and CEO.

00:44.54 – 00:58.92

Bluewave is the go-to expert of those with expertise. Bluewave connects proactive business builders, including more than 500 of the world's leading private equity firms, to the very best service providers for their critical variable, on-point and on-time business needs.

01:04.66 – 01:25.56

I'm very pleased to be joined by Alex Kostrounis, Nick Capone, Ken McLaren and Keith Thomas. What we'll do briefly here is make introductions from each of the panelists, so you understand who's joining us today and the insights that they're bringing. To kick things off, Alex, can you give us a quick intro?

1Speaker 1
01:27.40 – 01:43.38

Thanks Sean. Hey everyone, I'm Alex Kostrounis. I'm the founder and CEO of Live.AI. We're an AI strategy consulting and business training company that helps companies demystify and understand AI and develop responsible AI strategies to drive business growth and customer success.

01:43.82 – 01:55.68

I'm also a professor of artificial intelligence at Northwestern University's Kellogg School of Management. As part of their MBAI program, I'm the author of a book called AI for People and Business. Great to be here, thanks.

5Speaker 5
01:57.40 – 01:57.86

How about yourself?

4Speaker 4
01:58.60 – 02:10.54

Thanks Sean. Hey everyone, My name is Nick Capone. I lead digital at Access Holdings, among other things. Thanks to Sean and Blue, who's been an incredible partner to us throughout the years.

02:12.26 – 02:49.94

At Access, we aspire and we're very early in the journey, but we aspire to build what we call the next generation private equity firm. And analytics and data is central to that. Thinking through how do we apply all these technologies to improve what we do as a sponsor across the investment life cycle, but then also for value creation in our portfolio businesses? Prior to access, I was a consultant. I was with McKinsey for six years, primarily focused on digital business building and innovation strategy, and started off my career as a software engineer and startup founder. Looking forward to being on this panel with everyone.

5Speaker 5
02:51.76 – 02:52.74

Ken, how about yourself?

2Speaker 2
02:53.56 – 03:06.56

Hey, nice to see everyone. Ken McLaren, part of Fraser Healthcare Partners If you don't know Fraser. We're a mid-market, healthcare-focused PE firm investing at a fund 10 so about $1.5 billion fund exclusively focused on healthcare for 32 years. That's all we do.

03:06.82 – 03:31.24

To Sean's point, up front, we believe significantly in value building. Our Center of Excellence team, which I'm a part of, actually has more members than our investment team, which is a little bit unique in the mid-market. But really, we're close to build. Value is what we do. Data and AI is the vertical that I lead, and so we've been investing behind data and AI as a strategy for the last three years. Just really believe in the value it will bring to our portfolio companies. I'm excited to be here.

03:31.40 – 03:36.94

Prior to Fraser, I spent about 20 years as an executive, building and leading data analytics businesses in the healthcare space.

5Speaker 5
03:38.20 – 03:40.56

That's great. Thanks Ken Keith, bring us home.

1Speaker 1
03:41.86 – 03:42.66

Thanks, Keith Thomas.

3Speaker 3
03:43.10 – 04:10.16

AT&T Cybersecurity I've been with AT&T for a little over 14 years, I've got about a 25-year track record in it, wearing all kinds of hats. Today. We've been really fortunate in looking at the AI space and trying to understand how to implement AI tools and other cybersecurity technologies safely. For our customers to consume, and for businesses like the partners that are here today to consume and use safely, great.

5Speaker 5
04:10.88 – 04:45.08

Thank you, Keith. As we kick off here, maybe to give people a sense for agenda, we're going to talk a. Most companies should be thinking about before they really are able to activate the AI journey. Some of the tools that are going to be available or are available right now. And then maybe a lens into where the future is and how quickly things will change. As we get into the first part of the webinar here, I'd like to maybe set the stage. Jumping into AI with both feet is all well and good.

04:45.08 – 05:12.56

I think people have to do it in working with private equity firms in support of this journey. We found a number of things should probably be done in advance. That are going to have maybe more immediate roi, but also are going to enable the effectiveness of your AI journey. To get started off, I'd love to get some of your thoughts, Nick, about what are some of these precursor activities that people should be thinking about?

4Speaker 4
05:13.52 – 05:34.40

Yeah, for sure, I'll lean back on my consulting days. When we did these big digital transformations, McKinsey We typically have almost like a three-layer conceptual model when we thought about these big transformations. We have strategy at the top, then you have your foundational enablers in the middle and the bottom, you have execution and change management to actually roll this out.

05:36.00 – 06:06.62

It starts with strategy. I think that's the first point I'd make when it comes to this understanding where the value is. Understanding how you're going to prioritize things, the basics of a good strategy. It really sets your strategic compass for when you deploy these technologies, and that strategy needs to be tied to your strategy for using AI. Obviously, it needs to tie to your broader digital strategy, which needs to tie to your broader business strategy. As a firm, where the value is, where you're going to focus on.

06:06.62 – 06:30.34

I'd also kind of bifurcate it, because when we say AI, it's a broad spectrum of things. You have your traditional analytics, which is descriptive analytics, just getting stuff on a screen and reporting. Then you have your more predictive analytics for predicting the future, then prescriptive analytics predicting the future. And then actually doing something about it automatically.

06:31.94 – 06:35.42

With those kind of use cases, the value is well-known.

06:37.14 – 07:25.56

It's a bit more mature, so you could be a bit more systematic. With a strategy of taking some of these best practices, applying them to your specific business context versus something like generative AI, which I think is what we're all kind of excited to talk about here, like Chat, GPT and LLMS and things like that, where we know there's a ton of value on the table, but it's still new. The way you'd approach that strategy is a bit more iterative, a bit more experimental. Trying to get use cases, and then experimenting as soon as you can to figure out where the value is. But either case, even if you're in well-trodden waters or experimenting with something new. Just kind of having that strategic compass, knowing where the value is and how it relates to what you are trying to achieve as a business. And then the second level, below that, I'll talk about foundational enablers.

07:25.78 – 07:58.50

So the biggest one here is obviously data, you need to do analytics on something, so it's getting your data in order, oftentimes when you do some of these big. When I've done some of these big analytics projects in the past, 80 90 of the effort is just getting the data centralized and clean. And almost like analytics is like the fun part once you could actually get to that, once your data is all there. So that's definitely something everyone should be doing now as a no-brainer to really extract the value from some of these more advanced analytics capabilities.

07:59.34 – 08:02.66

And there's different ways you can do that, depending on how complex your organization.

08:04.52 – 08:31.08

Is there's a data platform? There's a Microsoft Azure kind of data platform that we roll out at all of our portfolio. Businesses that kind of ingest data from all their source systems services for analytics and then sends it over to us at Access for portfolio monitoring and fund valuations and things like that. So just getting kind of your data ecosystem in order is critical. Some of the other enablers here are talent and technology.

08:32.68 – 09:01.64

And there's a build versus buy kind of question when it comes to those things, how much do you in-source versus partner with? And the answer will depend on kind of your specific context, but definitely important ones to think through. And then, finally, my one last comment, kind of on the change management piece. Having done a lot of these digital transformations before. I think one of the biggest predictors of success is a champion inside the organization that could really own the vision and drive the opportunity.

09:02.00 – 09:20.96

And often that's kind of from the CEO, or someone the CEO directly holds accountable for the digital agenda. And really having kind of that leadership voice to set the vision and drive the organization and mobilize change is critical to success for analytics and any other kind of major digital transformation.

5Speaker 5
09:21.98 – 09:53.84

Nick, I thought you brought up a lot of really good points and one I think is so important is just the basics. You know, you've got to do the unglamorous data cleanliness part, and you know, when I was investing in information and data and analytics businesses. And certainly everyone here at Blue Wave here is the same. Is, you know, the only thing worse than no data is bad data. And so you've got to do the unglamorous part of making sure that stuff's good and keep it good. Because it's like a piece of equipment that's got to be maintained anytime there's rotation and force in anything that wants to lose calibration.

09:54.48 – 09:55.92

So I thought that was a great point.

09:58.12 – 10:13.90

You're going to get a lot of roi out of visualizing it and analyzing it, and don't forget that type of really, really good precursor things. And then it's the change management we can talk a little bit later about. Also, you know, AI is going to be part of your strategy as a tactic.

10:14.12 – 10:38.38

It's not your strategy. So I think there was a lot in there that was extremely helpful. And so if we think about that, you're on this journey, you've got your data, it's clean, you're analyzing it, you're getting ready to kick off the AI. Keith, What are some of the things that any company should be really thoughtful about in terms of protecting the castle? As you're building kind of these data assets up?

3Speaker 3
10:40.00 – 11:01.28

Yeah, absolutely, there's some great points here, I love that you said. Change management, first of all, because if you don't have a structured change management to support the integrity of the data being put in, then you're going to end up with. We'll call it data poisoning, but it could be inaccuracies in your data that then throw everything else off and we don't want to see that.

11:01.58 – 11:33.22

So we want to make sure that organizations protect their data, that they're actually ingesting and definitely using. A change management process is highly important as these dependent as these AI systems get rolled out. And Nick, you had mentioned that you had met your different organizations. There's a dependency on AI at this point. And if you don't get that data, if you don't get those analytics that you're looking for. Because the AI system goes down or becomes unavailable, then how does your organization respond to that?

11:33.66 – 12:22.74

And so it's a very important piece that you want to make sure that you have some type of disaster recovery failover capability. Even if it is to go to a manual approach, that's okay. Having the plan is the most important part of that. And then, finally, I'll say one more thing, Sean, which is. We're going to invest a lot of time, a lot of resources into building these data models, into building these systems. And we want to make sure that we protect them from theft. Making sure that if someone gets into our organization, that they can't pull that model out and take it with them to use somewhere else. And there's some ways that we protect, using different security tools and different security capabilities to support the idea of a model theft by attackers.

5Speaker 5
12:23.96 – 12:47.96

That's great, I think those are great points. And once again, we're seeing this theme of failing to prepare is preparing to fail. And so you've got to do the work in advance. Not just even on the data and the analytics side, but also on protecting your data. You know, at Blue Wave, we call kind of the cybersecurity issue, our Friday at five call, because it's always Friday at five.

12:48.66 – 13:26.96

And there are things that large companies certainly have bigger resources for, but I'll tell you just through the everyday. Here. There are all sorts of resources available to SMBS and any size company that can do a lot to protect your organization. And in some ways, it's increasingly most critical assets your data. And so if you're looking for this, you can go to almost any. MSP can take you a long way as a business, and so I think this is a great way to start is doing the precursor work. That's maybe not as glamorous, but that's going to enable you to do a lot of the really cool, fun stuff in the days ahead here.

13:27.66 – 13:59.74

So you have your systems protected, you're cleaning your data, you're visualizing, you're analyzing, you're change management, and you're ready to start putting AI in place. Let's talk about some of the tech that people and business leaders should be thinking about. You know, considering beyond, above and beyond, maybe even some of the consumer available LLMs like Chat, GPT and Board, etc. So Ken, I'd be curious, what's your thoughts on some of the best in class tools and tech stacks that businesses should be thinking about as they get going on this journey?

2Speaker 2
14:00.70 – 14:12.76

Yep, thanks, Sean. And I'd love to preamble because I think a lot of people like to jump into the tech and the AI. But getting the foundations in place first is critical, but once you've got those foundations, I think technology is important. We still do most of our prototyping on desktop.

14:12.98 – 14:53.78

So once you've got your data in place, you know, just using Jupyter, Notebooks, Python, your toolkit, you know, our Scikit, PyTorch, Tensorflow. Everyone has their own tool of the trade. But we do a lot of prototyping on desktops. And, you know, as we prove the value and the use cases, we then start getting ready for production. But, you know, don't build in production. First, get the kind of proof value with your customer market in place before you start building. When we're ready to build, we do. Like Microsoft Azure, we actually say we're cloud agnostic, but the reality of being in mid market healthcare is the majority of our portfolio companies in Microsoft Office, the majority of our companies are already using Azure Cloud in some ways.

14:53.88 – 15:15.58

So it's a natural step, and we do really love the tooling that Microsoft has been putting in place. We work with other cloud providers as well, but Microsoft Azure is just an easy path for us. And we really like to Keith's point before that. We've got a lot of good terms and conditions cybersecurity, data privacy, active directory. A lot of the stuff you don't want to be thinking about with AI kind of comes out of the box with Microsoft.

15:18.08 – 15:45.72

From there, the business has been investing, Microsoft is investing heavily behind AI, so not just the OpenAI partnership, but there's your ML environment. Before that, you know, the cognitive services, the open source tooling that they bring in. So you can natively work in Databricks and Spark, you can use Kubernetes and Kafka. And so whether you're streaming or batching, your tool of choice is pretty much available for you there. So it's a good platform and a good chase you for all of those reasons.

15:47.40 – 16:12.24

A lot of good success working there. The number one thing we always will start with is just having a good data lake infrastructure. You can pick some of your tools around that. But it's not just the clean data, it's that that data is hosted and production ready. So having your data pipes with things like Azure Data Factory, having good storage, whether it's Azure Data Lake storage or using Databricks Delta Lake. On top of that, having a production ready data environment is important.

16:12.92 – 16:36.10

And then once you've got your models ready, really thinking about the productionalization again. You can do a lot through Azure ML, but you can plug in a lot of open source tools, so there is. There's really no one platform to rule at all. There's a lot of best of breed tools. But whether it is Azure or Google or AWS, you've got good environments to work in. And we just probably spend 80 of our time in Azure. For the reasons I mentioned before.

16:36.20 – 16:56.76

And they continue to invest in and innovate in that platform space. So we see a lot of great benefits because of the healthcare world that we live in. Privacy, security, easy access, reasonable, scaled, production, ready tools is really important to us. We're not a hyperscaled organization, so we can get a lot of good kind of bang for buck and move fast.

16:57.04 – 17:03.72

So good tool for us to use. Most of our vendors and partners have experience with it. So it's pretty easy to get talent in there and move pretty fast.

5Speaker 5
17:04.74 – 17:40.10

Yeah, Ken, and that's great. And I think, particularly with your background in healthcare, there's all sorts of much higher order kind of things to think about. In terms of HIPAA data and very sensitive information, we've heard a lot from our clients that they're probably the earliest that, you know, adopting Microsoft. Azure it, particularly as it relates to kind of the open AI partnership and the confidentiality of it. So we're going to go deeper into this. But can you talk about maybe some of the things that you've seen that Azure kind of solves? Particularly as you try to bring in GPT-like capabilities into organizations.

2Speaker 2
17:41.08 – 18:02.02

For sure, so just in general, I'd say yes out of the box. Like Azure's posture around cybersecurity, data privacy, Active directory, you get a lot of just security compliance out of the box. And certainly putting that in place is critical. As Keith shared up front, we love where AI is going, We're intrigued by the use cases Gen AI is opening up.

18:02.40 – 18:35.98

Many of our portfolio companies are concerned about using some of the open tools. Because it's not clear what will happen to the data that goes into a prompt. Will it be used to fine tune or train a model, and eventually, what happens to that data? I think the open tools are starting to catch up and share some better language around protecting user data. But we still guide our portfolio companies for sensitive business data, customer data. Keep it out of any open tool. And use the protection of the Microsoft Azure environment, where open AI services and Microsoft has strong protections for business and customer data.

18:37.10 – 19:03.80

And again, to the healthcare point. Sean Yes, for like, HIPAA and PHI. We do a lot of work just to make sure those environments are protected in the right ways. For not just our businesses and teams, but our customers and patients, that are all impacted by the data that's there, so it's pretty critical for us, and we certainly do guide in those directions. And like the Microsoft terms and conditions around the commitments not to use open AI data in any of the underlying models that they train.

5Speaker 5
19:04.42 – 19:19.10

Yeah, and that's a spot on, and so I appreciate that. So Alex, what about you? What are some of the things that you're seeing in terms of what types of tech stacks and tools that companies are starting to adopt to now enable the activities?

1Speaker 1
19:20.64 – 20:05.04

Yeah, absolutely. I mean, as Penn said, there's multiple cloud platforms out there that are really quite powerful, do amazing things. As we've seen in sort of software development in general, there's sort of this movement more and more towards, like, no code, low code solutions. And part of the benefit of those things is one accessibility. And making it easier for people in organizations to sort of build software. Or in this case, train models, iterate on models, optimize them, deploy them, and so on. But also sort of gives you the ability to abstract away some of the underlying devops or orchestration that needs to be done. Or, most importantly, sometimes governance, right?

20:05.10 – 20:29.72

Like model governance and data pipeline governance, and so on. So, in addition to the kind of Azure offerings that Ken had talked about. I think Google has released recently their generative AI studio as part of Vertex. And it's really quite interesting. Because I think, if you think of like the superhero movies, right, Iron Man with Jarvis, and I think in Black Panther they have something like that.

20:30.48 – 21:28.90

You know a lot of the way that AI could be really powerful, using, especially the conversational interfaces and natural language interfaces. Isn't so much just having the parameters of a model like GPT-4 or Chat GPT to generate texts like if you're trying to write an email or summarize something. But rather to create this interface, that becomes sort of an information retrieval system or a question answering system on top of your data. And I think that's really we're going to see a lot of the real value in the already, but really in the near future. And I think some of the platforms out there, not just like Google, but also some of the open source stuff like Lane Chain, which I'll talk more about in a minute, are really sort of pioneering and pushing that a lot forward. So in the case of the generative AI studio, what's really amazing there is, you know? It gives you the ability to load up your data in different formats, whether it's sort of CSP or PDF, or text in other formats. Or what have you?

21:29.10 – 22:02.20

And then you can put on top of it. They have a model hub, and in that model hub you can choose either. You know, Google has their own model barred, which is similar to Chat GPT. The underlying model is actually Palm, but so you can choose different versions of that. But it's also a hub that has open source models like Mama and other models, so it really gives you a lot of flexibility there. To put a LLM interface like I'm talking about. On top of your data for information retrieval and question answering, as well as needing Google Search itself on top of your data, which is pretty powerful.

22:02.42 – 22:48.98

And it allows you to buy this actually between how much of the output of this generative AI is generated by the model parameters. In the same way. Like if you just went into Chat GPTs user interface and, you know, asked it to summarize something versus from your actual data. So you can kind of bias one way or another. Because obviously, one of the main concerns a lot of organizations would have are things like trustworthiness, hallucination and so on. So, you know, trying to get more towards a true informational retrieval system that you can rely on, and that's, excuse me, trustworthy. As well as it's all very containerized, where you can have your own encryption key that Google doesn't have access to. So it can be HIPAA compliant and everything else, and you can't get access to your data except yourself.

22:49.08 – 23:45.44

So it solves a lot of those issues that I know a lot of organizations are wondering when it comes to proprietary data, confidential data and intellectual property. And just kind of sending that off to sort of a closed source, proprietary API in the case of, like, you know, some of the open AI stuff. And then also allow us for a lot of that other sort of OPs and governance type stuff in terms of model tuning and iteration, and so on. One of the other things that's interesting with a tool like Lanechain, for example, is, you know, if you're just going into a user interface like ChaddBt. It's hard to track your prompts right, and like, versioning them, and as you're doing prompt engineering and so on. And so these kinds of frameworks like Lanechain really help you, excuse me, to templatize, if you will, your prompts and sort of also create variables in your prompts.

23:45.44 – 24:24.48

So you can sort of inject different things, you can iterate on the prompts, you can version them, and then you can also chain prompts. So, output of one LLM call becomes the input of another one. And it allows you to then set up these pretty sophisticated systems that not only do that chaining, but also can integrate with outside sources like the web or Wikipedia or other types of database. So on, APIS, so I think a lot of that, and, of course, Hugging Face, one of the really big open source options out there that's really compelling, has done a lot with making transformers widely accessible to folks.

5Speaker 5
24:25.82 – 24:41.20

That's interesting, I mean, I think it's really clear that a. I think Microsoft got an early start. According to Canon, they've got the most, I think, established kind of systems in place. But Google's catching up real quick, and my sense is that Google's probably had this stuff on the shelf.

24:41.32 – 24:47.46

They're just trying to decide how they want to kind of put the cards on the table for a while. Are you seeing some of that in the Google stack?

1Speaker 1
24:49.08 – 25:09.30

Yeah, I mean, for sure, and I know they have some partnerships now with some pretty big companies that are building on top of this. So I think Uber, if I'm not mistaken, or Uber Eats, is building now on that generative AI Vertex platform. I think Wayfair, I think one of the big travel companies, maybe it's kayak, I'm not 100 sure, but definitely.

25:09.48 – 25:38.18

And one thing worth mentioning, too, is there's also part of the data store, or the database. Kind of talked a bit about having a data lake and so on. One of the things that's also becoming really prevalent with these new generative AI sort of solutions is the idea of a vector database. And so Pinecone is a good example of that, and Promodb is another example of that. And these are ways to. I don't want to get too technical here.

25:38.30 – 25:41.22

So, try and summarize a very high level.

25:42.92 – 26:41.22

You have sort of unstructured data, like your text data, your documents, whatever it is. You can convert that into a very specific kind of numerical format that gets stored in a specific kind of database called a vector database. Which essentially sort of encodes all the semantic meaning of your unstructured natural language data and the contextual meaning of it. And that becomes very handy later on to do certain things, like putting that conversational interface on top of your data. Because now it allows your when you're doing queries by whether it's through a chat interface or something like that, to translate your query into pulling the right data out of the database to pass to the large language model without having to do like SQL queries or anything like that, or writing any sort of code. So it's almost sort of automated in that way, once you have your data stored, one of these vector databases.

5Speaker 5
26:42.92 – 27:04.58

That makes a ton of sense. And so I think what's clear to us is there's a lot of technical tools. There's a couple of leaders and that's going to change very quickly. And I can tell you, even personally. Blueway has been building our recommendation engines using multiple AI technologies for over a year. And we're already kind of replacing maybe a half of what we've already done.

27:04.94 – 27:11.36

And we started with the best in-class tools that were available a year ago, and so there's going to be requiring agility.

27:13.30 – 27:28.40

And new tools available. And you're going to be on a journey. And I think it shows you that there's some major titans helping. But there's some new things coming as well. And so Nick, let's jump as well into. You've got these tools at your disposal.

27:28.40 – 27:38.00

You've done your precursor. What are some of the most addressable use cases that companies should start thinking about this for most, like everyday companies can start doing today?

4Speaker 4
27:39.52 – 28:14.82

Yeah, I know, and a great commentary from Alex and Ken, and I was fiercely writing down notes. Because these are all issues that we're thinking of as well, trying to figure out how to give it access to our proprietary data and stuff like that. But, you know, as I think about use cases, kind of the construct that I find helpful is the power of talking. Specifically about generative AI. That the power of these large language models is tied to the power of language itself, because these things can synthetically generate language. You know, academically, language serves three functions it's languages information, languages expression and languages instruction.

28:15.00 – 28:53.84

So similarly, you can kind of think of bucket use cases for generative AI across those dimensions. So when it comes to information, this is really, and Ken touched on a bunch of this. It's really the power of these models to rapidly collect and synthesize data, information. And you really get, you know, something differentiating when you could connect that to your proprietary data. So this would be things like, you know, marketing customer research for marketing and sales function, report generation for customer operations. You know. Collect all of your customers data, feed it to them, and easy to read report automatically.

28:54.62 – 29:03.12

On the sponsor side, we do a lot of market research and we have these documents that we prepare using the Analyst associate capacity.

29:04.92 – 29:38.26

You know, generative AI, so I think about that, these kind of gen AI for information is almost like a, you know, Google on steroids kind of use case. And the value prop there is really when it comes to time savings, kind of. The next level for these kinds of models is, you know, languages isn't just information, it's not data, but it's also expressions, being able to convey, you know, thoughts and ideas. And you know, that's really the power of these models to generate kind of creative content on any topic, in any voice, in real time.

29:39.16 – 30:08.10

So these could be things like, you know, content marketing and sales is kind of the obvious one to start with, so content generation for personalized marketing campaigns. Can you create, you know, sales agents or chatbots for customer operations, you know, things like that? So kind of being able to create, kind of generating a question list for expert interviews and is one of the use cases that we've deployed on the sponsor side.

30:09.12 – 30:12.92

And then, finally, and this is where I think, you know, there's going to be a ton of value here.

30:15.10 – 30:50.94

Especially down the road would be, you know, language as instruction, so not only can you, you know, intelligently create language and content, but you could also use that to do things make to effect change in the world. So being able to generate code using these LMS, that's a perfect example. So being able to, you know, do software development, you know, cheaper and faster than before. I think you're going to start seeing the rise of agents that, you know, autonomous agents that can automate.

30:50.94 – 31:22.12

A lot of you know tasks that you use, so I've been hearing about, you know. Salesforce is launching Salesforce, GPT. And all these models that you know not only generate content for marketing campaigns, but can actually, you know, execute campaigns. It can bid on keywords, you know, things like that, to really drive automation. So I think there's so that's kind of exactly how I think about the different use cases. When it comes to what function I think we'll have, we'll see the highest value.

31:22.30 – 31:27.44

There's, you know, a few really obvious ones, so marketing and sales, like we said.

31:29.60 – 32:04.80

Marketing, customer research, sales agents, customer operations, so, you know, ports, chatbots, customer support. I think R&D and product development could be another big function where this stuff will add a ton of value. So being able to, you know, quickly, you know, test ideas. But also for rapid prototyping. So being able to use these models as kind of a man in the box, kind of MVP for product development. And then, you know, obviously software engineering, software development too, is going to be seeing a big uplift from Gen AI.

32:05.36 – 32:28.94

And then also data analytics, I almost see kind of some of these models as a really, well you know, a smart kind of analyst in your organization. That you could feed it data and have it run kind of ad hoc analytics and then use it in your data science, data analytics work. Yeah, so a few thoughts on use cases and some of the value is going to be in the early stages.

5Speaker 5
32:29.42 – 32:54.84

Yeah, I think those are spot on and maybe to give even some personal, you know, journey stuff. We've seen our content creation at Blue Egg go up 500 since using these generative engines, and arguably they're better SEOed. And so you can get some real value out of these things. I saw a statistic. Now this is not validated, so this might be a hallucination itself.

32:56.80 – 33:23.62

This now has had some AI generative aspect to it. And so there's going to be really huge increases in productivity. Kind of the magnitude that we saw on the internet in the 90s. That are going to take place. And then the real question, and maybe we'll talk about this a little bit later, is who is the beneficiary of that? If your coders, you know, should your coders be cheaper or faster, or both? you know? should your lawyers be cheaper or faster, or both?

33:23.62 – 33:41.96

Who gets that beneficial aspect? You know, the spoils of this productivity is going to be something I think humanity will be working through a lot of. And I think the points that you're bringing up are spot on use cases. What I think is kind of interesting is, in some ways, it's opposite of probably what they thought it would be.

33:42.04 – 33:52.10

They thought it would be kind of more, you know, robotic process, automation and plans, and then it would get to, you know, kind of mid-organization. And then creative. It seems like it's starting at creative.

33:53.62 – 34:25.86

Through the rest of the organization, with content and imagery like Dolly and whatnot. So I think those are really important things that every business should think about in terms of their own organizations. NICK So Keith, let's talk about this. So you've got these great engines that are amazing that you can feed things into, and they give these great distillations back to you. What are some of the things that companies should be considerate of in terms of using, you know, particularly the publicly available models and the implications that they could have on a company?

1Speaker 1
34:27.78 – 34:29.20

Sure, yeah.

3Speaker 3
34:29.30 – 34:51.62

We just heard a whole bunch of acronyms, a whole bunch of technologies and tools, and me, as a technology nerd, I was geeking out. So thank you all for that. There is some challenges with that, as you heard, and people who are not technology focused. There's a black box problem here, right? We don't necessarily know.

34:53.88 – 35:45.44

And so, you know, to Ken's point, they're building out their own infrastructure, they're building out their own platforms. And that's a way to reduce the black box problem of knowing what's behind all of these generative AIS, knowing that's behind all the reports that get built. So we want to make sure that you have an architecture and a design that people can follow and that we can look at as technology experts. And help align not just security, but align the integrity and the availability of these systems, so that they stay online and they stay available. And then to the point of what we put in there data privacy, and you know, I'll kind of keep going back to this. What is the data privacy rules that are in place to protect your organizations and your customers?

35:45.50 – 35:56.98

And how do we align that with our AI models, and how do we align it with all the different pools that we are going to build out our AI platform with?

5Speaker 5
35:58.26 – 36:08.36

Yep, and talk about that. So what happens if someone puts, you know, sensitive company data into chat? GPT with history turned on?

3Speaker 3
36:09.88 – 36:32.10

Yeah, so if you've got history turned on, well, then it becomes part of that AI system. It gets built into the models, and there's the ability for the model to use that data. What if it's poisoned data? what if it's corrupted information that's stuck in there? Then? That messes up your analysts, model, your analysis, and your models, and your reporting.

36:32.64 – 36:55.84

It could be something like malicious in there as well, and then that gives adversaries the ability to do an attack. It could be an attack to modify or corrupt the data, it could be an attack to try to take the data. There's lots of different ways that they could come in.

36:56.12 – 37:09.46

Vectors is what we call them, that they can come in. So those are a few of the ways, or a couple of the ways actually that you want to be aware of. When you're building out these models and looking at the overall architecture and design.

5Speaker 5
37:10.34 – 37:27.00

Yeah, and I think that's a really good point, because if you think about it, whether it's Chat, GPT or Bard. If you put that data in, you put your company's data comes in, that becomes part of the model. And then if that's something that's competitively sensitive or advantageous to your business, you've just given it to the world.

3Speaker 3
37:27.98 – 37:43.84

And so normally, yeah, Sean, normally. We'll want to have a privacy policy in place for our organization so that users of the AI platforms know what their company policy is and how and what they're allowed to put in. And then we also want to make sure.

37:45.80 – 37:59.80

So your company has multiple pools of data, we want to make sure that each employee only has access to the data that they need access to. That will prevent them from actually taking data inadvertently and putting it into an AI model.

5Speaker 5
38:00.76 – 38:14.94

Great lesson. Every company needs to have a policy on these engines, so people are very clear about what they can put in. And making sure that you just can't carte blanche. Copy paste your customer list and paste it in because it makes it easier.

1Speaker 1
38:16.12 – 38:16.60

Right?

5Speaker 5
38:17.34 – 38:43.70

But it's really tempting and really easy to do, and we certainly have the same temptations with our team. But people don't realize the secondary and tertiary effects that it could have in terms of the competitive protections that a company has. So I think those are great. So, in order to leave a little bit of time for some q&A, I think let's do a little bit of a lightning round here. And so this is the million dollar question, and probably the billion dollar question.

38:45.64 – 39:06.88

Of where is all this going? And we're going to talk crystal ball time. The crystal ball on my desk is pretty hazy and it seems to be changing shape and form every time I show up in the morning. And so let's talk about where you all see kind of AI going in the visible future. And so, Alex, what are some of the things maybe that you think may take shape?

39:06.88 – 39:08.46

To the extent you can't.

1Speaker 1
39:09.92 – 39:15.06

Yeah, I mean, things are moving quickly. Just yesterday, I think, or a couple of days ago.

39:16.70 – 39:52.44

Adding multimodality to Bard and Palm. They did a demo where they took a picture of a software screen, like a mobile app screen. And then code was automatically generated, like actual functional code, just based on pixels of an image. So it's pretty remarkable, I think. Not only are we going to see these large language models keep evolving on the tech side, but we'll also see that multimodality. So, adding audio capabilities, which are really just sequences of images at a certain frame rate, and so on.

39:52.68 – 40:34.34

And so we'll go from right now generative models like CHAgGBT and GBT-4. Essentially, just keep iteratively predicting the next word, and that's what generates or the next token, and that's what generates text. But we could see that happening with video, for example, so given a sequence of frames of video, what's the next image or frame of video predicting? And then just keep recursively doing that or not too long. Instead of just saying hey, write an email, say, hey, I want a 30-second company explainer video. And the next thing, you know, it creates the whole script, the animations in it, the background music, the whole enchilada all at once.

40:34.96 – 41:00.98

Things are just advancing very quickly, as well as the real-world applications and use cases of some of this generative AI stuff. So, yeah, it's going to be moving quickly where we'll be even three months from now. But people need to get started, need to start learning about it. Don't wait, at least look at what's happening right now and start building small and prototyping out specific use cases.

5Speaker 5
41:01.68 – 41:07.24

And Alex, I think it's a good point. It's so easy to go overwhelmed by this and just say I'm just going to wait.

41:08.78 – 41:09.58

Don't wait.

1Speaker 1
41:11.74 – 41:14.28

And don't forget one last thing, sorry.

41:15.92 – 41:50.16

I believe Nick made this point earlier is more than just generative AI. The good thing about, I guess Chad DBT's release and being so exponentially increasing public awareness and interest in AI, is that it did exactly that. But on the other hand, it's also over-indexed for people on AI as being just LLMS. When in reality it's this massive field. And so when I say get started, it isn't just go all in on LLMS or generative AI. Don't forget, there's a lot you can do with AI and machine learning.

5Speaker 5
41:50.78 – 41:54.80

And it's an excellent point, Ken, how about you? What does your crystal ball say?

2Speaker 2
41:55.74 – 42:09.72

I agree with Alex, Hard to predict. What we can predict is the pace of change is going to be relentless and unlike what we've seen before, I think, is the message. So, get ready for rapid change. That's what we share with our leadership team is the pace of change is going to be much faster than what we've seen in the past decades.

42:11.14 – 42:33.22

Salma Altman, CEO of OpenAi, was interviewed just after ChatGPT came out. And he was asked by Lex Friedman on a good podcast show, What is GPT for? And he said It's a system that we'll look back at in the future and say it was a very early AI. It's slow, it's buggy, it doesn't do a lot of things very well. This is the CEO of his big new product launch, saying it's not that good. But now there were computers when they first launched.

42:33.32 – 43:01.64

And so they're going to get a lot better, and they're going to get better fast. So the other point I'd raise is which has really driven innovation for the last almost 60 years. So the number of transistors in a chip, or the cost per compute going at a rate of change of every two years, the power doubling or the cost halving? What we see now with AI algorithms is the power or the pace of change is almost every three to six months, the performance of AI algorithms is doubling.

43:02.84 – 43:29.64

The big tech have about 400 billion of operating cashflow annually that they're going to be investing behind this. And so you see, all of these dollars divert towards rapid innovation. From the first iPhone launch to iPhone 14, it took about 16 years to go from Gen one to Gen 14. Think about what would happen if ChatGpt's 14th version came out 16 months from now, instead of 16 years from now, the pace of change is going to be much faster.

43:29.84 – 43:54.94

And so for our businesses to be ready to adopt the new technology, but not anchor on ChatgPt. Or you pick your tool being the last and final. It's going to be the start of a long journey that's going to move quite quickly. So be agile, be ready for change, be have good foundations in place. With all the stuff the team talked about here today, be expecting of a pretty rigorous pace of change, and the future is really in front of us.

43:55.02 – 43:56.18

We're just getting started with this.

5Speaker 5
43:57.02 – 44:07.18

I think it's great advice and it's easy to be daunted, but it's better to get excited and if you get excited about it. Boy, the future is kind of uncapped. Nick, how about you?

4Speaker 4
44:08.34 – 44:24.28

Yeah, I mean, I'm a big believer that the generative AI is going to be as much transformative potential as some of the other big technologies we've seen in our lifetime. And the personal computer, the internet, the mobile internet, cloud, so it's going to be transformational.

44:27.28 – 45:01.32

And you'll probably be users of Generative AI, even if you're not trying to be like Google Search, Bing Search, your favorite CRM, Microsoft Copilot. These tools that we're already using are going to get enabled by Generative AI. And it's going to become like electricity or the internet or analytics, right? It's something foundational to something that businesses just need as table stakes. I think the way we're thinking about it is still very in the early days, but it's about experimenting. It's any time you need, obviously being careful of privacy and data and all that.

45:01.42 – 45:28.02

But any time you need to google something or search for something, try an LLM. Every time you need to generate content, try experimenting with an LLM. And it's through that you'll uncover really powerful use cases that can be scaled and productionized across your business. So I'd say, don't be afraid of it, experiment with it, find exciting use cases responsibly because it's transformative.

5Speaker 5
45:28.98 – 45:31.22

That's great, Keith. How about yourself?

3Speaker 3
45:32.32 – 45:44.52

Sure, I always think about it as how are we going to enhance our users experience? And that's something that generated AI. Obviously, today everyone's experimenting to what Nick just said, which is fantastic. I do it too.

45:44.64 – 46:12.42

And if you aren't, you should. I see some pretty big areas, actually, where AI is going to be very supportive for us. I think it was Bill Gates who said that the winners in AI are the ones who are going to create, the personal assistants, the ones that are going to help us. And so we think about how AI might be used in training, taking someone through a training program and being able to answer questions on the fly. And then also there are certain industries that don't have enough professionals to staff.

46:12.42 – 46:43.60

The position Cybersecurity is a huge industry, a tremendous industry where there isn't enough skills and skilled position workers to fill all the spaces. And so we'll see AI come in. And it won't necessarily replace those professionals, but it'll relieve these professionals of additional work that could be handed off to an AI platform to support. And then they can pivot and start working on things to improve and grow the business in different directions. So those are a few of the ways that I see AI helping us in the future.

5Speaker 5
46:43.98 – 46:49.24

I think also really, really important considerations, okay, well, we've had, I think.

46:50.90 – 47:26.90

A rapid fire of really insightful information. Here we have a few questions that have come in, so let me try to paraphrase if we can get to one or two of them. And so one of them is if you think about these hallucinations in different places during this conversation, and there's this propensity for errors. How do you think about applying some of these generative AIS in different use cases, and what use cases maybe are more appropriate than others? Given the fact that we don't quite know how it comes up with some of these answers, and why they're right, and why they're wrong in certain ways. Does anyone have a take on that?

2Speaker 2
47:27.86 – 47:38.94

I can take a quick go, Sean. So for our purpose again, in the healthcare space, very sensitive to ultimate use case if we were in a customer patient, market-facing position.

1Speaker 1
47:39.24 – 47:40.50

So, a human in the loop.

2Speaker 2
47:40.50 – 48:10.78

Is something we talk about quite a bit, using Gen AI, embracing it. But having a human in the loop in the process, so you're putting some gating around. It is something that we always advocate. Number one, two, where we think there can be some more scaled use cases. There's definitely the ability today to train your LLMs so you can fine tune them and you can really put a lot of guardrails around them. To say, here is our protocol, the way that we manage our communications, and by fine tuning and training, is a number of tools and techniques.

48:10.94 – 48:30.68

You heard Alex talk a bit about vector embedding. You can put the LLM on guardrails, still with human on a loop, but you can train it so it does what you kind of direct it to. So those are two initial thoughts and things that we spend time talking about. But responsible AI You heard a lot of different versions of that. Today is critically important, so that's definitely needed in our space.

5Speaker 5
48:31.98 – 49:02.34

And I think that's a great answer, and I think that's one of the other big themes that we touched on. A little bit is like, a lot of these are co-pilots, right? You're not supposed to let them off on their own. It's something that's going to drive productivity and enhancements, but you can't just let them untethered out into your customer bases or your users, et cetera. And certainly, that's something that will, I think, maybe for future conversations. We can talk about kind of the moral, the ethical, the compliance, kind of considerations that we should think about.

49:02.80 – 49:28.98

I think we have one more question that we can probably get to here, and it's more of the practical side. What do you think are some of the AI applications that can be used to maybe optimize some of the mid and back office functions within companies and drive savings? That might not necessarily be LLM, but could actually improve the efficiencies of companies through the middle of the business.

4Speaker 4
49:30.10 – 49:53.68

Yeah, I think that there's a lot. The easy examples are all kind of working in sales. But in terms of back office operations, I think the big one that comes to mind is kind of reporting and analytics in general. As you're doing that in your business. So being able to quickly synthesize customer data and generate reports on the private equity side, things like rapidly synthesizing.

49:55.20 – 50:24.64

Investment memos. Or go into a data room and list out all the interesting things, like the things that I kind of think of. A LLM model, really strong performing kind of analyst or associate, just another member of the team that you can point to different paths. And I mean, sometimes they're wrong, just like real people are wrong, but you have to kind of evaluate that. So I think time savings in the back end for things like knowledge discovery, information synthesis, report generation, that could have a huge impact.

5Speaker 5
50:25.18 – 50:54.86

I think that's going to be massive as well. The only other use case that I'll say that we see coming in from kind of. Our client base is around call centers, and so there's a lot of training. It's really more into the LLM side. But how do you resolve your customer's needs earlier? Using this kind of dynamic, bilateral, you know, kind of generative AI, which then lets your humans and your call centers work on the really hard stuff, identify the answers to the really obscure much quicker.

50:55.34 – 51:28.94

And so I think what we're seeing is, you know, it can have a cost savings impact. But it can also enable you to serve your customers in a better way, faster. And so that you know that 10 minute wait time can go to 30 seconds and you can get access to better information faster for your customers. And so that's something that we're, at least, you know, from what's coming in perspective. Seeing some helpful use cases, the only last question I have This sounds like a plug, but it's not. Are there any partners that can assist you with building out use cases?

51:30.28 – 51:57.74

And the answer is yes, a lot of them, we know a lot of them. But we'd be happy to help with this ecosystem that we're building out rapidly. That are addressable for, not only, you know, larger companies, but particularly SMBS. So that is all we have for today. I want to give really, really special thanks to Alex and Nick and Ken and Keith here for sharing these insights.

51:57.96 – 52:05.22

And maybe we'll get the band back together again in a few months and we'll say so, thank you so much everyone for joining us today.

52:08.16 – 52:24.70

For more information on how your business can be connected with top advisors, experts, and or consultants in the world of business intelligence, predictive Analytics, AI, or anything else related to building your business with more speed and certainty, please visit Bluewave.

52:24.70 – 52:42.04

Net that's b-l-u-w-a-v-e dot net. Please continue to look for the Karma School. Anywhere you find your favorite podcasts, including Apple, Google and Spotify, we truly appreciate your support. If you like what you hear, please follow, review and share.

52:42.18 – 52:48.68

It really helps us when you do that, so thank you in advance. In the meantime, let us know if there's anything we can do to support your success.

3Speaker 3
52:49.14 – 52:49.58

Onward.

v1.0.0.260408-1-a910ba6_os