A.I.’s Original Sin

This podcast is supported by Disney.

As a kid, I wanted to be an artist.

I was obsessed with Star Wars. My dream was to be a Disney performer.

When you work at Disney, dreams can come true. The Disney Aspire program will help cover the cost of education for eligible employees and cast members.

I get to work at Disney while pursuing my degree in Graphic Arts. Hospitality.

Because at Disney, we turn dreams into reality. Academically, professionally, and everything in between. Learn more at Aspire.Disney.com From the New York Times, I'm Michael Barbaro. This is The Daily.

Because if you're thinking about the future of these chatbots, that is defined by their past. The thing you have to realize is that these chatbots learn their skills by analyzing enormous amounts of digital data. So, what my colleagues and I wanted to do with our investigation was really focus on that effort to gather more data. We wanted to look at the type of data these companies were collecting, how they were gathering it, and how they were feeding it into their systems.

And when you all undertake this line of reporting, what do you end up finding?

We found that three major players in this race, OpenAI, Google, and Meta, as they were locked into this competition to develop better and better artificial intelligence, they were willing to do almost anything to get their hands on this data, including ignoring and, in some cases, violating corporate rules and wading into a legal gray area as they gathered this data.

Basically, cutting corners.

Cutting corners left and right.

Okay, let's start with OpenAI, the flashiest player of all.

The most interesting thing we found is that in late 2021, as OpenAI, the startup in San Francisco that built ChatGPT, as they were pulling together the fundamental technology that would power that chatbot, they ran out of data, essentially. They had used just about all the respectable English language text on the internet to build this system. And just let that sink in for a bit.

I mean, I'm trying to let that sink in. They basically, like a Pac-Man on an old game, just consumed almost all the English words on the internet, which is kind of unfathomable.

Wikipedia articles by the thousands, news articles, Reddit threads, digital books by the millions. We're talking about hundreds of billions, even trillions of words. So, by the end of 2021, OpenAI had no more English language text that they could feed into these systems. But their ambitions are such that they wanted even more.

Which suggests that from the very beginning, these companies, a company like OpenAI with ChatGPT, is starting to break, bend the rules.

Yes, they are determined to build this technology. Thus, they are willing to venture into what is a legal gray area.

So, given that, what does OpenAI do once it, as you had said, runs out of English language words to mop up and feed into this system?

So they get together and they say, all right, so what are our other options here? And they say, well, what about all the audio and video on the internet? We could transcribe all the audio and video, turn it into text, and feed that into their systems.

Interesting.

So a small team at OpenAI, which included its president and co-founder, Greg Brockman, built a speech recognition technology called Whisper, which could transcribe audio files into text with high accuracy. And then they gathered up all sorts of audio files from across the internet, including audio books, podcasts, and, most importantly, YouTube videos.

Of which there's a seemingly endless supply, right? Fair to say, maybe tens of millions of videos.

According to my reporting, we're talking about at least a million hours of YouTube videos were scraped off of that video sharing site, fed into this speech recognition system in order to produce new text for training. OpenAI's chatbot. And YouTube's terms of service do not allow a company like OpenAI to do this. YouTube, which is owned by Google, explicitly says you are not allowed to, in internet parlance, scrape videos en masse from across YouTube and use those videos to build a new application. That is exactly what OpenAI did.

So, Cade, this makes me want to understand what's going on over at Google, which, as we have talked about in the past on the show, is itself thinking about and developing its own artificial intelligence model and product.

Well, as OpenAI scrapes up all these YouTube videos and starts to use them to build their chatbot, according to my reporting, some employees at Google, at the very least, are aware that this is happening.

They are?

Yes. Now, when we went to the company about this, a Google spokesman said it did not know that OpenAI was scraping YouTube content and said the company takes legal action over this kind of thing when there's a clear reason to do so. But according to my reporting, at least some Google employees turned a blind eye to OpenAI's activities because Google was also using YouTube content to train its AI. So, if they raise a stink about what OpenAI is doing, they end up shining a spotlight on themselves, and they don't want to do that.

I guess I want to understand what Google's relationship is to YouTube, because, of course, Google owns YouTube. So, what is it allowed or not allowed to do when it comes to feeding YouTube data into Google's AI models?

It's an important distinction. Because Google owns YouTube, it defines what can be done with that data. And Google argues that it has a right to that data, that its terms of service allow it to use that data. However, because of that copyright issue, because the copyright to those videos belong to you and I, lawyers who I've spoken to, say people could take Google to court and try to determine whether or not those terms of service really allow Google to do this. There's another legal gray area here where, although Google argues that it's okay, others may argue it's not.

Of course, what makes this all so interesting is you essentially have one tech company, Google, keeping another tech company, OpenAI's, dirty little secret about basically stealing from YouTube because it doesn't want people to know that it, too, is taking from YouTube. And so, these companies are essentially enabling each other, as they simultaneously seem to be bending or breaking the rules.

What this shows is that there is this belief, and it has been there for years within these companies, among their researchers, that they have a right to this data because they're on a larger mission to build a technology that they believe will transform the world. And if you really want to understand this attitude, you can look at our reporting from inside Meta.

And so, what does Meta end up doing, according to your reporting?

Well, like Google and other companies, Meta had to scramble to build artificial intelligence that could compete with OpenAI. Mark Zuckerberg is calling engineers and executives at all hours, pushing them to acquire this data that is needed to improve the chatbot. And at one point, my colleagues and I got hold of recordings of these Meta executives and engineers discussing this problem, how they could get their hands on more data, where they should try to find it, and they explored all sorts of options. They talked about licensing books one by one at $10 a pop and feeding those into the model. They even discussed acquiring the book publisher Simon & Schuster and feeding its entire library into their AI model.

Interesting. So they go from having conversations like, should we buy a publisher that has tons of copyrighted material, suggesting that they're very conscious of the kind of legal terrain and what's right and what's wrong, and instead say, nah, let's just follow the OpenAI model, that blueprint, and just do what we want to do, do what we think we have a right to do, which is to kind of just gobble up all this material across the internet.

It's a snapshot of that Silicon Valley attitude that we talked about. Because they believe they are building this transformative technology,

But what that means is that there is, at the birth of this technology, a kind of original sin that can't really be erased.

It can't be erased, and people are beginning to notice, and they are beginning to sue these companies over it. These companies have to have this copyrighted data to build their systems. It is fundamental to their creation. If a lawsuit bars them from using that copyrighted data, that could bring down this technology.

We'll be right back.

Hello,

using recipes that feature some of our favorite summer produce. Yuande, what did you bring? So this is a cucumber agua fresca.

It's made with fresh cucumbers,

ginger, and lime.

How did you get it so green? I kept the cucumber skins on.

and pureed the entire thing. It's really easy to put together, and it's something that you can do in advance.

Oh, it is so refreshing.

What did you bring, Melissa?

Well, strawberries are extra delicious this time of year, so I brought my little strawberry almond cakes.

Oh, yum.

I roast the strawberries before I mix them into the batter. It helps condense the berries' juices and stops them from leaking all over.

and getting the crumb too soft. Mmm. You get little pockets of concentrated strawberry flavor. It tastes amazing. Oh, thanks.

New York Times Cooking has so many easy recipes to fit your summer plans.

Find them all at nytcooking.com. I have sticky strawberry juice all over my fingers.

These suits are coming from a wide range of places. They're coming from computer programmers who are concerned that their computer programs have been fed into these systems. They're coming from book authors who have seen their books being used. They're coming from publishing companies. They're coming from news corporations like the New York Times, incidentally, which has filed a lawsuit against OpenAI and Microsoft.

Mmm-hmm.

News organizations that are concerned over their news articles being used to build these systems.

And here, I think it's important to say, as a matter of transparency, Cade, that your reporting is separate from that lawsuit. That lawsuit was filed by the business side of the New York Times, by people who are not involved in your reporting or in this daily episode, just to get that out of the way.

Exactly.

I'm assuming that you have spoken to many lawyers about this, and I wonder if there's some insight that you can shed on the basic legal terrain. I mean, do the companies seem to have a strong case that they have a right to this information, or do companies like the Times who are suing them seem to have a pretty strong case that, no, that decision violates their copyrighted materials?

Like so many legal questions, this is incredibly complicated. It comes down to what's called fair use, which is a part of copyright law that determines whether companies can use copyrighted data to build new things. And there are many factors that go into this. There are good arguments on the open AI side. There are good arguments on the New York Times side.

Interesting.

And here, the suit between the New York Times company and open AI is illustrative. If the New York Times creates articles that are then used to build a chatbot, does that chatbot end up competing with the New York Times? Do people end up going to that chatbot for their information rather than going to the Times website and actually reading the article? That is one of the questions that will end up deciding this case and cases like it.

So what would it mean for these AI companies, for some or even all of these lawsuits to succeed?

Well, if these tech companies are required to license the copyrighted data that goes into their systems, if they're required to pay for it, that becomes a problem for these companies. We're talking about digital data the size of the entire Internet. Licensing all that copyrighted data is not necessarily feasible. We quote the venture capital firm Andreessen Horowitz in our story, where one of their lawyers says that it does not work for these companies to license that data. It's too expensive.

It would essentially make this technology economically impractical.

Exactly. So. a jury or a judge or a law ruling against open AI could fundamentally change the way this technology is built. The extreme case is these companies are no longer allowed to use copyrighted material and building these chatbots. And that means they have to start from scratch.

And, conversely, what happens if the courts rule in favor of these companies and say, you know what? This is fair use. You were fine to have scraped this material and to keep borrowing this material into the future free of charge.

Well, one significant roadblock drops for these companies, and they can continue to gather up all that extra data, including images and sounds and videos, and build increasingly powerful systems. But, the thing is, even if they can access as much copyrighted material as they want, these companies may still run into a problem. Pretty soon, they're going to run out of digital data on the internet. That human-created data they rely on is going to dry up. They're using up this data faster than humans create it.

in that case, what would these tech companies do? I mean, where are they going to go if they've already scraped YouTube? If they've already scraped podcasts? If they've already gobbled up the internet? and that, altogether, is not sufficient?

What many people inside these companies will tell you, including Sam Altman, the chief executive of OpenAI, they'll tell you that what they will turn to is what's called synthetic data.

And what is that?

That is, data generated by an AI model that is then used to build a better AI model. It's AI helping to build better AI. That is the vision, ultimately, they have for the future that they won't need all this human-generated text. They'll just have the AI build the text that will feed future versions of AI.

So, they will feed the AI systems the material that the AI systems themselves create. But is that really a workable,

solid plan?

Is that considered high-quality data? Is that good enough?

If you do this on a large scale, you quickly run into problems. As we all know, as we've discussed on this podcast, these systems make mistakes. They hallucinate. They make stuff up. They show biases that they've learned from Internet data.

What you're really saying is these AI machines need the unique perfection of the human creative mind.

Well, as it stands today, that is absolutely the case. But these companies have grand visions for where this will go. And they feel, and they're already starting to experiment with this, that if you have an AI system that is sufficiently powerful, if you make a copy of it, if you have two of these AI models, one can produce new data and the other one can judge that data. It can curate that data as a human would. It can provide the human judgment, so to speak.

It feels like the real lesson of your investigation is that if you have to allegedly steal data to feed your AI model and make it economically feasible, then maybe you have a pretty broken model. And that if you need to create fake data as a result, which, as you just said, kind of undermines AI's goal of mimicking human thinking and language, then maybe you really have a broken model. And so that makes me wonder if the folks you talk to, the companies that we're focused on here, ever ask themselves the question, could we do this differently? Could we create an AI model that just needs a lot less data?

They have thought about other models for decades. The thing to realize here is that that is much easier said than done. We're talking about creating systems that can mimic the human brain. That is an incredibly ambitious task. And after struggling with that for decades, these companies have finally stumbled on something that they feel works, that is a path to that incredibly ambitious goal, and they're going to continue to push in that direction.

But what if the tech companies never get enough or make enough data to get where they think they want to go, even as they're knocking down walls along the way? That does seem like a real possibility.

If these companies can't get their hands on more data, then these technologies, as they're built today, stop improving.

Okay. Thank you very much. We appreciate that.

Glad to be here.

We'll be right back.

that we don't want to see.

a wider regional war. But emphasized that a final call about retaliation was up to Israel. Israel is a sovereign country. They have to make their own decisions about how best to defend themselves.

The day ended.

without a single juror being chosen.

or customize to better fit your investing goals, all in a few clicks. Schwab Investing Themes.

is not intended.

to be investment advice or a recommendation of any stock or investment strategy. Learn more at schwab.com slash thematic investing.