The Ballad of ‘Deepfake Drake’

2023-04-28 00:26:20

This is what the news should sound like. The biggest stories of our time, told by the best journalists in the world. Hosted by Michael Barbaro and Sabrina Tavernise. Twenty minutes a day, five days a week, ready by 6 a.m. Listen to this podcast in New York Times Audio, our new iOS app for news subscribers. Download now at nytimes.com/audioapp

1Speaker 1
00:00.00 – 00:02.66

Hi, it's Alexa Weibel from New York Times Cooking.

2Speaker 2
00:03.00 – 00:21.68

We've got tons of easy weeknight recipes, and today I'm making my vegetarian mushroom shawarma pitas. This recipe is just built for efficiency. You toss your mushrooms and red onion in your spices, throw them in the oven. By the time they're done, you've chopped your cabbage and you're ready to assemble. It feels crazy that this takes just 20 minutes of active time.

00:21.90 – 00:26.56

It's just delicious. New York Times Cooking has you covered with easy dishes for busy weeknights.

1Speaker 1
00:26.84 – 00:28.66

You can find more at nytcooking.

00:28.66 – 00:29.14

Com.

00:31.52 – 00:35.62

From The New York Times, I'm Sabrina Tavernisi and this is the Daily.

00:43.08 – 01:03.36

When an anonymous music producer used artificial intelligence to impersonate Drake earlier this month, it jolted the music industry. Today. My colleague Joe Coscarelli on the rise and fall of one AI song and what it means for the future of music.

01:13.02 – 01:15.38

It's Friday, April 28th.

01:21.88 – 01:23.56

Joe, welcome to the show.

2Speaker 2
01:23.96 – 01:24.88

Hey, thanks for having me.

1Speaker 1
01:25.80 – 01:46.92

You are a music reporter, that's the world you cover, but this is an episode about artificial intelligence, and artificial intelligence. AI is something we've covered a lot on the show, but never when it comes to music. So tell me how these two things came together for you in your recent reporting?

2Speaker 2
01:48.12 – 02:51.76

So there's obviously been a lot of buzz about AI in recent months. All across all my social media, television, cover of our newspaper, chatbots and image generators, I'm thinking of Chat GPT. Everyone's saying they're the next big thing. What do they mean for various industries? But in my world, the people who make popular music, fans of popular music, and the people who build businesses around pop music. AI hadn't really been a thing. There had been some experiments with AI on the fringes of the music business over the years, but it always seemed a little bit academic or niche. They weren't really touching mainstream culture, they weren't used by the biggest producers, or it didn't involve the biggest artists. And these are the people that I tend to cover, to write about and to listen to. But then over the last few weeks, there was this massive change. It started, like most things in pop music. On social media. I started to see videos on my feeds on TikTok, on Instagram, on Twitter, and it just really felt like a moment.

02:51.96 – 02:55.34

And what I was seeing mostly were novelty.

1Speaker 1
02:55.98 – 03:00.94

Somebody once told me, the world is gonna roll me ♪.

2Speaker 2
03:00.94 – 03:21.42

There are memes, they are covers essentially of familiar music, familiar songs and artists, very popular ones, but computer generated too many times before a Beyonce song, Cuff it as sung by A.I Rihanna.

1Speaker 1
03:21.46 – 03:26.62

So excited, so excited. I'm a seasoned professional ♪.

2Speaker 2
03:26.62 – 03:42.40

Or Kanye West doing Hey there Delilah by the plain white T's Hey there Delilah. What's it like in New York City? I'm a thousand miles away, but girl, tonight you look so pretty. Yes, you do.

03:43.52 – 04:01.50

These really strange combinations, but ones that people were obviously taking notice of. Because who wouldn't want to hear their favorite rapper rap a song by their other favorite rapper? It's just, you know, it's a strange mashup.

1Speaker 1
04:01.78 – 04:04.24

So kind of like a deepfake, but for music.

2Speaker 2
04:04.96 – 04:06.44

Exactly these a.

04:06.44 – 04:20.30

I vocal technologies have gotten better and better at generating human voices, especially voices we're familiar with, like Donald Trump and Joe Biden. Hey guys, can we talk for a minute? I'm feeling a bit overwhelmed with everything going on.

1Speaker 1
04:20.72 – 04:22.18

Of course, Joe, what's on your mind?

2Speaker 2
04:22.56 – 04:37.10

It's just that the weight of the presidency can be a lot to bear. The decisions I make impact the lives of millions of people. And I feel like I'm constantly under a microscope. I know exactly how you feel, Joe. There were times when I felt like the media.

1Speaker 1
04:37.10 – 04:39.28

Was always looking for a way to bring me down.

2Speaker 2
04:41.02 – 04:41.14

So I feel like the way that the a.

04:41.14 – 04:48.48

I vocals are trained from actual recordings, they're extremely accurate when it comes to people who we hear from a lot.

1Speaker 1
04:48.58 – 04:49.84

Because there's so many recordings.

2Speaker 2
04:50.24 – 04:58.18

Exactly, and it sort of drew people's attention to the possibilities that were starting to become available from this a.

04:58.18 – 05:03.74

I technology and people could do this at home, on their own laptops, in only a few minutes.

1Speaker 1
05:04.24 – 05:16.38

Right, so as people like having fun, just kind of like spoofing or kind of covering. Using their computers, their favorite songs, using voices from their favorite artists from other places.

2Speaker 2
05:17.00 – 05:20.72

Yeah, like, what would it be like if Nicki Minaj did a Frank Sinatra song?

1Speaker 1
05:21.52 – 05:22.62

What was it like?

2Speaker 2
05:22.80 – 05:24.20

I haven't heard that one, thankfully.

1Speaker 1
05:25.86 – 05:29.02

Okay, so it's fun, but it's kind of a novelty.

2Speaker 2
05:29.60 – 05:44.52

Yeah, you would see these things pop up on Instagram, on TikTok, on Twitter. And they were lightweight, they were harmless, but they sort of foretold all of this potential for how this technology could be used in the music industry.

05:46.66 – 06:11.74

And then a couple of weeks ago, in the middle of April, I'm lying in bed on a Saturday morning, scrolling Twitter. And there was one song that just wouldn't go away. And this song called Heart on my Sleeve. Claimed to use A.I Drake and A.I The Weeknd to create an entirely new track. And over and over again, I'm seeing, Oh my god, this A.i.

06:11.80 – 06:28.22

Drake Song is so good, it's basically a Drake song, you know, I like Drake as much as the next guy. And so I click play. And you know, it has all the touchstones there of what a Drake track sounds like.

06:30.16 – 06:48.34

My ex likes to lean on the flats. Ayy Pumpin Justin Bieber to fame If I ain't Left Ayy. It has a little piano beat that's not great, but sounds maybe like Drake would rap on it. The lyrics right away are sort of using subject matter.

06:48.34 – 07:00.04

That would be in a drake song that's on the radio, you know, he's referencing, what's with that? Ayy, 21? I love him and my brother, famous friends of his and the Weeknd's.

07:02.64 – 07:06.32

He's copying Drake's cadence, his flows, the way he delivers lyrics.

07:07.84 – 07:16.98

And the song is called Heart on My Sleeve. Which is a sort of nod to what most people know about Drake, which is that he's maybe more emotional than your average rapper.

07:20.84 – 07:22.06

And then an a.

07:22.06 – 07:38.96

I version of the Weeknd starts singing in a replica of his trademark falsetto Door. And she went out the store, heart on my, heart on my sleeve. And the collaboration is also exciting because Drake and the Weeknd used to make a lot of music together and they no longer do.

07:39.18 – 07:53.26

So the fans, this was like wish fulfillment in some way for the fans. And all told, when you put it all together, it's not so different from songs that Drake and The Weeknd have actually made together.

1Speaker 1
07:54.74 – 07:56.42

And who made it, who created this thing?

2Speaker 2
07:57.12 – 08:16.78

So it seems to have been seeded across social media and streaming services like YouTube and Spotify by someone calling themselves. Ghostwriter. Ghostwriter is a term in the music industry for someone who works in the shadows in studios, helping big artists come up with their tracks. And then not really getting credit for it.

1Speaker 1
08:17.50 – 08:41.48

So this is interesting, so this is different from the Kanye stuff, which was essentially regular people having fun on the internet with a bit of AI, doing spoofs and cover songs. This is actually someone who knows what they're doing, actually composing real music to sound using AI. Like one of the world's most famous artists.

2Speaker 2
08:42.30 – 08:56.00

Yeah, what seems to be happening here is that there's a songwriter with enough skills in the studio to write a Drake song that is then using AI technology to make it sound as if Drake is the one performing it.

1Speaker 1
08:56.74 – 08:58.18

So do people know it's not Drake?

2Speaker 2
08:58.42 – 09:28.46

Most people know that it's not Drake, and part of the novelty factor is that it's being presented as AI. But I think there's enough gray area that people wanna hear it for themselves. And it's a good enough copy that the song starts to snowball and becomes really popular at the end of the weekend. It's gone totally viral, and millions of people have heard it across TikTok, Twitter, Instagram, and even Spotify and YouTube, where official streams are counted.

09:29.08 – 09:35.96

If it would have continued on this pace, it could have very easily made the billboard hot 100, right next to a real Drake song.

1Speaker 1
09:36.24 – 09:41.20

Wow, huh, interesting? So really went viral and has this huge pickup.

2Speaker 2
09:42.34 – 09:57.78

Yeah, I think there's a combination of factors. People who think it's a good song and will take a new Drake song, whether or not he actually made it. And also people who wanna hear just how far this AI technology has come.

1Speaker 1
09:58.34 – 09:59.24

So then what happens?

2Speaker 2
09:59.50 – 10:25.48

All of this plays out over a weekend, which really gives the song space to grow and for its virality to spread far and wide. But by Monday morning, the corporations involved have seemingly had enough. So Universal Music Group, and the one that represents both Drake and the Weeknd, gets this song pulled down from all the official streaming services like Spotify and YouTube.

1Speaker 1
10:26.00 – 10:28.12

Huh, okay, how do they do that?

2Speaker 2
10:28.72 – 11:11.30

So it's interesting because the legal questions around AI music are still very much unsettled. It's a real gray area. Whether or not impersonating someone's voice is enough to get a song taken down. In the past, there have been some court cases where artists have a right to their likeness to the sound of their own voice. Especially if a copy is being passed off as legitimate, but we haven't really seen this legal precedent applied to AI, so in this case, it seems like they were able to get the song removed. Not because the song is impersonating Drake, but because the producer ghostwriter included a tiny clip of another song that was actually already copyrighted.

11:11.48 – 11:16.12

So that allowed the companies to use their normal process for when they try to get a song taken down.

1Speaker 1
11:16.90 – 11:20.40

So, in fact, it had nothing to do with AI, their ability to take it down.

2Speaker 2
11:20.82 – 11:30.48

That's right. It seems like this was just a bit of an unforced error by Ghostwriter to include something that was copyrighted instead of something that was just in this gray area.

1Speaker 1
11:31.26 – 11:33.20

But it sounds like, in any case, the party was over.

2Speaker 2
11:33.66 – 12:00.22

Yeah, for this particular song at least, but I think overall it was clear that a line had been crossed. And the industry, which had never really had to contend with the idea that AI was a threat to their business. And because they knew more and more, songs like this would keep popping up. So while Heart on my Sleeve may have been gone, the legal and creative questions that it raised were obviously here to stay.

1Speaker 1
12:18.86 – 12:20.16

We'll be right back.

3Speaker 3
12:32.66 – 13:04.12

I'm Julie Turkowicz, I'm a reporter at The New York Times. I have been trying to understand changes in migration. So I traveled with photographer Federico Rios to the Darien Gap, this hot, mountainous, 70-mile stretch of jungle straddling the border of Colombia and Panama. We're hiking through a river, just like covered in mud. Many used to think that this route was impassable. But thousands have been risking their lives to pass through the Darien, almost all in the hopes of making it to the United States.

13:04.64 – 13:32.76

We spent nine days hiking through the gap, and weeks building trust and relationships with migrants, with smugglers, with migration authorities to even be able to do this reporting. We interviewed hundreds of people who have made this journey to try and grasp what's making them go to these lengths to find a new life. New York Times journalists spend time in these places to help you understand what's really happening there. You can support this kind of journalism by subscribing to the New York Times.

1Speaker 1
13:33.98 – 13:41.56

So Joe Drake's label, Universal, gets Spotify to take the song down. How are they thinking about this stuff?

2Speaker 2
13:42.10 – 14:18.04

Universal didn't address this song specifically, they never mentioned Drake or The Weeknd, and they certainly didn't want to give any attention to Ghostwriter. But they do release this statement the day the song gets taken down. And it's this big, sweepy corporate thing that tries to frame this fight as a cosmic battle between good and evil. The statement basically asks people in the music industry and who might use AI, which side of history they want to be? On the side of artists, fans and human creative expression, or on the side of deepfakes, fraud and denying artists their due compensation?

1Speaker 1
14:18.78 – 14:25.42

Okay, so when you put it like that, that seems pretty straightforward, right? I want to be on the side of artists and human expression.

2Speaker 2
14:25.82 – 14:47.82

Yeah, I think Universal sees this from a couple of different angles. The music producers using Drake's sound and his celebrity to make money, they want to be making money off of Drake. They also don't want these AI tools to be able to learn from the music that Drake and the Weeknd and their ilk have already put out. That's copyrighted material.

1Speaker 1
14:48.42 – 14:57.92

But can they even control that? I mean, tell the computers of the world that they can't scrape the internet to listen to Drake songs because the Drake songs are copyrighted. I mean, they're just out there, right?

2Speaker 2
14:58.40 – 15:22.46

That's true, but they can try. I've compared the rise in AI music to file sharing, to napster. And these were issues for the labels back in the day, where they got caught a little bit flat-footed. Every time there's a rise in new technology, the labels want to find a way to get in on it. But in the meantime, they have to sort of play whack-a-mole, with people doing it on their own.

15:22.84 – 15:52.12

So that means getting their partners like Spotify and YouTube and Apple Music to take down songs that come from copyrighted material. But at the same time, they're trying to work with these AI companies behind the scenes and say your machines can learn from our catalog. You just have to pay us. And the other thing that labels like Universal are doing is trying to invest in their own AI innovation. So they're okay with using AI as long as it's authorized.

1Speaker 1
15:53.04 – 15:56.16

Huh, interesting? So they're not just going around trying to get stuff taken down.

2Speaker 2
15:58.08 – 15:59.34

That's exactly right.

1Speaker 1
15:59.68 – 16:06.18

So tell me about that, Joe. Like, how is AI being used to make music more broadly?

2Speaker 2
16:06.76 – 16:54.90

There's a few different categories of what we're calling generative AI music. What we don't have just yet is an AI bot that can create a song from a simple text prompt. Where you would say, Make me a song by Drake in the weekend, and it would spit the whole thing back out at you. Wholesale. What we do have are tools that professional musicians and even amateur musicians in their bedrooms can use in bits and pieces. Songwriters could use a chat bot like ChatGBT to come up with lyrics in the style of another artist, or a producer could use AI technology to create little loops of a guitar riff, for instance, or a drum beat or a horn sound.

16:55.32 – 17:01.86

One example that gained some popularity even before the Drake track This is the future rave sound.

?Unknown Speaker
17:02.00 – 17:03.18

I'm getting lost in an underground.

2Speaker 2
17:04.12 – 17:23.46

This is the future. Rave sound I'm Getting Lost In An Underground was one by the French DJ David Guetta, who had used AI to make an Eminem song. There's something that I made as a joke and it works so good I could not believe it. I discovered those websites that are about AI.

17:23.84 – 17:26.24

He used a chat bot to come up with lyrics.

17:28.52 – 17:42.08

And I went to another AI website that can recreate the voice. And then he has a David Guetta track that sounds as if it features Eminem. And I played the record and people went nuts.

1Speaker 1
17:42.68 – 17:45.54

This is the future rave sound. I'm getting lost in an underground.

17:50.22 – 18:03.64

So David Guetta, this French DJ, wants Eminem to rap on one of his songs. But he doesn't need him because he can just replace him with AI. Which kind of sounds like exactly what ghostwriter did with Drake, right?

2Speaker 2
18:04.44 – 18:15.92

That's right, but the key distinction here is that David Guetta wasn't trying to sell his song. He sees this as an artistic experiment, but he's not putting it on Spotify where it can make actual money.

1Speaker 1
18:16.40 – 18:21.92

And what do artists think about this, like Eminem and others who were being used in this way, or Drake, for that matter?

2Speaker 2
18:22.42 – 18:24.38

Drake hasn't commented specifically.

18:25.90 – 18:54.02

But I have a heart on my sleeve. The Drake's and the Weeknd's and the Eminem's of the World know how big their fan base is and how intense that connection can be between listeners and their favorite artists. Who have invested in them as people over the years. And really wanna hear what they have to say, what they're feeling, so I think they're not sweating just yet. At the same time, there are other artists who see this as a creative possibility.

18:55.90 – 19:14.60

They want people to try their voice on as another instrument in their toolkit. So you have independent singers like Grimes or this artist I spoke to for my piece, Holly Herndon, who are saying, go ahead, use this tool, use my voice however you want, you have my permission.

1Speaker 1
19:15.26 – 19:18.32

But they were okay with that, just like giving away their voice like that.

2Speaker 2
19:18.48 – 19:35.30

I think they realized that this is happening, whether they like it or not, and they wanna see what people can pull off. It reminds me of the beginnings of sampling in hip hop, where disco records all of a sudden become the basis for a completely new genre.

1Speaker 1
19:35.76 – 19:37.82

Right, and at the time, that felt pretty radical.

2Speaker 2
19:38.52 – 20:14.32

Yeah, and innovation often comes out of people breaking the rules or doing things that make people or corporations feel uncomfortable. But Grimes is saying that if people do make money off of her voice, she should be paid a cut. So she's trying to get ahead of the business problems. I think the risks come when you realize that with Grimes voice as a tool, you could make it sound like she's saying or feeling anything you want. This raises all sorts of questions about identity and creativity, and cultural appropriation.

20:14.68 – 20:20.72

A white artist could record a song and then make it sound as if Kanye West is rapping their words.

1Speaker 1
20:20.86 – 20:21.28

Right?

2Speaker 2
20:22.98 – 20:34.00

There are critics who see these vocal fakes as yet another form of digital blackface. You can put the words of a white creator into the mouth of a Black artist.

1Speaker 1
20:34.66 – 20:35.20

Say more about that.

2Speaker 2
20:35.62 – 21:04.36

I mean, the history of American popular music is full of appropriation, specifically white artists who take, borrow and steal from Black artists. I mean, rock and roll, Elvis, the Rolling Stones success of certain white rappers, that's always been there. So the uncomfortable thing about this technology is that it could allow for a much easier way of impersonating people. One thing an artist brings to the table is their identity, their culture, their biography.

21:04.84 – 21:10.22

And to just be able to try on that voice like a costume, you know, raises a lot of complicated questions.

1Speaker 1
21:11.00 – 21:22.86

Right, life, experience, identity, culture like these are some of the things that make music human, right? And if you take those things out of the music, then what is it?

2Speaker 2
21:22.94 – 21:53.64

I think that's ultimately what worries and interests me the most about these AI technologies in general right now. Maybe it's just a vocal impersonation, but what about when AI is writing the lyrics and the melody and impersonating a human wholesale? For me, I'm a music reporter and a fan, I'm obsessed with the people who are creating this stuff. What I'm looking for is the human being behind the music. If they sound angry or sad, or confident, or in love.

21:54.44 – 22:03.64

As a listener, you assume that that's real on some level, there's this connection between the listener and the human being performing and writing these songs.

22:06.49 – 22:10.14

But the question AI raises is, do we even need that connection?

22:13.90 – 22:40.12

Do we just want something that sounds pleasant enough in the background? Oh, that sort of sounds like Drake, or that sort of sounds like Bob Dylan. Or do we need to know that this is coming from the depths of their soul and from their lungs and their heart? Maybe we do, or maybe we don't, but as AI keeps coming in music and in other art forms, we're all gonna have to answer that question.

1Speaker 1
22:47.00 – 22:49.02

Thank you, Joe, thank you.

2Speaker 2
22:49.24 – 22:49.74

Thank you.

1Speaker 1
22:55.98 – 22:57.22

We'll be right back.

23:00.54 – 23:21.52

Here's what else you should know today. On Thursday, numbers released by the Commerce Department showed that the American economy was growing at a slower pace. Fresh evidence that the Federal Reserve's efforts were having an effect. Gross domestic product rose by just over 1 last quarter. that was down from 2.6 in the previous quarter.

23:22.84 – 23:44.50

The factors slowing growth included a slowdown in the housing market and companies pulling back on hiring. But consumer spending was still rising at a rapid rate, keeping the U.S. for now, out of a recession. And Jerry, Jerry, Jerry talk show host Jerry Springer died Thursday. He was 79..

2Speaker 2
23:45.02 – 23:49.72

Welcome to the show. My guests today say they've been keeping a secret from a loved one far too long.

1Speaker 1
23:50.20 – 24:07.62

Now, even though Springer's wildly popular program, The Jerry Springer Show, set a new standard for tawdryness on American television. He encouraged everyday people to make shocking confessions, engage in high drama screaming matches, and get in regular fistfights on stage.

24:10.04 – 25:38.80

The show, which ran for three decades, ushered in a new era of daytime television and made Springer a cultural phenomenon. Jerry, Jerry, Jerry. Today's episode was produced by Will Reed and Michael Simon Johnson with help from Nina Feldman. It was edited by Liz O'Balin with help from Michael Beno.it, contains original music by Dan Powell and Marion Lozano and was engineered by Chris Wood. The Daily is made by Rachel Quester, Lindsay Garrison, Claire Tennesketter, Paige Cowett, Michael Simon Johnson, Brad Fisher, Chris Wood, Jessica Chung, Stella Tan, Alexandra Lee Young, Lisa Chow, Eric Krupke, Mark George, Luke Vanderplug, MJ. Davis Lin, Dan Powell, Sidney Harper, Michael Benoit, Liz O'Balin, Aastha Chaturvedi, Rochelle Banja, Diana Nguyen, Marion Lozano, Corey Shruppel, Anita Badejo, Rob Zipko, Alisha Baitoub, Moujh Zadeh, Patricia Willans, Rowan Nemisto, Jodi Becker, Ricky Nevetsky, John Ketchum, Nina Feldman, Will Reed, Carlos Prieto, Ben Calhoun, Susan Lee, Lexi Diao, Mary Wilson, Alex Stern, Dan Farrell, Sophia Landman, Shannon Lin, Diane Wong and Devin Taylor.

25:39.32 – 26:05.86

Special thanks to Sam Dolnik, Paula Schumann, Lisa Tobin, Larissa Anderson, Julia Simon, Sophia Milan, Mahima Chablani, Des Ibequa, Elizabeth Davis-Moorer, Jeffrey Miranda, Renan Borelli, Maddie Messiello and Isabella Anderson. Our theme music is by Jim Brunberg and Ben Landsberg of Wonderly. That's it for the daily. I'm Sabrina Tavernisi see you on Monday.

v1.0.0.260408-1-a910ba6_os