The science of product, big bets, and how AI is impacting the future of music | Gustav Söderström

[00:00] The internet sort of started with curation, often user curation. So you took something, some good, like people or books or music, and you digitize it and you put it online. And then you asked users to curate it. And that was Facebook, Spotify, and so forth. And then after a while, the world switched from curation to recommendation, where instead of people doing that work, you had algorithms. And that was a big change that required us and others to actually rethink the entire user experience and sometimes the business model as well. [00:30] recommendation to generation. And I suspect it will be as big of a shift that you will eventually have to rethink your products. We have to rethink the user interface and the experience for recommendation first era. And so what does that mean in the generative era? No one really knows yet. [00:46] Welcome to Lenny's podcast, where I interview world-class product leaders and growth experts to learn from their hard-won experiences building and growing today's most successful products. [01:00] the Co-President, Chief Product and Chief Technology Officer at Spotify, [01:04] where he's responsible for Spotify's global product and technology strategy and oversees the product, design, data, and engineering teams at the company. I've had Gustav on my wishlist of dream guests to have on this podcast since the day I launched the podcast, and I'm so happy we made it happen. In our conversation, we dig into what Gustav has learned about taking big bets and what to do when they don't work out, how Spotify moved away from squads and how they structure their teams now,

[01:34] also why all great products need to pull some kind of magic trick how accurately succession represents swedish business culture and his hilarious analogy of peeing in your pants enjoy this episode with gustav sutterstrom after a short word from our sponsors [01:50] This episode is brought to you by Microsoft Clarity, a free, easy-to-use tool that captures how real people are actually using your site. You can watch live session replays to discover where users are breezing through your flow and where they struggle. You can view instant heat maps to see what parts of your page users are engaging with and what content they're ignoring. You can also pinpoint what's bothering your users with really cool frustration metrics like rage clicks and dead clicks and much more. [02:19] about the importance of knowing your users and by seeing how users truly experience your product. You can identify product opportunities, conversion wins, and find big gaps between how you imagine people using your product and how they actually use it. Microsoft Clarity makes it all possible with a simple yet incredibly powerful set of features. You'll be blown away by how easy Clarity is to use and it's completely free forever. You'll never run into traffic limits or be forced [02:49] apps and websites. Stop guessing, get Clarity. Check out Clarity at clarity.microsoft.com. [02:58] This episode is brought to you by EPPO. EPPO is a next-generation A-B testing platform built by Airbnb alums from modern growth teams. Companies like DraftKings, Zapier, ClickUp, Twitch, and Cameo rely on EPPO to power their experiments. Wherever you work, running experiments is increasingly essential, but there are no commercial tools that integrate with a modern growth team

[03:19] This leads to waste of time building internal tools or trying to run your own experiments through a clunky marketing tool. When I was at Airbnb, one of the things that I loved most about working there was our experimentation platform, where I was able to slice and dice data by device types, country, user stage. Epo does all that and more, delivering results quickly, avoiding annoying prolonged analytic cycles, and helping you easily get to the root cause of any issue you discover. [03:49] activation, retention, subscription, and payments. Epo supports tests on the front end, on the back end, email marketing, even machine learning clients. Check out Epo at geteppo.com, that's getepo.com, and 10x your experiment velocity. [04:05] Gustav, welcome to the podcast. Thanks for having me Lenny. [04:12] Pleased to be here. [04:13] It's my pleasure to have you on. [04:15] So at this point, you've been at Spotify for over 14 years, which is a rare feat in the tech world. [04:21] and you've held a lot of different roles while you've been at Spotify. [04:25] Can you just start off by giving us a sense of [04:27] what these various roles and what you've done over the years at Spotify and then just what are you, what are you up to these days? What are you responsible for now? [04:33] So I came into Spotify in... [04:37] Early 2009, late 2008. [04:41] And my job then, I had been an entrepreneur, started some of my own companies. [04:45] In the [04:46] back then very, very early [04:48] sort of feature phone smartphone space. So,

[04:52] I had a bunch of knowledge there. I had sold the company to Yahoo in the mobile space. I worked there for a while. [04:57] I came back to Sweden. [04:59] And then I met through a mutual friend, [05:02] Daniel Ek, the CEO and co-founder of Spotify. [05:06] and, [05:06] They had built the desktop product already, the free streaming desktop product. [05:11] And it was amazing, and I could try it. [05:13] but they needed someone to figure out what to do with MOBA. [05:16] And because I have been an entrepreneur in that space, [05:19] I got that job. So my job was to [05:22] to head up mobile for Spotify and figure out [05:25] what the mobile offering, [05:26] would be. [05:27] which was a challenge because obviously Spotify desktop was a free [05:32] on-demand streaming application and back then specifically with edge networks [05:36] You couldn't really... [05:37] Stream at all? [05:39] In real time, the performance wasn't there. [05:41] And also you couldn't fund that with an ads model. [05:45] It was a product and business model innovation that [05:47] It was a lot of fun. [05:48] So that's how I started. Then after a few years, [05:51] I took on all of product development for Spotify. [05:55] Then a few years later, I actually took on the [05:58] technology responsibility, sort of the CTO role for [06:01] Spotify as well. [06:03] And recently, [06:04] My official title is co-president of Spotify together with Alex Nordstrom. [06:10] So we kind of run half of the company each. I run the product and technology side and he runs for the business and content side. [06:17] So that's a super fast thing. [06:19] version, aside from [06:21] getting more responsibilities, like taking on the technology department,

[06:25] It has been sort of the same job by title. [06:28] I've always reported to Daniel. [06:31] But because Spotify has grown so much, every six to 12 months, it's been like starting at a new company. [06:37] First, it was sort of a Swedish-Nordic challenge. [06:40] And then it was a European challenge. And then it was [06:44] getting into the US and then we became a public company. [06:48] So it's sort of, [06:49] As if I had jumped around between a lot of jobs, actually, even though it was largely the same title and role. [06:55] Your story makes me think of the classic, be careful what you're good at. [06:58] because you end up taking on more and more. [07:00] And clearly, you've been given more and more responsibility over the years. And so [07:05] Clearly, things are going well, and you're doing well. [07:08] Shifting a little bit, so you're on my podcast currently. You actually have your own podcast. [07:12] which was kind of this limited series on the product story of Spotify, which I listened to and loved. And it's kind of surreal to listen to your voice in real time because I've been listening to that recently in preparation for this conversation. [07:24] Two questions, just what, [07:26] made you decide to launch your own podcast knowing you had a full-time job and a lot going on and the production value for your podcast is very high. [07:32] from what I could tell. And then too, just what did you learn from that experience in terms of the product you ended up building and just like, [07:39] empathizing with the podcast creator side of it. [07:41] There were a bunch of different reasons why I did that. [07:44] One is [07:46] and not a small one, [07:48] I think like you, I love writing and I have this [07:52] secret creator dream in me. I used to write blog posts a long time ago, and I write internally a lot. You can't write that much externally when you work at a company like this.

[08:02] But I love writing and talking and presenting. [08:05] So there was certainly that. [08:07] And then, [08:07] No small part was to. [08:10] from a product point of view to empathize with. [08:12] one of our main constituents. [08:14] the podcast creator. I'm unfortunately not a great musician. I try to play instruments and so forth, but I don't have any records. I don't sing very well. [08:23] But I decided to make a podcast. [08:25] And, uh, [08:26] That taught me a huge amount. [08:28] about what it's like to be a creator. [08:31] how you're creating different styles of podcast, for example, [08:34] We wanted to do a higher production cost podcast. [08:39] with music, [08:40] And then right away, you run into a bunch of problems. [08:43] As Spotify is actually pretty well positioned to solve, but still, like, it's really hard to have music in a podcast from a rights perspective. [08:50] So you understand all these problems that podcasters have. [08:54] and you can be better at solving them. [08:56] But... [08:58] The... [08:58] the biggest [09:00] benefit and the real reason for... [09:03] for doing the public podcast was that [09:06] I've actually done an internal podcast through sort of a hack where we could gate the podcast only employees. And, [09:13] I try to figure out internally how to [09:15] how to build more culture around Spotify. [09:17] and sort of help, um, [09:19] defined for new employees and existing employees [09:21] who we are, the mistakes we did, the successes we had, [09:25] and how we think about strategy specifically and product strategy. Because we were quite well-known externally for technology and the squads and all of these things.

[09:32] not so much for product strategy. [09:35] And because I love storytelling more than Google Docs, [09:40] I decided to do an internal podcast. And I went around and I interviewed [09:44] Actually, Daniel's direct reports, so the CMO, the CHRO, and [09:48] And, um, [09:50] CFO and just ask them about the bunch of stuff. [09:53] And the idea was to make them [09:55] more approachable for employees. Because I felt listening to podcasts, even these people that have no idea who I am because I've never met them, I feel like I know them. [10:04] I feel like I know how they think and I just like them much more. [10:07] So the... [10:09] This secret idea was [10:11] What if you could get to know your leaders much better than you do through occasional meetings or some town hall? [10:17] So I did that internally. [10:18] And because I'm a product person, we ended up talking a lot about product and product strategy. [10:22] And people internally really like that. [10:25] So next time, [10:27] The question was, [10:29] What if people that don't even work at Spotify yet could feel as if they knew people at Spotify? [10:35] That'd be great because most leaders in most companies are very... [10:39] opaque and appear as some sort of otherworldly creatures that aren't really real, I think, when you see them in business papers or something. [10:47] So what if you have heard them talk for an hour or so? [10:49] So that was the general idea. [10:51] So a combination of [10:53] Um, [10:54] Recruitment tool? [10:56] Uh, [10:57] sharing more about how we think about product strategy, [11:00] and, [11:00] Just because I think it was a lot of fun. I got to interview a bunch of

[11:04] Smart and interesting people are both externally and [11:07] and internally. [11:08] Did it have the effect that you were hoping after looking back? [11:11] I think it did. [11:13] And the podcast did well. [11:14] And no, we did not give it our own sort of promotion. I had to compete. [11:19] as everyone else, which also gives you a lot of empathy for [11:23] The problem of like, okay, now you have a product. What about user acquisition? How do you actually get people to listen to it? [11:29] So, [11:29] It did achieve what I wanted in the sense that [11:32] We have this thing called intradays where... [11:36] especially in the past few years when we've hired a lot [11:39] We actually fly people to Stockholm for sort of an onboarding session to learn about Spotify. [11:43] And the leadership is on stage talking about what they do and their department and strategy and so forth. [11:50] And, um, [11:51] It's very common that people come and tell me that, [11:54] oh, you know, I listened to this podcast or this episode, and it's at least one of the key reasons why I joined, or sometimes the reason why I joined. [12:03] So it's sort of anecdotal, but it may be in the [12:06] Many tens of people at least have said it. [12:09] So, [12:10] That seems to work. [12:12] That's really interesting. Just again, and this comes up a few times on the podcast, it's just the power of content and all these different ways. [12:17] for hiring, for culture building. And it sounds like internally, the original goal was just internally build this kind of culture and strategy. That was the original goal. Make senior leadership more approachable. [12:28] and reduce the distance and then also [12:31] Share more of the thinking in an entertaining or... [12:34] way rather than just through docs that people end up not reading.

[12:38] I love that. So I was listening to it, as I said, and what was really interesting is I think episode four was actually all about AI. [12:45] And I think your first kind of attempts at leveraging machine learning and AI within Spotify. And I think that's what led to Discover Weekly and a few other tools. [12:53] And that was like years ago. And it's interesting listening to it now where AI is again, like, you know, a huge deal. [12:59] And so I'm curious, [13:01] very tactically on the product team, [13:03] what you advise product managers and product teams [13:06] uh, [13:07] on how to think about AI in their product, [13:09] thinking and also just in their day-to-day work. I can give a few examples there. [13:14] And I don't know that we're more sophisticated than anyone else, but what we'll be doing at least [13:20] the traditional machine learning. [13:21] for quite a long time. And I think in the podcast [13:25] I think I talk about... [13:27] the [13:28] the journey of the internet in sort of stages. And one way to think about it is that [13:33] The Internet sort of started with curation, [13:35] of the user curation. So you took something, some good, like people or books or music, and you digitized it and you put it online, and then you asked users to curate it. [13:44] And that was Facebook, Spotify, and so forth. [13:48] and then after a while, the world switched from curation to recommendation. [13:52] where instead of people doing that work, you had algorithms. And that was a big change that required... [13:57] us and others to actually rethink the entire user experience and sometimes the business model. [14:03] As well. [14:04] And I think what we're entering now is we're going from your curation to recommendation to generation.

[14:10] And I suspect it will be [14:12] as big of a shift that you will eventually have to rethink. [14:16] your products. [14:18] So that's one lens. So I tend to talk to my teams [14:22] about [14:23] even though it's all machine learning. [14:25] I asked them to think of this as something completely different. [14:29] The recommendation error was one type of machine learning, [14:32] The generation error is a different type. So don't think of it as just more of the same. Think of it as something actually... [14:37] completely new instead. [14:40] And? [14:41] What we learned in [14:42] Well, a few things. So if you look at this new era of large language models and diffusion models and so forth, [14:49] There are two types of applications. As I said, for the recommendation era, we had to rethink the user interface and the experience for recommendation first era. [14:57] And so what does that mean in the generative area? No one really knows yet. [15:01] There are bonds, as usual, there are bonds of... [15:05] iterative improvements. [15:06] So we use these large language models to improve our recommendations. You can have bigger vectors. I can have more cultural knowledge. You can use it for safety classification on podcasts that no one has listened to yet and so forth. [15:18] There's lots of obvious improvements. [15:20] And we're doing those. [15:22] But so far, we've only really done [15:24] one real generative product, [15:27] in the hard definition, which is a product that couldn't have existed, [15:31] with alternative AI, and that is the AI DJ. [15:35] So that's a concept that [15:37] we've been thinking about for [15:39] a very long time.

[15:41] And the ARDJ is you press a button... [15:44] a person of [15:46] a digitized person. There's a real person named X, and we digitized X. [15:50] So he's now an AI, comes on and talks to you. [15:53] about music that you like and suggest music and you can listen to it. And if you don't like it, [15:58] you can call them back and he says, "Okay, now let's listen to something maybe from a few summers ago, or here's some new stuff that were trending yesterday." [16:06] in that Last of Us episode or something like that. [16:10] So that product couldn't have existed without generative AI, both generating the voice, [16:14] and generating the content of what the voice says. So you can have individualized, personalized voice at the scale of half a billion. [16:24] people [16:26] And so we had [16:28] the use case we had seen for many, many years. [16:31] Sometimes people call it the radio use case. We call it the zero intent use case internally. [16:37] when you actually don't know what you want to listen to at all, you know, [16:39] Spotify. [16:40] wasn't that good. Spotify was good when you knew [16:44] at least roughly, you know, the use case of what you want to do if it was a workout or [16:48] dinner, like we had lots of [16:50] Lots of options for all of those, but if you really didn't know at all, [16:53] It's hard to open Spotify and sort of stare at it. [16:56] And people used to say longingly, you know, that this was the one thing that radio was good at. [17:01] Radio was quite bad, to be honest. I mean, it's not personalized to you. [17:05] at all. It's not on demand. You come in in the middle of things. It's actually terrible in many ways. [17:10] But people still often say that there was something good about it. And I think that's something...

[17:14] was the fact that you had a knob [17:16] You could just switch between contexts. [17:18] It's like, no, boring. [17:20] Boring, boring, boring. Okay, this is good. [17:23] And Spotify never had that mood of like, [17:26] I don't know what I want, but I want to sort of cycle through things until I find something that I like. [17:31] And I think with AI DJ, that's actually the use case we managed to solve. [17:34] So X comes on and says, I'm going to suggest something to you that you can listen to. [17:39] And if you like it, you can keep listening. [17:41] But if you don't like it, you kind of bring him back again and you change genre. And for one reason or another, we tried to solve that for many times, for a long time, but [17:49] just starting to play a random song without any context as to why you would hear this [17:54] It just didn't, never worked. [17:57] So that was our first sort of foray into [18:00] a product that couldn't exist before. And I think to your [18:02] Questionable principles around that. [18:05] There are a few pretty distinct principles that we've learned. [18:09] One that I really like that is not my principle at all, I think it is straight from Chris Dixon. [18:16] is the principle of fault-tolerant user interfaces. [18:20] So, [18:21] I can't say how many times during the early machine learning era, [18:25] when we said, you know, we're moving from curation to recommendation. [18:28] I saw the sign sketch that was a single big [18:30] play button. [18:31] Because clearly, that is the simplest user interface you can do. [18:35] But if you don't understand the performance of your machine learning, [18:39] You can't design for it. [18:41] The quality of your machine learning, if you're going to have a single play button, needs to be

[18:45] literally 100% or zero prediction error. [18:48] And that's never the case, right? [18:50] So let's say that you have a one in five hit. [18:54] Four out of five... [18:55] Things are done. [18:56] Then you need a UI that probably at least shows five things at the same time on screen. So you have a one in five. [19:01] of something being relevant on screen. [19:03] So you need to understand the performance of your machine learning [19:06] to design for it. There needs to be fault tolerance. [19:09] and often you need an escape hatch for the user. So you make a prediction, but if you were wrong, it needs to be super easy for the user to say, no, you're wrong, I want to go to... [19:18] my library or to this or to that. [19:21] So we have that principle of having fault-tolerant user interface. [19:25] and a user interface that corresponds to the current performance [19:28] of your algorithms. [19:31] And I think that is going to be true for generative machine learning as well. [19:35] I think a very clear example actually is [19:37] Mid-journey. [19:39] If you think about the early mid-journey user interface inside the Discord channel, [19:45] Actually, generating an image, [19:47] was very, very slow. It took a long time to generate high-quality image, and they could have built the silver button thing where you put in a prompt, [19:54] You wait for minutes. [19:56] you get an image and I think one out of four times it's going to be [20:00] Bad. [20:02] So you would have been disappointed three out of four times. And it's a minute each. So like four minutes later, you'd be, this is a shitty product. [20:08] What they did was [20:10] They generated four simultaneous low-res images very quickly, [20:15] And you could say, like, so apparently their performance was probably one in four. That's why they showed four and not six.

[20:21] And so one in four was usually pretty good. You click that one and either continue to iterate or scale it up. So that's also an example of, I think, [20:29] people understanding where the performance of generative AI was when they built the UI. Is that something that, you know, [20:35] I would be inspired by. [20:36] And for the ARDJ specifically, [20:39] Another principle is to try to avoid this urge of just [20:43] wanting to show off the technology and have this voice sex talk and talk and talk and talk. You have to remember that people came there for the music. [20:50] So the principle for the AI DJ [20:52] Coming from the team, by the way, this was a bottoms-up product, actually. [20:56] It required a lot of support. We actually required big companies and so forth to be able to build it. [21:01] But the idea has been built by Teams bottom-up. [21:04] So the principle there was literally to do as little as possible and get out of the way. [21:09] And I think that was really helpful. [21:11] It's not telling you what the weather is and what happened in the news and going on and on and on about this ban. [21:17] It is trying to get you to the music. And I think that's, [21:20] That's why it's working, because it is working very well for us. [21:24] I love this distinction between recommendation. [21:26] and generation. And this kind of begs the question of, [21:30] There's this trend that I imagine you're seeing of people auto-generating music. [21:34] using artists, you know, catalog. [21:36] Like there's this Drake and the Weeknd thing that came out a week or two ago. [21:41] Where do you think this ends up going and how do you think artists adjust to this world where music can just be out and generated? You know, this play button is like all of it is generated versus just like the DJ in between the songs. First big caveat is this is just super early.

[21:55] No one knows anything. [21:58] about how this is going to play out or the legal landscape and so forth. [22:02] But I think it's going to be [22:03] have a lot of impact. [22:05] And I think if we talk about two things, one is what it could do for music. [22:10] The other is the right situation. [22:13] and if rights holders are getting compensated and so forth. So we talk about the first thing in isolation, [22:19] I think an interesting example is right about when I grew up, [22:24] Avicii came along. [22:25] And it's interesting to think about because Avicii, [22:28] was not really... [22:29] considered by the existing music industry as a real artist. [22:33] Because he couldn't really play an instrument and he couldn't sing. [22:36] And he was just sitting with this computer. [22:38] in this DAW, this audio workstation. [22:41] And so it wasn't really considered real music. [22:43] And I think now all of us consider it very real music and that he had tremendous real [22:48] musical talent. [22:50] So I think right now we're probably in the phase where people say this isn't real music and it's somehow fake. [22:56] I think the way to think about these [22:59] these diffusion models, if and when they get good enough at generating music, [23:04] is probably the same, like an instrument. [23:07] It's just a much more powerful instrument, and we'll probably see [23:10] a new type of creator, [23:12] that [23:13] wasn't proficient at any instrument, and they couldn't [23:17] They couldn't assemble the full orchestra and do the thing that they had in their head. [23:21] and they can now [23:22] generate very, very new things. I also think, by the way, that there is this distinction between AI music and real music.

[23:30] That doesn't exist. For sure, very talented real musicians are using AI. [23:37] to get better. [23:38] and to help create new ideas. So that distinction doesn't really exist. It's all going to be AI. The question is what percentage? [23:46] Which makes the problem harder because you can't talk about if it should exist or not. You have to talk about what percentage should exist and who gets to use it or not. [23:55] But I think the way to think about it is probably [23:57] as an instrument. [23:59] and that could help create a huge amount of [24:02] of art. [24:03] And I think... [24:04] This is not news to you. [24:07] who probably use these things a lot. But I think if you don't use these generative models, [24:11] There is the perception that [24:13] You tell it to create a hit. [24:16] And you will get that. [24:17] That's not how it works. [24:19] Actually, what these models do is, [24:21] because they've been listening to a lot of music, they are very good at doing something that sounds very similar to what already exists. [24:28] actually being original. [24:30] It's very hard. [24:31] And from one point of view, as it now gets easier to create more generic music, [24:36] it will actually be more difficult than ever to be truly unique. So I still think there will be tremendous skill in creating something [24:43] truly unique. And my hope would be that [24:46] What happened with the door and that technology jump, [24:49] Well, so you've got a whole new genre like EDM. [24:51] that didn't [24:53] You couldn't really produce it with an orchestra or live. [24:56] and maybe we'll see completely new music styles. [24:59] with these technologies. I think that would be very exciting.

[25:02] So that's on the positive side. [25:04] But then you have the rights issue, which I have a lot of empathy for. [25:08] And Spotify specifically has seen this before. So we had a different technology shift like this, which was the technology shift to online downloads, [25:15] of music and piracy and peer-to-peer. [25:19] So first, there was a big technology shift in peer-to-peer. [25:22] And it was, it was, [25:23] exciting for consumers. More consumers started listening to more music than ever. [25:28] And I think that's where we are now with generative AI. There's a new technology that [25:32] but it also required a new business model. [25:35] before creators and industry could actually participate and benefit from this. [25:39] That's obviously self-serving to say because we were a big part of innovating that business model. [25:44] But I still think that's what's necessary. [25:46] And I hope that that's what I and we could be part of. [25:50] So I think we've seen the first part, the technology shift. [25:53] And there would probably be a lot of discussion and discussion. [25:56] chaos here, which I have a lot of empathy for. [25:59] But... [26:00] I think... [26:02] I think we haven't seen the second part yet. What is a model? [26:05] where this could be [26:06] a benefit, what actually happened after piracy, [26:09] is that the music industry got bigger than ever. Not just as big, but bigger than ever. [26:14] And I think that could happen with this technology as well. [26:17] But we're right in the beginning. [26:19] Thank you. [26:20] So along the same lines, [26:21] Something else you teach is this idea of, [26:24] All truly great products have to pull some kind of magic trick. This comes up in your podcast a lot, and I think you mentioned this other places. [26:30] And thinking about all the stuff you're talking about here, it feels like

[26:34] In a sense, everything's going to feel like magic because AI is kind of big into it. [26:38] I think when we did the... [26:40] The AIR DJ, we did a small version of that. When people first listened to it, we could see that reaction in user testing. [26:47] when they've... [26:48] So the magic trick there was that, [26:50] How could they? [26:51] record this person saying so many different things because it's talking about my music. [26:56] So the magic trick was obviously didn't record a person saying it's generated. [27:01] And then that magic trick wears off. You hear it all the time now and so forth. But it was one of those [27:06] Magic tricks? [27:07] So I still think that concept is important and it seems to correlate [27:11] with products going viral and taking off. [27:15] And I think it was the same thing. [27:17] using something like, um, [27:19] DALI or stable diffusion or mid-journey. [27:22] the first time. [27:23] It completely seemed like a magic trick. [27:26] And obviously there is no magic. It's just data and statistics. [27:29] But I think getting to that [27:31] point and iterating a product to the point where it feels like magic the first time. [27:36] is very helpful. And it's often a question of, [27:40] just getting the performance to certain levels, scoping down. [27:43] removing things. There's a lot of fine-tuning, I think. [27:47] that makes you cross that [27:49] that line from [27:51] It's cool and impressive, but not magic to... [27:55] It feels like magic. I don't understand why. [27:57] how this could be done. [28:00] Yeah, it reminds me of the launch of GPT. [28:02] which ended up being the biggest, most fastest-growing product in history.

[28:05] It's like the epitome of a magic trick. It feels like actual magic. [28:09] Absolutely. And to most people, it is still... [28:13] Actually, to a lot of us and even to researchers, it's a little bit magical. No one really understands fully. [28:19] So I guess there's maybe some magic. [28:22] left in the world? [28:23] Absolutely. I think a lot of people are worried about not understanding what's going on there. [28:27] Shifting to the way you all build product at Spotify. So Spotify is kind of famous for popularizing this idea of squads and tribes and... [28:35] And correct me if I'm wrong, but you guys have kind of moved away from that approach. [28:39] Yeah, that's right. [28:40] Okay, so I'd love to understand just like why you shifted and what you kind of learned from that approach to building product. And then just like, how do you organize the teams now? What do you... [28:49] What do you do now? [28:51] This was something that we focused a lot on early. [28:54] And, [28:55] It turned out to be smart of us to name these things. [28:58] into squads and chapters and so forth, it wasn't really... [29:02] well, maybe it was sort of deliberately branding, [29:05] But it wasn't for purposes of branding that we made it up. We made it up because we thought it was a good structure to use. [29:10] And we needed names for things. And this was the early internet era, so you were allowed to, like, [29:15] Make things up. [29:17] And so it was very good for where we were at the time, and it certainly helped us in recruiting. [29:22] It's become a little bit of a cost to us because people still think that we organize that way. And it's not a very efficient way of being organized at this scale. Or maybe even if you started over right now because you've learned more. [29:34] But, [29:35] I think the big difference is

[29:38] the idea with the [29:39] where the squad specifically was [29:41] twofold. [29:43] They were supposed to be small and sort of full stack. So squad should be about seven people and it should have, you know, front and back end. [29:50] mobile QA, [29:52] agile coaches and so forth. And it should be very autonomous was the idea. And that's really what we've shifted. So first of all, as you grow the company, [30:01] Scaling in increments of seven engineers just creates a ton of overhead. So obviously our teams now tend to be much bigger, maybe two. [30:09] two, three times that at least. [30:11] Per like manager. [30:12] to maybe have like 14 or something. [30:14] instead of seven. [30:16] and just less overhead rolls. [30:19] and, [30:20] So that's one. It looks more traditional as you learn more and is reasonable as you scale. [30:26] The second big thing, I think, [30:28] we struggle with was back then when I joined, [30:32] The average age at Spotify was... [30:35] I mean, I was the oldest and this was 14 years ago. [30:40] I think the average age was probably under 30 or something. And it wasn't most... [30:44] tech companies. [30:45] And so we had [30:48] Coming from Sweden. [30:50] which is a different culture than the US. And I love a lot of things about Swedish culture. I think we managed to keep the best parts. [30:57] But Sweden is a very... [30:59] sort of bottoms up, autonomous culture. There's this famous [31:03] drawing on how you make decisions in Sweden and [31:06] In the US, I think it's just a hierarchy. In Sweden, it's kind of a circle. It's a circle. No one is in the middle. There is no leader and so forth. So I think by sort of culture, we're very inspired by this super autonomous movement.

[31:18] thing. [31:19] And I think the idea with autonomy, [31:22] This... [31:23] is very reasonable and the right one, which is? [31:26] We work and we are hiring the smartest people we can find. [31:31] And we pay high salaries for that. [31:33] So if you're hiring smart people, one way to think about it is you're renting BrainPow. [31:39] So if you're renting all of this expensive brain power, [31:42] And then you give them no room to think for themselves. [31:44] That doesn't sound smart. Then you should actually hire less smart people. [31:48] and keep your costs down or something. [31:51] So I think you have to give a bunch of autonomy [31:54] to actually maximize the value of the investment you're making. [31:58] So that's very reasonable that you would give a lot of space for people to use as much of their talent and capacity as possible. [32:06] But the problem with that is, [32:08] If you put... [32:09] autonomy very far towards the leaves of the organization. And then also, if you combine that [32:14] with having a very junior organization, which we did back then, [32:17] there's a fair chance that you're just going to produce heat. You're going to have 100 squads with 100 strategies, [32:23] running in 100 directions. [32:25] And, you know, Spotify has been there in that camp. [32:29] I mean, we managed to get somewhere for sure in spite of this. [32:32] But I'd struggle to say we were efficient. [32:36] in doing that. [32:37] So we've done a few things. The team structure is more traditional. [32:41] larger teams, less overhead. [32:44] And we've been specifically working with [32:47] Where in the org do we put the autonomy?

[32:49] Because the extremes are at the leaves, and we were there. [32:52] The other extreme may be at the top. Let's say maybe something like Twitter. There's one person. Both have problems. If you have it at the leaves... [33:00] you're going to produce a lot of heat. [33:02] If you have it at the top, [33:04] You need someone with a lot of capacity and Elon has a lot of capacity, but you are by definition going to bottleneck. [33:11] All decisions have to go through there. [33:13] And Daniel, it's not his personality that he even wants to make all the decisions. He wants to maximize throughput. [33:21] rather than to bottleneck the throughput. [33:23] So the question is, if it's not at the top and not at the very bottom, where do you put it? [33:28] And what we found, which I [33:30] I don't think it's very contrarian at all. I think this is the case in most companies is [33:35] around sort of the VP level. So if you have Daniel, then you have the C level, myself and others, then you have sort of the VP level. [33:42] That is a good mix of [33:44] Instead of having one person in the company think, so only Daniel then, and the rest just do, [33:50] you have on the VP level in a company like this, [33:53] many tens to maybe hundreds of people. [33:55] that have a lot of autonomy to think. So you get a good amount of [34:00] freedom of thought and people thinking in different directions. [34:03] But it's not like 8,000 people. [34:06] And these people on the VP level are both quite a lot of them. [34:11] but they're also usually quite senior. [34:13] They have a lot of pattern recognition. [34:16] So I think that solves for, it's like a good, if you think of it as a,

[34:20] has an optimization problem. It's kind of a good... [34:23] optimization space. [34:25] So the autonomy level in Spotify now tends to be quite high at the VP level. [34:30] and then lower around those levels. [34:33] And when you say autonomy, what does that actually mean? Is it the VP of, say, the podcasting product? [34:39] has a lot of say over what happens and there's not a ton of [34:42] I don't know, like how involved are people above? And I know Maya is the VP of product, I believe, for the podcast. Exactly. Who I think is going to come on the podcast someday. [34:51] What does that mean in terms of autonomy for her, practically? [34:54] So it means that, um, [34:57] I would ask Maya, [34:59] to define a strategy. [35:01] for what we do in podcasting, how we're going to be different. [35:05] Why would a podcaster want to be here? [35:07] Whereas in another company, I would make that strategy, or in another company, Daniel would make that strategy. Same with the AI DJ, for example, came from our personalization team. [35:18] And so, [35:19] That was a bet that they made. [35:20] So they have autonomy to make those kinds of [35:23] of bets and defined strategies. [35:26] Same with the user interface. We have an experienced team. We can talk about the org structure later. [35:31] But I put a lot of autonomy... [35:33] I'm the VP of Experience. [35:35] to define and suggest what it is that we want to [35:39] to do. [35:40] And in other companies, [35:42] I would define all of that myself, for example. [35:44] Just going even a little bit further here, I know you have just like strong opinions on the way to organize teams and [35:50] how the organization

[35:52] kind of helps you optimize for specific things. What are your kind of just thoughts along those lines and what have you learned about the impact of organization and [36:00] what you're optimizing for. [36:02] Yes, so I talk about [36:05] sort of an, um, [36:07] an idealized spectrum or maybe not idealized, but exaggerated spectrum. It's not really, nothing is really true. [36:14] But you create extremes to make a point, right? [36:18] So, [36:19] On one spectrum, you have something like Amazon, which is known for two pizza teams. [36:25] Um, [36:26] no dependencies you try to minimize dependencies so you can run in parallel [36:30] Teams compete with each other. [36:32] even on the same project and so forth, but they have direct access to the user. And so the benefit here is if you have an idea, [36:39] The time to get the user [36:40] It's very low. And it has worked for them. It's produced, you know, [36:45] It's produced Kindle. It produced Alexa. It's produced a lot of very... [36:50] Novel things. [36:52] There are a few interesting... [36:54] Thank you. [36:54] Downsides here. [36:56] One downside that I'm extremely impressed with Jeff Bezos for seeing is [37:01] if you have teams that compete with each other, [37:04] The incentives are to hide your results. [37:07] Hydrocode. [37:09] And that should make for an organization that gets... [37:12] No platform leverage. [37:13] Because no one's cooperating. [37:15] And I think this, either he had that insight or because he saw this, he had to do this, but [37:21] He's well known for pushing extremely hard on hard APIs.

[37:24] If you don't create hard APIs to your technology, [37:27] You're out. And if you think about it, it has to be that way because otherwise no one would do it. [37:32] And a hard API is essentially like everyone knows how to use this API and connect to this team to interface. Exactly. You have to expose your technology to others. You have to maintain those APIs and they have to be very structured because otherwise the whole thing would collapse as everyone's supposed to compete because there are no incentives. You have to centrally force that. [37:49] And interestingly, even though [37:51] Theoretically, then, they're the worst position [37:54] to have a structured platform. I think because they forced it so hard, [37:57] They were the ones who did Amazon Web Services because they had such hard-defined APIs because of this rule. [38:02] that it was easier for them to turn it inside out and expose it to the rest of the world. [38:06] Whereas if you look at something like Google, I think they struggled more with externalizing their APIs. [38:11] maybe because it is so friendly and soft, so they didn't need as hard APIs on the inside. [38:15] because there was no competition. [38:17] People could just go into each other's code. So it's interesting. [38:20] anecdote around it. [38:21] But the main point is, [38:23] You're faster there. [38:25] But it's going to be hard to cooperate. [38:27] And so you will see something like maybe... [38:30] exaggerating a bit, sometimes you'll see multiple search boxes on the same page from different teams. [38:35] And this has been true in Spotify, by the way, as well. You've seen like [38:39] multiple toasters on the now playing view coming up from different teams because they're working when we were in the autonomous mode everyone running [38:46] Uh, [38:47] And then... [38:49] So you get the benefit of speed. [38:51] but you get the drawback of kind of shipping your org chart and shipping complexity.

[38:56] to the end user. [38:57] But clearly, that's been the right choice for Amazon because they're a trillion-dollar company. [39:03] But then on the other spectrum, you have something like Apple, also a trillion dollar company, [39:07] So clearly both models work. [39:10] Where? [39:10] you would never see two search boxes from the same team popping up on an iPhone. That shit is centrally organized by something that is close to a single individual. [39:20] So they are instead in what's probably the world's biggest [39:24] largestfunctional.org. [39:27] they're doing as much. If you think about what goes into [39:30] Toplets. [39:31] I mean, they certainly do everything we do. They have a music service, podcast service, audio books, and they have a billion other services. [39:37] So it's not like they have an easier problem. [39:40] And yet they build something that feels more like it was built by a single developer for a single user. [39:47] So they centralize. [39:49] And they have this bottlenecking function that everything has to go through and be decided how it fits with everything else. [39:55] And so that has the benefit of the user experience [39:58] being simpler and not shipping [40:00] the org chart and the increase in complexity, [40:02] but it also has the drawback of speed. [40:05] Without having facts on it, I've heard people [40:08] working at Apple, said like, yeah, it took seven years to get that thing to market because it just had to wait in the pipeline. [40:16] So you have these extremes. And I think the most interesting example, I think, to think about is, [40:25] When you double-click the power button on an iPhone, the Apple Pay comes up.

[40:29] That decision. [40:30] How did that happen? You can imagine that all the services team would like to pop up when you double click that button. [40:36] And so someone had to decide. [40:39] Should music come up? Should payments come up? Should [40:43] Something else come up? [40:45] Um, [40:46] And so they have a different structure there. And on that spectrum of centralized [40:51] versus decentralized. [40:52] Because of our strategy, which is we're a single application, [40:56] trying to add, or not trying to, we have added multiple types of content with actually very different business models on the back end, you know, rev shares and royalties and [41:04] book deals and so forth. [41:06] into a single user experience. That is our strategy. We think the user experience and keeping that simple is the most important thing. So we've chosen more of the centralized model, [41:16] where these different sort of vertical businesses, if you think about it, the music business, podcast, audiobooks business, [41:21] They have to go through a single... [41:23] recommendation organization, [41:25] That's another problem. Which one do you recommend to which user? It should be a book or podcast or music and how do you weigh them against each other? [41:32] and also the user interface, [41:34] could easily get incredibly complicated if everyone built their own UI. [41:38] the music team built their UI, and then someone added features on top. So that's how we chose to optimize. But it is based on our strategy. And I think, [41:47] Both models work.

[42:17] or even earn rewards for saving each month. And then imagine if you got rewarded again, just for getting rewarded. With Ico you can spend at some of your favorite merchants and automatically get 5% cash back. Plus, Ico's APY rewards look more like $80, not $0.80. And then there are Ico Points, the world's first open reward system. You earn them whenever you do almost anything in the Ico app. Ico is working to make these points the most rewarding points [42:47] eco.com slash Lenny, sign up for an onboarding and find out why it isn't. Lenny's podcast listeners who attend an eco welcome session will get an exclusive 4% APY on deposits over $1,000. Learn more at eco.com slash Lenny. That's ECO.com slash Lenny. [43:05] It's interesting, these two examples you gave Apple and Amazon, they're [43:08] Two of the biggest companies in the world, and they're at the extremes of these two ends of the spectrum. [43:13] And it's interesting, most companies are somewhere in the middle. [43:16] I wonder if there's just like a benefit to being at an extreme and that ends up being really important. I think so. In almost all industries, you have this smiling curve concept, right? Where you want to be at the extremes of the smiling curve. [43:28] That's what big business opportunities are, but not in the middle. So it's probably true. [43:31] in terms of organizational moments as well. [43:34] Speaking of extremes, I want to talk a bit about taking big bets. [43:38] So you guys had this big launch event recently where you basically redesigned the whole [43:42] primary feed of Spotify to make it feel more like where kind of apps are going, like TikTok Reels feel of just, you know, stream and you start hearing videos and music starts playing and

[43:53] Some people loved it, some people did not. [43:55] And I'm curious as a product leader, [43:58] how you think about thinking long term and dealing with people that are just like, what the hell's change? I hate change. Stop changing things. [44:04] How do you think about that? Who do you listen to? Who do you ignore? How do you know to stay the course? How do you approach that? [44:10] Yeah, you're being very kind. There was a lot of negative feedback on Twitter. [44:14] on on some of that so [44:17] Let me actually kind of, [44:18] dig into some detail, because I think this is a really... [44:21] for product people listening to this. [44:24] This is an interesting lesson that I think few people... [44:27] few companies talk about. [44:29] Because you don't really want to talk about [44:32] You want to talk about everything that went exactly as you thought they would, and you don't want to talk about that. [44:36] the things that didn't go exactly as you thought they would. [44:39] So I'll go through kind of... [44:42] what we are trying to achieve and what we learned. [44:46] So, [44:47] Spotify is mainly a background application. And for a long time, we've been considered very good at background music and podcast recommendation. When the phone is in your pocket and you're listening to like a, [44:58] an EDM playlist or, you know, [45:01] pop playlist or something, we're really good at inserting another EDM track there or another pop track there or something like that. [45:07] in the background. [45:09] What we hear from users again and again, though, is that [45:12] They say that [45:14] they get trapped in a taste bubble. So, you know, I love my Spotify... [45:18] I love this. [45:20] but I am a little bit bored with EDM now. [45:22] And Spotify is not suggesting something completely new.

[45:26] And if you think about that problem, [45:29] It may sound similar to the recommendation. It's just another recommendation problem. [45:33] But it's actually fundamentally different. [45:36] Because when you're recommending another EDM track inside the EDM playlist, [45:40] you have a lot of signal from that user that they like EDM. [45:44] But if you're going to recommend a completely new genre, by definition, [45:48] You have no idea. [45:50] Because if you had an idea, it wasn't new to them. [45:53] You can't know anything. [45:55] So back to hit rate. Your hit rate [45:57] is going to be incredibly low when you suggest something [46:01] completely new to the user. [46:03] So this problem of helping people get out of the taste bubble, [46:07] Isn't that easy as it sounds? [46:09] And we can't really take some genre that maybe isn't typical. [46:13] I'm a big fan of reggaeton, for example. [46:16] It's not typically... [46:18] It's not that common in Sweden. And if you would look at the rest of my profile, it's kind of EDM heaviness. You probably wouldn't have guessed it. [46:24] Spotify wouldn't have guessed it. [46:26] So, [46:27] If I'm listening to my favorite EDM playlist in the background, or maybe my metal playlist, metal is very big in Sweden. [46:34] It's really hard for us to just insert a reggaeton track in the middle of that. Most people are going to think Spotify is broken. What the hell? [46:42] Are they thinking right? [46:44] So that doesn't really work. So in order to [46:48] help people break out of their taste bubbles, you need something different. [46:51] You need something where your hit ratio [46:54] can be very low. [46:56] And you need people to expect it to be very low.

[46:59] So when we recommend things in the background, our hit ratio needs to be [47:04] at least nine out of ten maybe one dot is okay but if you get [47:08] you know, five dots, you're going to think we broke your playlist on your session. [47:12] We need something where one out of 10, [47:15] is a success. If you find one gem, [47:18] Out of 10 tries, you're very happy. [47:20] So you need to complete a different paradigm. [47:22] And, and, and, [47:24] you also need to be able to go through many candidates quickly. [47:28] because the hit rate is so low. You can't take three minutes per item. It's like, okay, I didn't like this, and it's still like two minutes left before the next one comes on. [47:36] You need to quickly say no, no, no. [47:38] So the obvious candidates for this [47:40] are this feed type experience. [47:43] where you can go through lots of content, [47:45] you're expecting the hit ratio to be much lower. And if you don't like it, the cost is very low. You just swipe. [47:50] And then this is the reason. [47:52] why people have been, when they want to break out of their [47:55] of their taste bubbles. [47:57] Or when they come into Spotify and listen to something completely new. [48:00] It is usually because they found it on one of these services, like a TikTok or YouTube or something. [48:05] where they get exposed to lots of new content. [48:08] So people were asking us for these tools. [48:10] And so that's what we wanted to solve for. [48:13] And so we built a bunch of features, feed-like structures, where you can go through either a new genre with many tracks, or a podcast genre with many episodes, [48:25] or even fold playlists. [48:28] And we implemented those and

[48:31] we put them in something called subfeeds. So in the current experience, and this is rollout worldwide, [48:36] If you click the podcast sub feed, you get a feed of podcast episodes. [48:39] Click the music sub feeds, you get a feed of... [48:42] Playlists. [48:44] where you can [48:45] quickly [48:46] You can go through many playlists, and if you don't understand the name, you can quickly hear what they sound like and check out a few tracks and understand if this is for you. [48:53] And if you go to the search and browse page, you can find [48:56] Completely new genres. [48:58] that you can quickly go through. [48:59] And so those are working as we intended. People go through them, go to them when they want to find the music. [49:05] They browse through them and they save new songs. [49:08] So they're working as we intend it. [49:10] The thing that didn't work as we intended was [49:13] When users asked us for this, [49:15] again and again, we took the sum of these things, [49:19] And we put it on home because people ask so much about discovery and we can see clearly how [49:23] how correlated Discover is with retention on Spotify and so forth. [49:27] But what we [49:29] will be misjudged or failed to, or rather learned about our own homepage. [49:35] Is that [49:37] The way it works right now, [49:39] And this is what you can see in the Twitter comments. If you remove the angry [49:43] voices and sort of try to see what they're saying. [49:46] They're saying the following, which is actually quite clear in the quantitative data as well. [49:51] that if you look at what people do on Spotify's homepage, the current one, [49:56] It is almost 90% what we call recall. [49:59] So it is either getting [50:00] to a session that you're already in,

[50:03] or a specific playlist that you know you want to get to, or at least a specific use case. So you come in with a high intent. You actually knew what you wanted. [50:11] And maybe only 10% of the time is a true discovery. Like, I don't know what I want. [50:16] So if you think about that, it's 90% recall. [50:19] and 10% discovery. [50:21] When we tested the design, so the subfeeds were working and are working, but we tested the [50:26] the sum of them on home, we kind of switch it from 9 to 10 to 10.90. So 10% recall. [50:32] 90% discovery. [50:34] And while people want discovery, [50:36] They probably don't want 90% discovery. [50:39] instead of 90% recall. [50:41] So if you then look at the comments on Twitter, what they're saying is like, hey, I can't find my playlist anymore. Like, where are these things? [50:47] They're not really complaining about the discovery. They're complaining about the things they don't get anymore. [50:51] And we can see this in the quant data as well. And you can see traffic shifting from home into search and into library, which is a clear sign people are trying to find [50:59] find the things they can't find anymore. [51:01] And you can even see people, [51:03] then trying to use these discovery tools, which are optimized for quickly understanding new things, [51:09] to do the recall, like where is that? [51:12] Workout playlist I know I want. [51:14] And it's actually a very bad UI for recall. It's kind of like a slot machine. [51:18] Very unpredictable if you ever get to that workout playlist. [51:21] It was optimized for finding new things, not for recall of existing things. [51:24] When you do recall, you want the dense UI [51:27] with many items on screen because you know what it is you're looking for. So you don't need a lot of real estate. [51:31] When you're doing discovery of new things, you want a lot of pixels.

[51:36] And you probably won't sound because you don't know what it is. [51:40] So, [51:41] what we learned about our UI, and I think there's maybe a little bit of, you know, [51:46] product jealousy here you always look at other experiences [51:50] And if you look around, [51:51] It could be forgiven for thinking that [51:54] most other products. If you look at something like YouTube, for example, [51:58] Their homepage is exactly that. It's a huge... [52:00] a single item discovery feed with only new items. [52:04] And people... [52:05] don't seem to tweet angrily about how angry they are to say that you love YouTube and it's a big product. [52:11] And I think what we discovered was that [52:14] We actually did something really well on our homepage, which was supporting you being inside of multiple sessions at the same time. So you could be in the middle of two podcasts. [52:23] and an audiobook. [52:25] And also then, actually, I just want to get to that workout playlist. [52:29] I don't remember the name of it, but I know it's workout. [52:31] We actually did that part really well. [52:34] I would venture to say much better than the other experiences where [52:36] You literally have to go to your... [52:38] to some tab and into library and start browsing. [52:41] to get back to where you were. [52:43] And so maybe it's path dependent. [52:45] Because we have done recall pretty well, [52:49] People got, I think, reasonably... [52:53] upset when they couldn't do the recall anymore. [52:56] And we really didn't want to lose that because it was one of the things we did well and underestimated. [53:02] And my takeaway is actually we do it better than other experiences. [53:06] So we certainly want to keep that

[53:08] So what we did was now we're just... [53:11] updating the hypothesis to achieve the same goal. [53:13] which is these things are working, and when people want to discover, they use them and they seem to work, they can... [53:18] Also get better, you know, [53:20] You're on this like... [53:22] hill-climbing journey from a machine learning point of view, [53:25] But the question is, [53:26] how do you make sure that whenever people feel that they are in that i'm trapped in my taste bubble [53:32] They understand that these things are there and they're easy to use. [53:35] So now we have a version of Home that we're also testing, obviously. [53:41] where these things are very available, but voluntary, and you can still do all of the recall. [53:47] And so... [53:48] From my point of view, this is the reason we A/B test. [53:51] Because, you know, you want to be scientific about it. [53:53] And, uh, [53:54] you know, [53:55] You want to learn as much as possible about your own product and your users. [53:59] And now I'm sharing a lot of the learnings. Maybe we should keep them to ourselves, but... [54:04] My hunch is that it's going to make it a much [54:08] Better product. [54:09] But what I told my teams when we went into this, because I've done this a few times, I agree to signing [54:13] I think there is a, [54:16] There are two fundamentally different types of product development. [54:19] One is designing [54:21] a new feature. [54:23] It is hard to make it, but it's [54:26] But it's voluntary for people to use. So you do the AIDJ. [54:31] Some people love it. That's fine. If you don't like it, it didn't make it worse for you. But when you redesign, it is much more tricky. [54:38] because it's not voluntary to participate in the redesign.

[54:42] So there's a cost even for people who don't like it. [54:46] You have a very tricky problem here, which is [54:49] there are going to be two types of feedback. [54:52] One is. [54:54] You did something. [54:56] And he was right. [54:58] But people are upset. [55:00] because you change stuff. [55:02] The other is you did something and it wasn't right, and people are also upset. [55:07] but for good reasons. And so how do you separate these two? Because [55:11] I think I explained this. [55:14] to, um, [55:15] When we talk through this with my teams, I think the analogy to think about is you have your desktop, your physical desktop. You have your computer in one place. You have a pencil over here. [55:24] You have your notebook over there. [55:26] And I come in and I just rearrange all of it. [55:29] and you have spent, in our case, maybe 12 years with that setup, [55:33] it doesn't matter if I have a lot of quantitative data that my new setup is better. You're going to get upset. [55:40] Because you are effective in this old setup. [55:44] And it's hard to tell those apart. The most classic use case is the Facebook news feed. [55:49] which people were very upset about when it became a single newsfeed. But it turned out to solve a lot of user problems. [55:54] that you didn't have to run around all Facebook collecting events yourself. [55:58] So there are some ways of understanding if... [56:01] If you made it better, [56:03] but people's habits are broken, or if it's not better. And one thing is, for example, to look at new user cohorts that don't have that, [56:09] behavior versus old user cohorts and so forth.

[56:12] So we went through all of this with the teams before we did it. I said, this is going to be painful, probably going to be a lot of tweets. [56:18] Because chances that we get exactly right are very low. [56:21] So for that reason, [56:23] It hasn't been very hard on the team. [56:26] It is hard. You want to respond to people, but the right way to do it is to listen. [56:30] understand, try new hypotheses to really figure out what's going on. [56:35] So I think I've done it... [56:37] maybe three or four times now, one. [56:40] three maybe one unsuccessful [56:43] to successfully. [56:44] I kind of knew what I was getting into. [56:46] So it's almost like you punish yourself. Very painful, but also, [56:51] the most exciting things. And I think [56:54] Any product person knows that's [56:56] The easiest, the most straightforward thing to do is to iterate around where you are. [57:00] There's no risk. You're not going to get fired. No user is going to get angry. [57:04] But everyone also knows that [57:06] Eventually, [57:08] If you don't adopt new technologies, new paradigms, etc., you're going to get replaced. You have to find this balance of trying new things. [57:14] When you work in software, you have this tool of A/B testing. [57:18] and being scientific about it. When you build hardware, [57:21] It's worse. [57:22] If you're wrong, you're wrong. You can't update. [57:26] I love this story. I so appreciate you sharing it. [57:29] I imagine also with a big launch like this, you can't actually A/B test it ahead of time because the press is in. They're like, "Oh my God, look what Spotify is doing." And so you're kind of limited there, I imagine. You couldn't really test this ahead of time. The hardest thing about this is if you're trying something completely new,

[57:44] the MVP [57:46] needs to be very big so you can build a new UI. But if you didn't do algorithms for single item feed, [57:53] You can't tell if it was the right idea, but [57:55] but poor machine learning, right? UI poor machine learning or the other... [57:58] You have to build a lot, and I guess quite expensive. That's actually [58:02] The biggest why it's painful is not really the feedback from the outside. [58:07] It is... [58:08] the cost you have to take on the inside. [58:11] You incur a lot of cost, so you're really hoping you're right. [58:15] And in our cases, [58:16] the [58:17] The changes on the homepage aren't that [58:19] hard for us to do. The important thing is that the underlying [58:22] Hypothesis of [58:23] Can we help you break out of your taste bubble? Actually works and then [58:27] you know, you update... [58:28] the acquisition funnels into that experience. [58:32] But I think the problem is, [58:36] that you need to get so many things [58:38] in place to be able to say, [58:40] You might get a false negative. [58:43] Just because I... [58:44] He didn't do it well enough. [58:46] That's the biggest chance, I think, with these big rewrites. [58:49] Everyone has to update everything before you can know if you're right or wrong. [58:52] What was the process like of helping you understand what? [58:55] is not working and what is working and what you wanted to change. I imagine there's a bunch of data you're looking at. [59:00] some [59:01] tweets, things like that, what was kind of the tactical... [59:05] Oh, shoot, something's not going the way we expected. Here's what we should do. [59:08] Well, the feeds we tested, but the home feed. [59:11] we rolled out and tested afterwards, and we tested that on users

[59:15] a few different variants of it, and then we got the data back. [59:18] And we look more at the quantitative data, and we do a lot of user research where people sit and use the [59:25] the feeds to understand and build like our own [59:28] Fear of mind of what is working and what is not working. [59:31] And then obviously you look at... [59:34] you look at [59:35] user feedback, of course, [59:37] and some users are very good at expressing what is that that isn't working others are [59:43] not as good as expressing [59:45] What isn't working? [59:46] So it can be hard to parse that. [59:48] But certainly that's a factor as well. [59:50] And so then once you do that, [59:53] then you have quantitative data to look at. [59:55] And then you sit and reason through. [59:58] What do you think is right and wrong? What are the different hypotheses? What is working? What is not working? [1:00:02] and then just update and test again and again until you find [1:00:05] until you disprove your hypothesis. [1:00:09] trying to be as scientific as possible about it, [1:00:13] And also, I think the biggest risk [1:00:16] Also, when you've invested so much time in something, [1:00:19] is you you know getting precious about things you have to just be brutal [1:00:24] You have to believe in things 100%. [1:00:26] Until the data says no. And then you believe in something else 100%. [1:00:30] That sounds easy. It's very hard to do to the extent that people get upset. [1:00:35] when you do it because [1:00:37] For some reason, [1:00:40] people don't like when people change their minds. It is what we should want from everyone. I would love a politician who said, "I looked at the data,

[1:00:47] And I realized, actually, [1:00:49] This is right and now I believe this, but we hate politicians that do that. [1:00:52] They feel untrustworthy and we ridicule them. [1:00:55] So, [1:00:57] I think that's the biggest risk. [1:00:59] with anyone. You just have to be like unemotional. [1:01:02] And just look at [1:01:05] The proof and the data. [1:01:07] And then, you know, if you do that, [1:01:09] Just move on and then you get to where you want to be. You solve the same problem, but you adapt. [1:01:13] I really like that philosophy. Essentially, it's the idea of strong opinions loosely held, right? Exactly. Exactly what it is. [1:01:21] And it sounds so easy, but it's hard. Right, because to your point, people don't like... [1:01:26] Don't respect someone changing their mind. They're like, oh, I see. They were wrong the whole time, and they were so confident about being wrong. [1:01:31] Yeah, exactly. And it's unclear why. [1:01:34] that is what we should want. [1:01:37] But I think it has something to do with human... [1:01:40] Human psychology. [1:01:42] We actually... [1:01:44] tend to love personally, [1:01:45] prophets and people who [1:01:47] Holds very strong opinions with very little data. Those are the people we like. People who look at a lot of data and actually that we don't like. [1:01:55] Not for why. [1:01:57] We're flawed. Flawed creatures. For sure. [1:01:59] Is there something that you've recently changed your mind about along these same lines that maybe comes to mind of like, oh, yeah. [1:02:06] Now, I think these learnings about [1:02:08] the what our home [1:02:11] The Science System and Homepage does really well. [1:02:14] maybe better than others. [1:02:16] that we don't want to wash out with the bathwater or whatever the expression is.

[1:02:21] I think that's the biggest... [1:02:23] Current learning? [1:02:24] I'm actually very, very happy about. Yeah, I love learning that. [1:02:28] We're doing something really well that we didn't really realize necessarily, and maybe we should lean into that more. [1:02:34] Exactly. [1:02:35] Go ahead and out. [1:02:36] somewhat different direction. Shashir Marotra suggested I ask you something. He's on your board, I believe. [1:02:41] And he suggested ask you about your 10% planning time. What is that about? [1:02:46] This is a concept that [1:02:47] I think Shashira has used for a long time, ever since he worked at YouTube. [1:02:52] And the idea is that roughly, [1:02:54] you shouldn't be spending more than 10% of your time planning versus executing or building. [1:03:01] How? [1:03:02] which means that [1:03:03] If you're working quarterly, sort of 10 weeks, you should spend one week planning. [1:03:07] We work in sort of six-month increment [1:03:10] So we try to spend [1:03:12] Two weeks planning. [1:03:13] kind of roughly successful. And this is... [1:03:17] Actually, when we talk about org models, give a shout out to [1:03:21] to Brian Chesky at Airbnb.com. [1:03:23] who is actually one of the first, I think, to have these more contrarian org models. He's much more Apple-esque than most of Silicon Valley. [1:03:30] It also works in six months. [1:03:32] increments. So he has a lot of experience in that as well. [1:03:36] So that's what the 10% planning time is. [1:03:39] And I think if you find yourself [1:03:40] Planning much more than that, you're either planning too much or [1:03:44] Your execution period is just too short. [1:03:47] for that amount of planning. It's a rule of thumb. [1:03:50] But I find that it works.

[1:03:53] I asked a few PMs what I should ask you, PMs that work at Spotify actually, that I haven't told you. And someone pointed out that you always bring a lot of energy and clarity. [1:04:02] to a room. That's something they see you as really strong at. [1:04:05] What have you learned about just the importance of that or just how to do that well as a leader? [1:04:10] Well, that's great to hear. I didn't know that, so I'm trying to figure out. [1:04:15] What's the answer? [1:04:16] Uh, [1:04:17] I think that... [1:04:20] The energy, I don't know. I guess I'm just excited about it. [1:04:24] What I do. [1:04:25] I've always been excited about technology. [1:04:27] I love... [1:04:29] seeing new things my core drive is still [1:04:33] This notion of you see something, which I think you'll empathize with, that doesn't exist yet. And you're like, wow, I wonder if that could exist. That would be so cool. [1:04:42] And then in order to get people to do it, you try to share that. [1:04:46] excitement. So I don't think I can bring a lot of energy [1:04:50] for something I'm not excited about. So I kind of have to work on things I actually believe in. [1:04:56] and that I am excited about. And so maybe then the energy comes more naturally. Unfortunately for me so far, [1:05:03] Spotify has been in this phase where a lot of innovation is allowed, and I'm even asked to try to do new cool things. Maybe I would have less energy for a pure optimization phase. [1:05:13] On the clarity... [1:05:15] I've always liked trying to explain things. [1:05:18] It's a well-known fact that the best way to understand something is to try to explain to someone else.

[1:05:25] So I go around explaining things to people who didn't ask for it. [1:05:29] And not to sound smart, but to see if I actually understood it. [1:05:32] And so maybe it's that practice. And on that note... [1:05:37] I actually do ask, [1:05:39] My leaders, [1:05:40] that work for me and I ask them to ask their leaders, [1:05:44] to always explain themselves. [1:05:46] And I think when we talk a little bit about autonomy and so forth, I don't think [1:05:51] We don't promise everyone that they have to agree. [1:05:55] But I think the promise we should make to all employees is that [1:05:58] Even if they don't agree, [1:06:00] they should be entitled to understand why. [1:06:04] you're making the decision. [1:06:06] What I don't think is acceptable is to say, [1:06:08] No, we're going to do it this way. [1:06:11] because I'm more senior, I've seen this a bunch of times, you're not smart enough, like all of those things. [1:06:18] I think you have to explain yourself. So you owe an explanation. [1:06:21] And I find that valuable. [1:06:23] Back to like the only way to understand something is to explain it because I, [1:06:26] It usually turns out [1:06:29] that if you can't explain it yourself, you probably don't really even understand it yourself. Sometimes, [1:06:35] I think it's possible that you can have [1:06:38] product instincts that are good, but you can't express them. [1:06:42] But most of them, [1:06:44] When people say there's something there, but they can't explain it, [1:06:49] They actually don't understand themselves. [1:06:51] And many times there actually isn't anything there. [1:06:54] And also, if you can explain it as a product person,

[1:06:58] that knowledge is now shared. [1:07:00] becomes [1:07:01] much more effective [1:07:02] for the organization. So sometimes I try to provoke [1:07:06] people a little bit and say, you know, [1:07:09] Many people ask, how much is [1:07:11] Heart vs. Science. [1:07:13] I say it's 0% art. [1:07:15] 0% magic and 100% science. [1:07:18] And that's, [1:07:19] Because... [1:07:21] I want to force people to try to explain it. [1:07:24] I think we used the word art and magic. [1:07:27] We have historically used the word "art and magic" for anything that we couldn't yet explain. [1:07:31] you know, um, [1:07:33] genetics was [1:07:35] with magic and art until it was science. [1:07:38] And, uh, [1:07:39] quantum physics with magic until it was science. And most recently, actually, [1:07:44] Intelligence and creativity. [1:07:46] It was art and magic until it was statistics in an LLM. [1:07:50] So I think I try to [1:07:52] push people to say [1:07:54] Are you sure you can't explain this? [1:07:56] Because that forces people to think through. [1:07:58] So that's maybe... [1:08:00] I like it. [1:08:02] And I try to force it on people, so maybe that's why people think [1:08:05] I sometimes bring clarity. [1:08:07] I love that. [1:08:09] Question along those lines. [1:08:10] Is there a system or an approach to explaining that you recommend? Is it just like write it out in a document? Is it explaining in a certain style or is it just like however is natural to the person? [1:08:19] I used to write everything. [1:08:22] and then write and rewrite... [1:08:24] and make it more and more condensed. [1:08:26] So that worked for me.

[1:08:29] I don't write as much anymore. [1:08:31] Now I tend to walk in. [1:08:33] talk in my head. [1:08:35] myself what what i actually do is i um [1:08:38] And I found it's different for different people. [1:08:40] A lot of people want to bounce something with someone else. That's how they think. [1:08:45] You kind of repeat the same thing again and again, and you get some feedback on it. [1:08:49] And so, [1:08:50] I used to write a lot. I sometimes do. [1:08:53] when it's an idea I want to understand better. [1:08:56] And at some point in my life, I would love to write something real like a book or something. [1:09:00] But what I do increasingly now is I do my one-on-ones with [1:09:05] peers or people who report to me or something. [1:09:07] and I just put on AirPods and do like a, [1:09:11] This is a beautiful walk and talk. Both people are... [1:09:13] walking, but in different locations. [1:09:15] and you spend an hour discussing something, [1:09:18] That has actually turned out to be very, very fruitful. [1:09:22] So then you get the power of you're not alone. [1:09:24] So you get more brain power than your own. [1:09:27] And I think, you know, [1:09:28] I don't think there is strong evolutionary proof for this. [1:09:32] but there's certainly indications that, [1:09:34] that you're thinking better when you're walking. [1:09:36] whether it's because you're oxygenating [1:09:40] your brain or [1:09:41] because it's evolutionary for some other reason. I'm not sure. [1:09:45] But I found that walking, talking, and thinking [1:09:48] Actually, [1:09:50] even if you're not in person, just over AirPods, it's super effective. It was the pandemic that kind of forced this. I thought we would get less [1:09:57] creative and that strategizing with software during the pandemic.

[1:10:01] I found the opposite. We had more of this than ever, and I started thinking about why. I think it's all of these walk-in talks that we did. [1:10:07] You kind of throw out there that you want to write a book someday. What do you think your book would be about? [1:10:11] I have no idea. [1:10:14] statistically it's probably going to be [1:10:17] about something that it did a lot. So it has to be about something with technology or product or something. [1:10:22] But I would love to write something fictional. That would be a lot of fun. [1:10:26] Oh boy. I'll pre-order as soon as that's up. [1:10:29] Another... [1:10:31] concept I wanted to touch on that another PM suggested, which is he called it the pee-in-the-pants analogy. [1:10:37] Does that ring a bell? And is that interesting to talk about? [1:10:40] I don't know exactly which occasion [1:10:42] This person is [1:10:44] referring to [1:10:45] But I know I've used that analogy. [1:10:47] A few times. Okay, promising. [1:10:50] I... [1:10:51] I don't know if it's like a Swedish analogy, [1:10:54] because I thought it was more widely known. [1:10:57] But the idea is that [1:10:59] You do something. So the saying is that's like peeing in your pants in cold weather. It feels really warm and nice to begin with. [1:11:09] and then after a while you start to regret it. It's about being short term, basically. [1:11:14] So now I just say that [1:11:16] I just say that's like peeing in the pants inside because people know what I mean. [1:11:19] It's a short-term thing. [1:11:21] That's a hilarious way of communicating that idea. [1:11:23] Must be a Swedish thing. [1:11:25] Yes, I think Swedish people do it for some reason. Apparently, others don't. [1:11:29] Maybe because it's cold a lot of time of the year? Yes, that's probably it.

[1:11:32] This is a saying in cold climate, in the warm... [1:11:35] It doesn't help. No one understands what you mean. [1:11:38] Speaking of Sweden, do you have succession? [1:11:42] Yes, I do. Okay, so Sweden has become a big part of the show, specifically the company trying to... I guess I don't want to spoil, but there's a character that's really... [1:11:50] Important, yes, exactly. That is Swedish. [1:11:53] And so I'm curious, just what do you think of the way they portray the Swedish culture and Swedish business dealings? It's super fun to see this as a Swede. [1:12:02] And I guess first and foremost, anyone or any person or any country that gets represented by [1:12:11] Super tall, well built, great looking Alex on the ScarScore. She's probably pretty happy. [1:12:17] So that's good. [1:12:19] Then I think... [1:12:21] There's this episode where they are in Norway without giving away too much. Yep. [1:12:25] There are elements that are authentic. There's a lot of... [1:12:29] of, uh, [1:12:32] I think, paid brand positioning from a Swedish brand named Fjällräven, which I think means Arctic Fox, which is actually a very popular outdoor brand in Sweden. So that's kind of, [1:12:43] That's kind of authentic. [1:12:45] The Sona things and so forth are... [1:12:48] authentic. So it's real, but it's exaggerated. [1:12:52] Actually, the thing that isn't very authentic is his negotiation style. Swedish people tend to be... [1:12:59] Serious? [1:13:01] cautious, [1:13:02] And this guy's more of a player.

[1:13:04] So he's not the typical Swedish guy. [1:13:08] Businessman from a negotiation tactic. [1:13:10] Point of view, I think. [1:13:11] Yeah, it doesn't make me think of the way you described it, where in Sweden people sit in a circle and no one's in the center. [1:13:16] No, exactly. He's very much in the center. [1:13:19] And then when people go saunas, they're just like a chant, sauna, sauna. Exactly. The last episode. [1:13:25] It is a great show. I love it. [1:13:26] I love it. This season is insane. I am so curious where it all goes. [1:13:30] Maybe just the last question before a very exciting lightning round. Spotify is [1:13:36] at this point the biggest podcasting platform for me specifically and i think globally [1:13:41] And I love using it. It works great. I'm curious just what's next for... [1:13:45] Spotify and specifically Spotify podcasting. [1:13:48] There are two sides to it. It's for Spotify creators and for Spotify listeners. [1:13:53] For Spotify creators, [1:13:55] there are two things. One is, and this is what we talked about at StreamOn, [1:13:59] We talked about it mostly for music, music discovery, [1:14:03] But it's the same problem and even harder for podcasts. [1:14:07] So we're still focused very heavily on helping [1:14:12] Podcasts, creators, find more audience. [1:14:14] Thank you. [1:14:15] uh, [1:14:16] This is, like I said, it's even a bigger problem to break out of your... [1:14:20] habits and your bubbles in podcasting is such a big investment. [1:14:24] to find a new podcast. [1:14:27] And so that is something I think we could and should do really well. So we keep investing a lot. [1:14:32] there. [1:14:33] And as I said, you'll see more as we roll up more features now.

[1:14:37] The other big need for [1:14:39] for creators as monetization. [1:14:41] And, [1:14:42] You can monetize today in many ways. [1:14:45] with DAI and Spotify, SAI and so forth. [1:14:49] Are we working hard? [1:14:51] to expand that and make it better. [1:14:54] because the industry is starting to mature. [1:14:56] And I think this is one of the biggest challenges. [1:14:59] needs and the biggest things we could do for creators to help them monetize better, actually both free and paid. We also have paid podcasts. [1:15:05] So that's on the creator side. [1:15:07] On the consumer side, I don't want to share too much. We've shown that we're investing a lot in [1:15:12] Discovery. [1:15:14] I want to keep some secrets for when they roll out, but [1:15:18] We are... [1:15:19] investing a lot in the user experience itself. I think it's far from [1:15:24] optimal yet, what it could be. [1:15:26] One thing that I can share that we're investing a lot in is [1:15:30] just the ubiquity and playback across different devices and in cars and all these things that we've [1:15:35] done well for music. [1:15:37] But I think the listening experience can get a lot more seamless. [1:15:41] I think search can get better, the data about podcasts and [1:15:45] Well, I don't want to say too much, but looking at, you know, [1:15:48] AI and generative technology, there's a lot that can be done. [1:15:52] All right, well, I'll take what I can get. [1:15:55] With that, we've reached our very exciting lightning round. I've got six questions for you, Gustav. Are you ready? [1:16:01] I think I am. [1:16:02] Let's do it. We'll find out. [1:16:04] What are two or three books that you've recommended most to other people?

[1:16:08] Okay, this is why I try to squeeze in seven into two and three. [1:16:12] So if we start with the own product, I think it's well known, but one that I would recommend probably people to read is Seven Powers by... [1:16:19] Hamilton Hammer. [1:16:21] which Netflix has used a lot. We use a lot. It's just, [1:16:24] If you're starting out, it's great to have a strategy framework. No strategy framework is right. [1:16:29] but having one is better than none. [1:16:31] Another [1:16:32] in sort of the space of mental models and frameworks, I think, is that The Complete Investor by Charlie Munger. [1:16:38] So yes, it's about investment, but really it's a bunch of mental models. [1:16:42] that he uses, and I think that [1:16:44] The key takeaway is, [1:16:46] You have a problem, you should always apply three different models to it. [1:16:50] because what models do is they... [1:16:54] simplify and reduce dimensionality. The world has probably infinite dimensions and it reduces to maybe three or four. [1:17:00] The risk with that is, [1:17:02] You happen to get rid of a really important dimension, like maybe... [1:17:06] pandemic diseases or something. [1:17:08] But if you use three models, [1:17:10] that have different dimensions and was reduced in different ways. [1:17:14] Statistically, [1:17:16] And it comes to the same conclusion. [1:17:18] Even the second model you apply vastly increases your chances that you're right. [1:17:22] So that was a good book to read. [1:17:24] then I think if we go outside of product, [1:17:28] I'm very interested in just science and [1:17:30] mathematics. So a few quick ones. [1:17:33] the mystery of the aleph. [1:17:35] An amazing book. [1:17:37] Something deeply hidden by Sean Carroll on the Everettian interpretation of quantum mechanics.

[1:17:42] Helgoland by Colin Rovella on the relational interpretation of quantum mechanics. [1:17:49] The Beginning of Infinity and the Fabric of Reality by David Deutsch. [1:17:54] The Case Against Reality by Donald Hoffman on evolution versus truth and that evolution doesn't optimize for. [1:18:00] Seeing the truth just for fitness. [1:18:02] Gerdel's proof, I think, is an amazing... [1:18:05] book on his incompleteness. [1:18:08] DRM, that in... [1:18:09] or any [1:18:11] axiomatic systems, there will be [1:18:13] true statements that can never be proven. [1:18:16] It's a weird thing to think about. [1:18:19] And then maybe one of my favorites is the demon in the machine. [1:18:23] by Paul Davis that I think is lesser known. [1:18:25] on how [1:18:26] Information is really just... [1:18:28] entropy and this concept of information engines, that you can power something by just information, and exhaust is also information. [1:18:36] That was not a quick list. No, but I was just going to say, you've set the record for the most number of books, but it also shows how you've, [1:18:43] becomes so insightful and wise is just, you know, reading. [1:18:47] books like these. And so I think if people are looking to [1:18:50] get to a place that you're at now, I think there's the lesson. [1:18:54] I'll keep the others much shorter, I promise. It's all good. We got time. [1:18:59] Okay, next question. What's a favorite recent movie or TV show? [1:19:03] So we talked about succession, and it is a recent favorite. [1:19:05] So I'll just furiously take something that isn't recent, but is an absolute favorite. [1:19:11] which is Hold and Catch Fire.

[1:19:13] which I think is on FX. [1:19:15] Amazing show. If you ever worked in technology, it kind of starts out in the Silicon Prairie in the 80s and follows up to present day. Amazing show. [1:19:23] I watched some of it. I actually fell off of it, but it's a good reminder to go check it out. [1:19:29] Gotta go back. [1:19:30] I'm going to go back. What's a favorite recent interview question you like to ask? [1:19:34] I don't ask it, but my favorite question is Lex Friedman's small ending question. [1:19:39] That is usually something like, so what's the meaning of it all? [1:19:43] I like that. It's a tough question to get. [1:19:46] I'm so tempted to ask you, but... No, don't. [1:19:50] Let's move on. That'll be another podcast. That'll be our second take at this. [1:19:54] What is [1:19:55] What are some favorite products you've recently discovered that you love? [1:19:58] The obvious one is. [1:20:00] is, uh, [1:20:01] ChatGPT, GPT-4, and just playing around with that, trying to create bots for yourself that do different things for you and so forth. But I don't think that's... [1:20:09] That's probably true for everyone. [1:20:11] The other really favorite is something you've written about and talked about. [1:20:15] which is Duolingo. [1:20:17] which I think is both very impressive from a product point of view, [1:20:20] the execution and [1:20:22] what they've done. It is also... [1:20:25] insanely used in my family. We have a family account and everyone is, you know, [1:20:29] using it and competing every day. [1:20:31] So I'm both impressed by the product and also use the product quite a lot. [1:20:34] What languages are folks learning within your family? [1:20:37] In my family, it's Spanish right now. [1:20:41] How's it going? [1:20:42] Bien.

[1:20:46] Thank you. [1:20:47] I only have like a few thousand XP. I'm not [1:20:50] that good yet. I don't know if that's good. That sounds pretty good. [1:20:54] Next question, what's something relatively minor you've changed in your product development process that's had a tremendous impact on your team's ability to execute? [1:21:01] I'm not sure I've done anything minor that had a tremendous... [1:21:06] impact [1:21:08] Usually it takes... [1:21:10] something bigger to get a big impact. [1:21:13] I think maybe one thing that I've tried to do [1:21:16] back to clarity and so forth, is... [1:21:19] This thing I mentioned about, I'm trying to push a lot for what I call Socratic debate. [1:21:24] where the idea is obviously that the best idea wins, not the most... [1:21:29] senior idea and so forth. [1:21:32] and trying to push for this notion of, [1:21:36] having people explain themselves. [1:21:38] Not saying, like, I think there's something there, I have a feeling... [1:21:41] or something like that. [1:21:43] And apparently, as you said, that has had some impact because people apparently [1:21:47] Say that about me, sir. [1:21:50] That's probably the biggest thing. [1:21:53] Final question. What is one fun ritual of the Spotify product team and... [1:21:57] is at Saanus. [1:21:59] So Spotify is big now. [1:22:01] that [1:22:01] We don't... It's quite local, actually. Different parts of Spotify have different... [1:22:06] product rituals. [1:22:07] I accidentally created one ritual many years ago, maybe 12 years ago. [1:22:12] when we talked about which phase the product is in,

[1:22:17] We needed some definition. [1:22:20] So I think sort of off the cuff, [1:22:21] I said like, well, you know, [1:22:23] It's four faces. It's ThinkIt, [1:22:26] Build it, ship it, tweak it. [1:22:28] And then to think it face, it should be cheap, you know. [1:22:32] Not a lot of money spent. [1:22:34] In the build it phase, you're going to start spending a lot of money. So then you must have reduced the risk in the think it phase that you're right and then [1:22:41] Then you have the ship it phase, and then you go over and tweak it. [1:22:44] And it was something that wasn't that thought through. [1:22:47] But it's funny because I still hear it, sometimes even from other companies. Like, oh, we're in the think it phase or we're in the tweak it phase. [1:22:53] So it kind of stuck. [1:22:54] I don't know if it's very good, but [1:22:56] It's stuck. [1:22:57] It is catchy. I think that anything getting stuck in people's head is a success. [1:23:02] Gustav, thank you so much for being here. We are two for two for Swedish people. Gustav with an F. Alstrmer was on the podcast. Who is also an amazing person. Also an amazing person. I feel very jealous of people that get to work with you and for you. [1:23:17] Thank you again for being here. Two final questions. Where can folks find you online? If they want to learn more, maybe reach out, ask some questions. [1:23:23] This is this at Gustav S. [1:23:25] Okay. [1:23:26] Say it again. [1:23:27] At Gustav S. [1:23:29] Awesome. And then final question is just how can listeners be useful to you? [1:23:33] Just reach out. [1:23:34] I do read feedback and I try to [1:23:36] remove the angry comments and understand what they're actually [1:23:40] thinking and why they're upset or what's not working. [1:23:44] And then the reaching out, would you recommend an angry tweet at you or more of an email to that email address you shared?

[1:23:50] Well, the @kustavess is the Twitter handle. [1:23:53] So just tweet at me. And you can be nice as well. It's okay. [1:23:58] Amazing. Gustav, thank you so much for being here. [1:24:00] Thank you for having me, Lenny. It's been a pleasure. [1:24:03] Bye, everyone.