Episode 36: Failure is an Option!
- Links to this episode: Spotify / Apple Podcasts
- This transcript was generated with AI using PodcastTranscriptor.
- Unofficial AI-generated transcripts. These may contain mistakes. Please check against the actual podcast.
- Speakers are denoted as color names.
Transcript
[00:00:11] Blue: Welcome to the theory of anything podcast. I am cameo and I’m here today with Bruce Nielsen and Tracy. You guys want to go ahead and say hi. Hey, everybody, this is Bruce. And this is Tracy. Happy day. So today we are talking about the importance of falsification when building software or products. So we wanted to try and take some of these concepts that we’ve talked about for a long time. Poppers theory of falsification and see if we could apply those to some of the real world things that are important to me because that’s this is the industry that I work in and I know you guys have some familiarity with that so I want to start today by kind of talking some history about how software used to be built and how we got to where we are today. Back in the day and I’m going to use, I’m going to use Microsoft Office Suite as, as the, the reference for for this conversation because I think it’s something most people have used for most of their life it’s probably the software that’s been more ubiquitous for most of us through many, many, many years I remember the first time I ever used Microsoft Office or Microsoft Excel when I was in college, you know, almost 30 years ago so it’s been a part of our modern life for a very, very long time. So, back in those days when a company like Microsoft would sit down to build a piece of software. Of course this software was going to be distributed on a floppy disk. Originally, and then of course that moved to CD ROMs, but,
[00:01:57] Blue: but originally this was going to be something you would go to the store, and it came in a big giant box, even though the disk was just a little floppy. And it came with user manuals and all of all of this ancillary things that you needed to be able to take this piece of software and install it onto your machine. And as such, they would release this you know the new version, every 18 months to 20 months because not just because it would take that long to build all the software, but it also you had all this infrastructure around the release all the, you know the user manuals had to be written and all the marketing materials had to be created and the boxes had to be printed and all of all of that kind of manufacturing side of software to support a software release. And this was how it was for all software for most of the early days of computers. And we, you know those of us that are older than 25 remember going and buying software, bringing the software home taking it out of the box and installing it. There were special stores you could go to to buy software. Yes, there were. Right, those are gone. Software stores existed. But then of course, things started to change at once we had early versions of the internet. As soon as the internet got a little more advanced as we started to move away from modems and the amount of data that could be pushed back and forth over the internet.
[00:03:39] Blue: Of course, one of the first things that ended up happening is software was able to be on the internet and we started to be able to interact with software that didn’t come in a box. And, you know, big applications like Microsoft Office still had big giant development and release cycles, usually on a still on a yearly basis but now those deployments would come over over the internet instead of being in a box. But then for the companies that and organizations that didn’t have that big heavy deployment lift. They still had, you know, a, a concept of do a bunch of build and then do a bunch of like a big giant release and you would. It was really typical during those days to have blackout periods when the new software was being deployed alright this the software is going to be down for 24 hours every month or every three months while we update your software. Behind the scenes for all of that was all of these people who are building this software and they had come up from a from a system where they would build software over 1819 months. Get it all packaged up. Hope it wasn’t too buggy. Honestly, and sometimes for Microsoft that hope did not pan out windows. I’m trying to think which of the worst windows. We could point to
[00:05:12] Red: There’s like some that you like don’t remember because they were so bad like windows 8.
[00:05:16] Blue: Yeah, where they release it. It’s so bad that you know everybody in their organization is scrambling to build the replacement, just because everybody knows it’s just absolutely horrible and people are skipping that update and people are just. And honestly, Microsoft did all of us a disservice over some of those years where I think they made people really hesitant sometimes to up to update their software. Yeah, and then you get into these behaviors where people would skip major releases on their updates, which by the way causes just tons of problems anyway. Enough rambling on that the this interesting side effect that I think is relevant here for us and talking about the importance of falsification is that software was built throughout all this time around the concept of really big bets. There would be people whose job it was to decide what features and functionality was going to be in a piece of software. And honestly they had no real way to validate whether or not those were going to be good features or the ways that they were building them. No way to validate that there were really going to be enjoyable by users clippy clippy is such a great example. Oh my gosh. Clippy right you know that somebody was really proud of clippy. Yes, multiple people right that they had they felt like they had solved this usability problem by giving people clippy to show them how to use all of the awesome features that that were actually already inside of work and you know it’s interesting because I took word and Excel right before clippy came out as a college course and learned really in depth functionality on on both word and and Excel.
[00:07:17] Blue: And really clippy was just there to try and teach people about a lot of these features that had been standard inside of those those applications for a while that people just didn’t know existed.
[00:07:28] Red: So, some people I mean like we’ve got age groups that won’t even know what we’re talking about when we say clippy. So we probably got to describe what clippy is a little bit manic.
[00:07:40] Green: I,
[00:07:43] Blue: you know, and if we were a visual thing. I think if we had a visual here of clippy clippy exists enough in pop culture. Yes, that even if people don’t necessarily know clippy’s name. They might recognize your
[00:07:59] Red: I agree clippy became the laughing stock. So like became the laughing stock clippy lives on to this day as a meme of what you don’t do. But,
[00:08:08] Blue: but ultimately clippy was just a user, like a walkthrough tool. And, and it was actually almost the precursor to a like a chat that would help you figure out how to how to do the things.
[00:08:27] Red: The basic ideas didn’t turn out to be bad, like clippy we all make fun of clippy because of the implementation. But the idea of a wizard that says let me show you the new features. We still do that today that that became an idea that was improved upon and we still use.
[00:08:45] Blue: It did but but men did people hate it and I, I don’t, I haven’t ever really thought about why people hated it so much or why it was so.
[00:08:56] Red: So clippy was a little animation of a paper clip that when you would run like say Microsoft Word, it would pop up and it would say, Oh, I noticed you were trying to do x let me teach you how to do that so you don’t have to repeat it all the time. And clippy would try to teach you how to use the interface more effectively. And the first thing everybody did the moment Microsoft came up is they would like Google the internet to try to figure out how to turn off clippy. I guess clippy was so annoying, like you try to do something in the middle of your work and clippy is like not letting you do your work and wants to instead teach you something about the the software tool. Yes, he had bad timing, all the time.
[00:09:39] Blue: Yeah. Well, you know, poor clippy because at the end of the day, like, he just wanted to help. Right. Um, so one of the things that I love about thinking about this this flow of software prior to the internet is of course they couldn’t have a way to validate a lot of the ideas, or effectively test some of these concepts and so a lot of software would get built that that people weren’t using. And, and in a way that has never changed, even with the, the start of the internet and now software is in a lot of ways much easier to build. But the interesting thing to me and and where I think we can really bring falsification in here is people wanted to get more effective at building software, of course, and and so during this time you saw the rise of things like agile methodologies, which were designed to try and make the development of software more effective and more streamlined. But none of those methodologies ever really worried about the concept of how are we validating that we should build this thing to begin with. How are we validating that people want clippy, even if even if we can see from usage statistics that people are not utilizing 50 % of these awesome features that we know would make their life easier. You know, there’s a huge assumption that they want their life to be easier right like we, we just decide that that’s something that that they want and then we build software to answer this problem that we believe they have, kind of like a god like okay we’re here to fix your problems we’re going to give you clippy to do it.
[00:11:41] Red: So, it’s also interesting to note that there was an attempt for a while to build stripped down versions of the software not like by Microsoft but like other companies trying to compete with Microsoft which is back then was a really bad idea. They would build like a word processor that only had the basic functionality you needed in a word processor, and they didn’t have all the the bloat of extra feature that that’s what they called the bloat of extra features. So it would be theoretically a cheaper piece of software but might be just as effective because of the 8020 rule. The problem was is that every is true that people only use 20 % of the features but everybody uses a different 20 % of the features. Yes.
[00:12:21] Blue: Yeah, that’s actually a great point and and ultimately the real problem at the end of the day is is that that that a group of people building software or company building software was still really more focused on output than outcomes. That the that the idea was how do we get all of these features into the software versus outcomes of how do we support varying kinds of users in the place they need to be, and and really solve their problems. There’s actually a great quote from a software guy that’s a bit of a hero of mine his name is Jeff Patton. He’s he’s a local guy here. And he says, When we’re building software we kind of get the idea that that our job is to fulfill these requirements or to deliver these feature sets. But really, our job when we’re building software is is to change the world. And he says yes that sounds a little bit flippant and a little bit grandiose. But at the end of the day, we’re responsible to pay attention to the way the world is now, and look to see if there are problems that we could solve to honestly make the world a better place and some of the problems are big and and life changing and some of them are are really small and might seem inconsequential and still can have really huge impact. And I’m going to share just a small story as an example of this that I think maybe can resonate with a lot of people I have a friend who posted on Facebook, a picture of a spatula. She had broken the arm that the handle off of her spatula.
[00:14:09] Blue: And she said I feel like this is the most privileged thing I could ever complain about but I’m heartbroken that I broke this spatula. She said I cook with a spatula every single day for like 15 years and I buy lots of other spatulas, because I know this one’s getting older and I keep thinking I’ll replace my spatula, but it fits perfectly in my hand and it’s got this really sharp place right at the beginning that picks up a pancake just perfectly without bending it underneath or like, you know those spatula can’t get under the pancake. She’s like this is the perfect spatula and I’ve never found it’s like and I can’t. I’ve looked and looked and looked and now it’s broken right and I thought, like, how funny that it’s 2021. And we don’t even know how to build a spatula right.
[00:14:59] Red: Our spatula technology has not improved our
[00:15:02] Blue: well and maybe it’s gone backwards because somebody got excited about about silicon and and what an awesome surface it is to not stick, but the only way to make it rigid enough to to flip anything is to make it thick. And so the person who got enamored with how this this silicon thing could could make a new spatula didn’t actually know what what somebody might want a spatula to do or, you know, it’s so it’s, it’s I think this really interesting challenge of the modern world is if we’re building things. How do we even know what problem we’re solving for somebody. And then how do we know that we’re solving it in a way that helps them, you know, because something like a spatula. If you said like what problem does a spatula need to solve for somebody they’re like it flips things right and and some of the things that might be important is I don’t want it to stick to my food. And maybe you don’t think about like how important the handle needs to feel for you know she even said, I have these little teeny hands and all these spatulas have these big round things and they feeling comfortable in my hand and so okay.
[00:16:23] Red: Don Norman’s book the design of everyday things. Yes, yes, that’s what he talks about in his book is the way we often end up trying to design things to look cool, instead of just be useful.
[00:16:37] Blue: Well, and I would say Bruce that that the interesting challenges. I don’t always think we understand what makes things useful.
[00:16:45] Red: Yeah.
[00:16:47] Blue: So, so that was software back in the day, agile came in and agile said, hey, we need a couple of things we need to be doing here, we need to be building
[00:16:59] Green: software in in smaller increments and
[00:17:02] Blue: and agile as a as a methodology kind of and I don’t want to call it just a framework but just almost as a conceptual thing knew there was value in building smaller batches. And in in building incrementally, it had some notion of the concept of like a build learn cycle. But I would say over the last many years as most companies try to use agile in in real life that the idea of of the incremental and building and smaller batches as a learning mechanism isn’t talked about as much as a lot of the other side effects of agile. Like, I would say that that is not the primary reason that companies use or and I don’t, I mean, I don’t know, Bruce, do you hear that talked about in the circles that you’re in and building software and no, there’s the benefit of agile.
[00:18:07] Red: So, there, like we could, we should do a whole episode on just agile development, because it ties so deeply into theory of knowledge. But it is so easy for agile to very quickly become just something you do because everybody else is doing it. And with no real rhyme or reason as to why it matters. In the moment you do that you end up with kind of a worst of both worlds type situation where you where you now lack the benefits of the old traditional style which did have benefits I think people often miss that fact, you know, mixed with none of the benefits of the new stuff.
[00:18:52] Blue: Right. No, keep going. I’m sorry.
[00:18:56] Red: Well, it’s, and I think it’s a tough thing like I, my boss at work this is not my current job but previous job. He, he brought in some agile experts to teach us agile. And I was in a meeting he himself didn’t really seem to understand it that well.
[00:19:14] Blue: Sure.
[00:19:15] Red: And which is pretty common at a CIO level they kind of know it’s a buzzword I need to make sure I’m doing it, but they don’t really necessarily get it. And in a meeting, he, he started talking about how he wanted to make sure everybody’s cadences were on the same date because that’d be convenient and they needed to use the same point system. And the, the consultant who had been brought in to teach agile goes, Why is it that you like agile, do you like agile because you like estimating things in points, or do you like agile because you like the fact that it actually produces better software. And this is exactly the right point that he immediately starts making fun of her, you know, in a fun way but, but he wasn’t getting it right really just wasn’t getting it. To him agile was just this methodology he had to make sure people were doing because that’s what good CIOs did. To the consultant agile had no purpose, unless you were using it to try to get a fast feedback mechanism on your software. And there was no other purpose to it. And in so far as points or whatever in the methodology wasn’t useful to that purpose you should do away with it. Right. It just do it only if it’s going to work. And the consultant had exactly the right attitude. And that was one of the best implementations of agile I had ever seen in fact you and I were when that first happened you and I were still working together.
[00:20:45] Red: So I, I was a consultant so I would have my customer who treated me like an employee and then I was working with cameo at the actual company I worked for. And I came back and I said I’ve actually seen one of the best agile implementations I’ve ever seen at this company. It didn’t last, though, it started to fall apart within a few months. When the consultants left when there was pressures from above. It became increasingly hard to hold the agile implementation together, because nobody really cared about you they weren’t there weren’t rewards built around it. And so people would immediately start falling back to a more traditional mindset. And yet they kept the, they kept all of the imagery of agile they still talk. The
[00:21:29] Blue: ceremonies and the, the way of talking.
[00:21:34] Red: Yes. Yes. So they still talk as if they were agile they still acted like they were agile they were going through the agile motions, but the actual agile this was gone,
[00:21:45] Blue: which I think is the most common implementation of agile right now. I agree the methods. And I think, because most organizations, either, like you say, by agile for the buzzwords, or and I, you know, I work for a big agile consultancy now so I’m pretty deep in this world. Most of the customers that I see, they buy agile for predictability. They that what they want is a predictable cadence of delivery. And, and agile can give that to them. Um, you know, a high performing agile team you have things like velocity where you can say, we’re pretty routinely going to build XYZ in X amount of time right and and executives love that because knowing how predictable your system of delivery is really makes feels awesome because you can say hey you know we’re going to request XYZ of our IT department, and they’re going to give it to us in three months and we can estimate these things and get it out the door. By the way,
[00:22:58] Red: how predictable have you found agile to be.
[00:23:01] Blue: I believe that it that if you’ve implemented it fairly with with a lot of controls, it can be quite predictable.
[00:23:10] Red: I think it’s fairly predictable in terms of its output. I don’t think it does as well in actually predicting when your projects going to be done.
[00:23:19] Blue: Well, done done is an interesting word. Because most companies view done as the place where we got to that matches our assumption. Yeah, from when we started.
[00:23:34] Red: Right. I don’t know I don’t even know if agile. It may do a better job than traditional traditional used to have these spirals out of control that agile just doesn’t seem to get into anywhere near as often. And those spirals out of control created mass in predictability for unpredictability for a number of reasons. So maybe agile does help solve that problem and thus creates greater predictability. But my the honest truth is is as an agile project manager there’s no such thing but as an agile project manager. The main thing I did was, I didn’t try to match the schedule, but I did understand how to use agile’s ceremonies and everything to get the customer to come along and them to make changes to the schedule. I don’t know that I was necessarily more predictable if you’re looking at it on a project level. I think what it did though is it created this level of communication that allowed the customer to become comfortable with the fact that some things had to change now and again. And they felt like they were making the decisions instead of me, which made a big difference emotionally
[00:24:41] Blue: has a number of things that does well like that.
[00:24:44] Red: No, that’s actually
[00:24:45] Blue: a great point. They, they are front row participants and deciders of of their own predictability. They have the ability to choose to be predictable at the end person who’s kind of making those choices, which you could put under the umbrella of the business. But you know predictability at the end of the day is a pretty useless metric I mean it’s desirable if you don’t have it, like if you don’t have a trustworthy system of delivery, but, but output isn’t what makes an organization money. And ultimately, a company only earns or saves money when the software they built is is used by users and when users like and enjoy it.
[00:25:37] Red: So, and when it solves a problem, when it solves a problem. Yeah,
[00:25:42] Blue: you know and I don’t. There is definitely this focus on problem solving within within software for I think for non software people sometimes that’s a funny thing way to describe it because a lot of the way people use software in their day to day isn’t isn’t necessarily about about solving you know when I sit down to play, you know, a game a video game on the on the switch with my kid, neither of us think about the fact that we’re sitting down to like solve a problem. Right, we’re we’re that’s not what we’re doing we’re sitting down to have fun with each other and play and you know a fair amount of software, especially in the consumer space falls in under that umbrella of that that the end user doesn’t think about what they’re doing as you know quote unquote solving a problem. Yeah,
[00:26:38] Red: just as a side note on that though, the whole concept of gamification is the realization that game interfaces are very specifically about solving made up problems because it’s fun to solve problems. And so they’re trying to figure out ways to apply that to real world settings. Well, and it’s fun to
[00:26:58] Blue: compete.
[00:26:59] Red: Yes, yes,
[00:27:00] Blue: because I think that’s also a big part of what the appeal of gamification is is that people like to to compete with each other and get awards. Yes. Also, you know that you, when, whenever I see, so you pretty regularly see people like talking about kids today they need, you know trophies for everything participation trophies. And I always think about gamification because gamification has taught us that everybody likes a participation for a trophy. Yes. Even though we just want to disparage the kids and say it, you know, it’s all their fault for for wanting to get rewarded for doing almost nothing so So, over the last I would say, well, some something happened over the last several years. And, and a gentleman named Eric or Rios released a book that was called lean startups. And he did a bunch of things really wrong that will give us pain for many years one of them being how he used the word MVP. But ultimately, what he did right for software and what I think is going to be game changing for products in general over the long term is he said, Hey, our job is not to build software. Our job isn’t even to, when we build software we’re not even we shouldn’t even be saying oh I’m coming in to solve a problem. Our job is to build a test to validate our assumptions. And every piece of technology we build should always be with that being the first thing that we do an experiment that’s designed to either fail or succeed. But ultimately it’s designed to to teach us how to solve a particular problem or in some cases to validate that it’s even a problem worth solving.
[00:29:03] Blue: And, and this is where I think that software is going to lean very pop area. Um, because, you know, as we know from from being on this podcast Carl Popper his falsification principle suggests that for a theory to be considered scientific. It must be able to be tested and conceivably proven false or true. And I think that the same ends up being true for any concept that anyone wants to build, whether it be a service or a product. Our first job is to to figure out how something can be tested. And can it be, can our assumptions be proven false or correct. And so here’s where I think that things start to get very interesting for people working in in technology because seeing your job as the response that our responsibility is to create a series of tests. Is a totally different job than our responsibility is to create a bunch of features that we’re going to sell to people. Yeah. And it’s, um, it’s interesting because on LinkedIn, I’ve been posting a kind of fairly regularly about the concept of failure. And, you know, businesses are traditionally super failure adverse. And so even before you include agile or software, you know, business leaders, their job is, is to not fail. Right. That’s, that’s ultimately what people, oh, you know, they go and get MBAs so that they can come up with better concepts so that they’re less likely to fail. Um, but then all those same people will come and they’ll sit down in the conference room, and they will come up with a bunch of assumptions that they’re going to fund in the in the form of big initiatives or, you know, whether they be marketing initiatives.
[00:31:24] Blue: Because there’s still every single one of them, based on a set of assumptions that a person has that might be educated assumptions but they are still just assumptions. And then they fund them and then they go in and deliver on them. And then you know somebody’s a failure if their assumption is incorrect, then we fire them, and we move on to the next person.
[00:31:48] Red: To put this in perspective with epistemology, a business initiative could be thought of as a theory. Right. It’s a theory for you’ve got some theory. If we build this functionality, then it’s going to increase our sales by this much because of this reason, or
[00:32:08] Unknown: there’s
[00:32:08] Red: something along those lines, right. And then actually going and implementing it, you’re actually trying the theory out and exposing it to do you think
[00:32:18] Blue: if you were to go into the boardrooms across the world and describe what they’re doing that way. Do you think that that, you know, these business leaders sitting in boardrooms, do you think that they would agree with you that that’s what they were doing.
[00:32:32] Red: No. And if they did, I still wouldn’t believe they actually believed it. Right. It’s even ones that say well we want to fail with I had a boss who used to say we want to fail with flair, right. He wouldn’t let you fail in anything. Right. I mean like he would just, he gets so angry for every little perceived problem. Right. It’s, I don’t think that’s the way we’re wired. And I think there’s even kind of a rationality to it and maybe there’s even a little bit of truth to it even false ideas usually have some truth to them. Right. And the idea might be something like this if I try to put it in its strongest form. We’re hiring you Mr VP because you have experience in this field. And so it’s up to you to have the right theory as to what’s going to actually make us money and your theory failed therefore you failed and so we’re going to fire you. And, you know, maybe I’ll even give a little bit of credit to that way of thinking but let’s be honest the real truth is that you’re never solving the same problem twice. Right. It’s just because someone has experienced with some seemingly analogous problem in one area doesn’t mean that they therefore know how to solve the same problem in a, we call it the same problem but a similar sounding problem in a different area. You’re always actually trying to be creative you’re actually always trying to come up with some sort of completely new solution to a completely new problem unique to your business. That has never been solved before in the history of the world.
[00:34:05] Red: If it is a problem that is actually solvable by known knowledge, you probably don’t even perceive it as a problem. You probably just go buy the piece of software you need to take care of it and you’re done. Right.
[00:34:19] Blue: Well, and, and it’s interesting because they’re, you know, one of the things that gets talked about a lot in product management. When, when, when polio was running rampant, and the iron lung was the way that you treated polio. Yeah, you can go in and keep figuring out how to make a better more efficient iron lung. But ultimately, what what you really need to be doing is figuring out how to how to cure polio or or immunize against disease that forces people into a situation where they need an iron lung. You know, if I’m, if I’m a manufacturer of iron lungs, I probably don’t have the expertise to even start to envision how to build a, you know, something to immunize people with polio. But it is interesting to kind of try and get that perspective of what is the, the right set of problems to actually be trying to solve, you know, and, and you’re right about people are hired for their expertise and their expertise is supposed to ensure that these bets that the companies making are successful, right.
[00:35:38] Red: Yeah.
[00:35:40] Blue: So, my big thing now though is, by the way, let
[00:35:43] Red: me just make a comment here. It’s, it’s interesting that we kind of talked about this in the interviews with Bart where he was talking about how he tried to come up with a consultant company that utilized poppers epistemology to encourage companies towards knowledge creation. Right. But there’s this idea, you have to conceptualize your company correctly. And that’s not even necessarily an easy thing to do. So like let’s say you conceptualize your company as Polaroid, as we create, you know, Polaroid cameras. If that is your expertise and that’s the problem you’re solving, you are literally just out of business the moment the digital camera and phones come into being right because your problem just dried up entirely. Right. If instead you conceptualize yourself as we’re a company that’s experts in photography, then you have a more generalized problem you’re trying to solve and you’re trying to figure out how to keep advancing that problem which goes well beyond the need for Polaroid film. That’s something valuable to the market.
[00:37:04] Blue: Well, and I would, I would suggest that’s that’s because their boardroom was filled with people who didn’t see their job as to come up with concepts test those concepts and then use those within the market. Their job is to bring the expertise from their past experience and and to make predictable bets based on past experience. Yes. So and this is where I think we’re at this really cool. Let’s take risks and make mistakes kind of turning point with it within the professional world, and that software and technology, I think is leading this, you know, as as definitely the tip of the spear because if you don’t have a physical product, the idea of creating a set of tests is a whole lot easier than if you have a manufacturing cycle or if you have, you know, and so I can come up with concepts all day of software I want to build and come up with cool ways that I could test those concepts of prototype them without ever needing to build software you know there’s there’s lots and lots of ways to do that but I think it gets more difficult if you do have a an actual physical product that you’re trying to build and but only just barely you know that the emergence of things like 3D printing allow us to to come up with concepts and have them in a physical form sometimes within hours. Very cool.
[00:38:40] Blue: But, but ultimately, the key to all of this is to change our mindset within the business world from being confidence that we have the right expertise to solve this problem to assuming we don’t have the answers at all for how to solve the problem and that our job is to come up with small failures that a small tests that that we can use to validate those assumptions way before we we expend energy or effort on trying to to manufacture produce in our solutions.
[00:39:21] Red: That makes sense. And that would be how you apply the concept of creativity to a business, right is obviously all businesses have to be creative in some sense, but you’re expanding that notion, well beyond the guard rails that usually exist of trying to take a specific business that you already have running and maybe make it a bit more efficient or something along those lines to how do we actually provide whatever value we need to within our space to the market.
[00:39:52] Blue: So can I extrapolate an assumption out of what you just said, which is, is failure required for creativity.
[00:40:03] Red: So, I think. Yes, I would be my answer. I think you could make up some scenario where you just get lucky every single time. And, you know, your first conjecture happens to be right. But I think even in a case like that, that would be a misunderstanding, because the real truth is is that the conjecture process has many levels to it. And so you probably came up with an initial even if you got lucky and your first conjecture was exactly was the Walkman, you know is exactly what everybody really needed but didn’t realize they needed. You actually probably went through a series of conjectures at some other stage where you had to kill initial bad conjectures. So my guess is that creativity always requires the death of ideas, and therefore in some sense failures.
[00:41:00] Blue: I think I’m in love with the statement that you just said. Creativity always requires the death of ideas. So you know when we were talking about AlphaGo last week was that last week.
[00:41:16] Red: That was last week.
[00:41:17] Unknown: Yeah,
[00:41:17] Red: or two weeks ago,
[00:41:18] Blue: two weeks ago when we were talking about AlphaGo. So, you were mentioning kind of these intuitive leaps that AlphaGo was making. Do you think that AlphaGo, I mean, so much of what AlphaGo was doing is non visible, just watching, you know, maybe even to the programmers that these calculations within its program. Was it making lots of these kind of creative failures and learning from those.
[00:41:47] Red: It does. Yeah. So think about the episode where we talked about how reinforcement learning actually works. And that was why I did that episode first before we talked about AlphaGo. And remember, maybe you won’t remember this but there’s something called the Explore -Exploit trade off. Okay, that was one of the things that came up in the podcast episode. That is the key to how reinforcement learning works. Reinforcement learning explores failed approaches as a way of trying to find ones that work better than its current policy. And there’s a whole, there’s a whole science to it. Right. And there’s tons we can go into. We so barely scratch the surface with reinforcement learning. But if you just always follow your best policy, then you get stuck in a rut and you can’t improve. But if you always just explore, then you’re not utilizing the knowledge that you gained. So you have to have this careful trade off before between Explore -Exploit and basically what you do is you turn it down over time. So you start with initially a heavy Explore basically making random moves in grid world. That’s the way it would work. It would depend on the problem you’re trying to solve. And then later on you start turning down how often you take random moves and you start favoring instead following your best policy. But you never actually, at least during the training phase, you never actually get rid of the Explore -Exploit trade off. And the reason why you don’t is because it’s known that you can only arrive, the theoretical mathematical guarantees of arriving at an optimal policy only exist at infinity so long as you’re always doing some exploration.
[00:43:34] Blue: That’s fascinating if you look at it applied to the business world, because I think you could say the same set of rules are critical for a company. Because companies have it, there’s a cycle you can follow for businesses where they start out, they tend to be creative when they’re initially starting out on varieties of different ways that they want to try and solve a problem. And then as the organization becomes more and more mature, it solidifies processes around all of those things and becomes less tolerant to exploration as a rule, because it knows how to leverage that maturity, predictably to guarantee some sort of return. But you stop having that creativity and risk taking kind of test as part of your key makeup, and then the organization stops being competitive within the market and ultimately dies off. In fact, that’s why we’re seeing it used to be that a company could be successful over 12 or 15 years. And now they’re seeing the length of time that an organization kind of can grow and then contract is shortening. And, and, and I think it’s because of that because the cycle of innovation across the world is getting faster, but that inclination of humans to shy away from creativity, the more stable we get is kind of just baked into who we are.
[00:45:21] Red: Yeah, you might even say that, you know, reinforcement learning is not the same as animal reinforcement learning those two are very different things. But obviously the computer one was inspired by the animal one in so far as some computer scientists thought he understood animal reinforcement learning but in fact didn’t really. But there is some overlap there. And what you’re kind of saying is is that, you know, humans are still animals we still have kind of an incentive structure that, you know, pain, pleasure, things like that that apply to us. And we have kind of our own explore exploit trade off that we do. If we looked purely at animals is everything’s harder with humans because in theory, we can change our own ideas. Right. This is the theory. This is the universal explainer ship the fact that ultimately ideas went out that in board in board ideas are never permanent. But particularly with animals where that’s not true. You can really see this idea of curiosity and we know it also applies to humans where curiosity is something that’s important to the survival and we’re going to do animal intelligence is one of our podcasts. And there’s a reason why animals and even humans have this, this natural curiosity it’s because there’s survival value in doing exploration. Right. But then they have to get just be curious. Because that’s not a good survival strategy they have to mix it with fear they have to mix it with this impulse to pull back from the curiosity and have conditions under which they are curious and conditions under with, which they’re not curious and that they’re just too fearful.
[00:47:05] Red: And so there’s I think you’re right there there’s going to definitely be a natural built in for humans, propensity towards both fear and curiosity that are in conflict with each other at times. And I think you see that in businesses right you know if you’ve captured some market your, your first impulse is to try to defend exactly what you’re currently doing because it’s been working, you know up to this point.
[00:47:28] Blue: Yeah, so the kind of that’s, I don’t know how heavily I brought Popper into this conversation. I remember when we had Bart on, and I, you guys were talking about like why do more companies not use philosophy within their, their business models. And I think I had said something at the time like nobody’s looking at philosophy right and they’re building a therapist. Do
[00:47:54] Red: you know I, I’m going to agree with you on that. And let me, let me go a step further. It just the Carl Popper described what actually was already happening with science. Right. And he didn’t even initially realize it could be generalized to other areas his interest was in science. Sure. And, you know, Donald Campbell was the one who started talking about evolutionary epistemology and Popper endorsed his ideas as we’ve talked about, where he was really trying to figure out, hey wait a minute this these ideas apply all over the place they’re like ubiquitously all over the place knowledge creations going on. And it’s important to understand how it actually works. But the simple truth is this, you don’t actually have to know the philosophy to be able to do, you know, error correction, you know, philosophy that doesn’t have to have anything to do with it. Scientists are really good the scientific community, let me actually clarify scientists personally aren’t very good at error correction. The scientific community is awesome at it. Okay, yes. In fact there’s a book John Roush, the Constitution of Knowledge that I just finished reading we should actually invite him on the show sometime where he he has worked out. So Popper understood the importance of institutions but he didn’t really explore it very deeply. So John Roush is trying to explore how do institutions affect our ability to create networks that produce truth versus networks that produce error.
[00:49:27] Blue: Oh, fascinating.
[00:49:29] Red: And he calls that the Constitution of Knowledge it’s an analogy with like the US Constitution or for that matter the British Constitution which isn’t written down. What are the traditions what are the, the, the ways of doing things what are the organizations that exist that allow a network to be more likely to pass truth than error, and then he gives the example of Twitter or Facebook versus the scientific community. Twitter and Facebook, at least the way they’re currently set up by far and away they favor falsehoods over truth. Right. Okay Wikipedia that’s not true Wikipedia absolutely favors truth over falsehoods, the way it’s currently set up because it, it’s far more similar to the scientific community which is this tradition that we’ve built up that we know really does favor truth, and he explains how the nodes in the network there’s no central organization, but the nodes just don’t do a good job of passing along falsehoods that they there’s things that exist that just make it so that they tend to lose interest in false theories and the false theories tend to die out. Whereas with Twitter and Facebook the false theories tend to spread better than the true theories, because their attention grabbing and things like that. And basically what he says is this is this idea of the marketplace free marketplace of ideas. He says, by itself that would never work you actually have to have certain institutions in place to favor truth. And if you don’t have that or if you let those get destroyed, then you’re not going to be favoring truth anymore.
[00:51:04] Red: And in many ways I think that’s what we’re talking about with business as well right it’s it’s, it’s not just a free for all you never want just a free for all, because that really doesn’t favor the truth. And then popper wasn’t so much saying science should be done this way. He was trying to understand why science was effective. And then he was trying to describe that. Once you’ve described that then that becomes really useful then you can say well how would I apply that to a business setting. Okay, but you don’t have to. Feynman famously said that scientists need to understand the philosophy of science, like birds need to understand the, you know, the theory of flight. It’s, you don’t really have to understand it to be able to do it well, you just have to be part of the organization that has the right institutions, and a lot of those institutions grew up by chance, right they’re the ones that happened to work. It’s evolutionary. That’s the way this works. And because of that, you really don’t have to bring popper in to be effective, but it might might make you more effective if you actually understood what was going on if you actually had a good theory for how does knowledge get created, and then try to figure out how to apply that that might make you more effective. But there are other best practices out there radical candor we talked about agile we’ve talked about that weren’t really inspired by popper’s philosophy, maybe a little bit like in the case of agile some of the agile lists were inspired by popper but a lot of them were also inspired by coon. So I mean like, it just sort of depends.
[00:52:39] Red: So it’s interesting when you bring science into it because popper or not core to the concept of science is the idea of making a hypothesis and testing the hypothesis.
[00:52:54] Blue: Yeah. That is a missing concept from business.
[00:52:58] Red: Yes. And you can get the absent. Even if you don’t know popper, you could look at the scientific community you could say, what are they doing right that we’re not doing. And you could come to the exact same conclusions as if you tried to take poppers epistemology and applied to business. Right, because it’s the same thing. It’s you’re looking at what actually works in real life to find the scientific theories that are the ones that have the highest verisimilitude, the ones that are the truest. How do you go about doing that. It’s really the same thing that you’re there’s only one way to do that. Right. There’s only one way to do that. There’s only one way to do that you’re either going to follow the scientific method which popper says doesn’t exist but I’m going to use it in a very general sense. You’re either going to use that in business and your business is going to grow knowledge, or you’re not in your business isn’t going to. So
[00:53:52] Blue: I will tell you though and and I’m only basing this off of kind of my experiences on on LinkedIn where I have a large enough following that it’s an interesting sample size. But I’ll tell you nothing will get people riled up, like me suggesting applying the scientific method, quote unquote, to business. Yeah, like people will come out and say, Oh, good luck with that you’ll drive companies into the ground like I’ve seen people say that to you.
[00:54:24] Red: Yeah.
[00:54:25] Blue: Passionately that this, like I am speaking radical concepts to suggest to apply what works for science to business. Right. It’s it’s it’s really shocking to me that it that it that it seems so foreign to people. When we can see that concept and that approach, working so successfully to create scientific knowledge. Yeah,
[00:54:53] Red: you know, let me just go on a limb here. If you were to go to the average scientist and ask them, why does science work. I don’t think you would get a good answer from the vast majority of scientists.
[00:55:07] Blue: Interesting.
[00:55:08] Red: I think a lot of it is professionalism. They get trained to do things in a certain way and they don’t truly understand why in a lot of cases. Right. Because a lot of it just grew up as traditions. Nobody implemented it for a specific reason or if they did the reason didn’t necessarily come with the tradition. And this is the way traditions work. Right. I think when I’ve seen scientists talk about a scientific world you they consistently I mean the one I just can’t even think of exceptions, they consistently explain it wrong, right and in really bad ways. One of the ones that I used to put on Facebook, given up on is they would like put here is the mindset of a scientist, you know what, I don’t care about the mindset of the scientists it it has so little to do with the progress of science. And it’s you know they have to be rational they have to be looking for, you know, what’s wrong with their ideas and there’s nothing particularly wrong with any of these things. But one individual scientist is never going to get there what’s really matters is is that they’re part of a culture where they have to subject it to other people who think differently. Right, then they have no choice even if they’re completely ideological, they’re going to have zero choice, but to buttress up their arguments against who they’re going to encounter to figure out how to make experiments that anyone else can can subjectively do, they will naturally move the right way, not because they have the right mindset it doesn’t matter if they have the right mindset that much at all.
[00:56:43] Red: Okay, but because they’re part of this community and they know they’ve got no choice they’re going to be a laughing stock if they don’t right. And that’s kind of shows just how important the institutions are, and how they really matter more than the individual mindset. One could argue individual mindset still matters. And I think you can make a good case for that. But even Popper talked about the importance of the dogmatic mind right he kind of started off thinking that that was a bad thing and then changed his mind over time that a lot of cases the reason why science works is precisely because individual scientists are dogmatic and they won’t give up on theories easily. So they therefore force that community to deal with the strongest possible defenses and criticisms of a theory that’s false until it’s been fully dealt with rather because you don’t know upfront which theories are true and which ones are false, you have to. The community needs dogmatic individuals who won’t give up on ideas easily, or the community won’t be considering some fairly good ideas long enough or well enough that they actually develop into good ideas.
[00:57:54] Blue: That’s interesting.
[00:57:56] Red: Just to use this as an example, general relativity from Einstein. Did Einstein general relativity, like, this is literally one of the two greatest scientific discoveries of all time the one being quantum physics, right. He did not win a Nobel Prize for general relativity. They did give him a Nobel Prize they couldn’t deny that he was producing some really interesting stuff so they gave him one for the photoelectric effect. But like Einstein won a Nobel Prize for the photoelectric effect, not for general relativity think about that for a second. Okay, and the reason why is because his ideas were considered controversial.
[00:58:39] Blue: Right, they were considered maybe wrong.
[00:58:42] Red: Yes,
[00:58:42] Blue: controversial right that’s. Yeah, you can’t give somebody a Nobel Prize if they screwed up,
[00:58:48] Red: right.
[00:58:50] Blue: So maybe you should.
[00:58:53] Red: I mean, you know what, maybe we should. Okay, that may not be the way we currently think of the Nobel Prize and that’s the problem. But if your idea that failure is good. Maybe we should have given Einstein a Nobel Prize for a theory that we thought might be wrong. You know that that would maybe make some sense if it solves some really interesting problems. But that, you know, that’s just not the way the Nobel Prize is ever actually going to probably be used just because human beings aren’t like that, right. No, no, no, we
[00:59:23] Blue: want to we want to reward the changing of the world that ultimately did I mean it, even looking at it in retrospect. The reason why it seems laughable that he wasn’t the word that awarded the Nobel Prize for the theory of relativity was because we’ve all decided it’s right now right. And although, you know, maybe not also so.
[00:59:46] Red: Yeah, it’s actually wrong, but it’s right.
[00:59:51] Blue: Well, and, and, and what I love is at the end of the day, like even the concept of quote right and wrong, when it comes to ideas is, it’s always emerging and growing you know and, and, and what 10 years ago or 20 years ago made us say, Oh, wow, Einstein was right. Wow, he was right. And now we’re like, Oh, well, he had some really great ideas but right.
[01:00:20] Red: He had a theory that had heavier verisimilitude than its competitor, which was Newton’s theory. Right. It’s, there’s no one really doubts that today that Einstein’s general theory of relativity is superior to Newton’s in every way that there’s simply are no exceptions that we know of, right. Sure. And because of that, it’s now one of the two great paradigms of physics. And there’s even, I don’t, and I’m not trying to make fun of science, part of the institution of science is a certain amount of orthodoxy and intolerance to new ideas that that that’s the what that’s what you would want in science to some degree. Okay, what really happened was is that his theory continued to get corroborated. They continue to find test cases that required an understanding of general relativity and whole low and behold you go do the test and he’s right each time. Right. As those tests in this does come from popper, a lot of paparians think there’s no such thing as a positive argument in popper. There is it’s called corroboration. And to popper what that is is that you have a potential chance to falsify through an experiment, and it fails to falsify. So each time they come up with this new idea well according to relativity, this is what should happen let’s go try that and each time it works, you know, GPS is required an understanding of general relativity, you can, you literally can’t make a GPS without an understanding of general relativity. Once you’ve gone you try these things and they end up, yep, turns out you need to understand general relativity.
[01:01:59] Red: That does corroborate the theory, those are the positive arguments for the theory I people might argue with me here, but they’re also negative arguments for the previous theory yeah okay true. It’s not super clear cut, because you’re always in, you’re always comparing theories, so positive argument for one theory is always negative argument for another theory. The reverse is not as true, but any positive argument is also a negative argument that’s why popper emphasized negative arguments. So, that’s what happened though is we corroborated the theory more and more over time, until it just really. There was no other theory out there that was truly its competitor anymore, and people just gave up on trying to figure out how to adopt, adapt Newton to accomplish the same things, or whatever. The true competitor to general relativity today is quantum gravity, which does not exist as a theory that’s why it can’t be a competitor yet.
[01:02:56] Blue: All right, well I, those are some of the thoughts that that I wanted to explore today I I love with the conversations taken us. All right, well, I would say that we could wrap up this conversation I think it’s been a fascinating one. I like the kind of settling on the dogmatism that that is in in science because I, I think in spite of the fact that I’m here heavily advocating that companies need to be more risk. I don’t think it here’s the here’s maybe my finishing thought. I don’t think it’s, it’s risky to be to be failure and mistake advocates within an organization, I’d ultimately I think organizations that have a tolerance, not just at the executive level for taking risks, but push the ability to to do experimentation down to their teams, and that can create a culture of of experimentation as a way to develop speed. So that your ultimate goal, at least early in any product conceptualization is to figure out how quickly you can invalidate that idea. And be really pop air in with it, and then get those ideas out of your, out of your way, so that you don’t expend time and money focusing on things that are non valuable. Yeah,
[01:04:37] Red: and we mentioned this when we were doing the bark interviews, but you’re either going to do this as part of your company culture, or you’re going to the knowledge creation will happen by the death of your company and the success of other companies right, right.
[01:04:52] Blue: And that is the value of the capitalistic system, it creates knowledge at multiple levels, right, it’s incentivizes creation of knowledge creativity.
[01:05:02] Red: But even if no one individual company is good at actually changing its ideas and experimenting the across the market, those ideas will exist, and we will see progress, even this is a little like the analogy with you don’t need any one individual scientist to be non dogmatic, you just need the system to be non dogmatic. That’s true of capitalism to. But once you know that’s true. Do you really want to be the dogmatic business that goes out of business. Right,
[01:05:33] Blue: right, do you want to be blockbuster who couldn’t visualize how to be a different you know that their main money maker was late fees. You can’t give people, you know, movies are in the mail with no clear return deadline if the way you make money is by late fees.
[01:05:50] Red: Yeah, interesting I didn’t know that. That is, well,
[01:05:53] Blue: that’s my interpretation.
[01:05:56] Red: I think that’s a decent interpretation I never thought of that.
[01:06:00] Blue: I have I have blockbuster bitterness. I remember this would have been like early 90s. I had a movie you know that I just forgot to take back and I remember standing in a blockbuster and they wanted $87 and it’d been like two weeks. You know, and, and that would be a lot of money for a late movie now, even though we don’t have that concept anymore. But, but back then like that was, that was probably close to $300 in today’s money and I, I swore I would never go into a blockbuster again. I never did.
[01:06:38] Red: Do you use red box.
[01:06:40] Blue: I did use red box for a while and you know red box. If you don’t return your movie after I think it’s 30 days of $1 a day that you’ve bought the movie and they no longer charge you late fees.
[01:06:52] Red: Interesting. So that that’s a better. That way they can’t just make the money off of you just continue to make the money off you renting it to you.
[01:06:59] Blue: Yeah, which was, which was I truly believe core to blockbusters business model was the levy, levying of those late fees for a substantial amount of their revenue.
[01:07:13] Red: Interesting. Yeah.
[01:07:14] Blue: All right, well, this has been a fun conversation.
[01:07:17] Red: It has been. Thank you for bringing it up. I hope we’ll have more interesting conversations like this I would like to see this area of how do we apply creativity to other areas. I think that’s always an interesting subject.
[01:07:30] Blue: Yeah, I do too. All right, well, well thank you to Bruce and Tracy.
[01:07:33] Red: All right, thank you. Thank you. Bye bye. The theory of anything podcast could use your help. We have a small but loyal audience and we’d like to get the word out about the podcast to others so others can enjoy it as well. To the best of our knowledge, we’re the only podcast that covers all four strands of David Deutch’s philosophy as well as other interesting subjects. If you’re enjoying this podcast, please give us a five star rating on Apple podcasts. This can usually be done right inside your podcast player. Or you can Google the theory of anything podcast Apple or something like that. Some players have their own rating system and giving us a five star rating on any rating system would be helpful. If you enjoy a particular episode, please consider tweeting about us or linking to us on Facebook or other social media to help get the word out. If you are interested in financially supporting the podcast, we have two ways to do that. The first is via our podcast host site anchor. Just go to anchor.fm slash four dash strands f o u r dash s t r a n d s. There’s a support button available that allows you to do reoccurring donations. If you want to make a one time donation, go to our blog, which is four strands.org. There is a donation button there that uses PayPal. Thank you.
Links to this episode: Spotify / Apple Podcasts
Generated with AI using PodcastTranscriptor. Unofficial AI-generated transcripts. These may contain mistakes; please verify against the actual podcast.