Episode 17: Shiri’s Scissor: Polarization and Politics
- Links to this episode: Spotify / Apple Podcasts
Unofficial, reviewed transcript. It may still contain mistakes; check the podcast when wording matters.
Speakers are labeled by first name where identified. Unidentified-speaker labels may refer to different people. Bracketed question marks indicate uncertain wording.
Transcript
[00:00:00] Bruce: The Theory of Anything podcast could use your help. We have a small but loyal audience, and we'd like to get the word out about the podcast to others, so others can enjoy it as well. To the best of our knowledge, we're the only podcast that covers all four strands of David Deutsch's philosophy as well as other interesting subjects. If you're enjoying this podcast, please give us a 5-Star rating on Apple Podcasts. This can usually be done right inside your podcast player, or you can Google The Theory of Anything podcast Apple or something like that. Some players have their own rating system, and giving us a 5-Star rating on any rating system would be helpful. If you enjoy a particular episode, please consider tweeting about us or linking to us on Facebook or other social media to help get the word out. If you are interested in financially supporting the podcast, we have two ways to do that.
[00:00:45] Bruce: The first is via our podcast host site Anchor. Just go to anchor.fm slash four dash strands, F-O-U-R dash S-T-R-A-N-D-S. There's a support button available that allows you to do reoccurring donations. If you want to make a one-time donation, go to our blog, which is four strands dot org. There is a donation button there that uses PayPal. Thank you. All right, welcome to The Theory of Anything podcast. I'm Bruce Nielson. How are you doing Cameo?
[00:01:28] Cameo: I'm doing well, Bruce. I'm Cameo Duran.
[00:01:31] Unidentified speaker: All right.
[00:01:32] Bruce: So we have an interesting subject today that Cameo picked. I guess it came from a Facebook post I made probably a few months ago, I guess.
[00:01:41] Cameo: Yeah, probably, maybe even three months ago.
[00:01:44] Bruce: So the subject is called Shiri's Scissor, which it's a story, a fictional story, although whenever I was reading it, I kept wondering if it was really fiction because it seemed so true to life at times. But it was written back in 2008, October 30th, 2018 is when it was posted on a blog. And I can't remember who, somebody on Facebook posted a link to it. And I one night read it and I thought it was awesome. So I posted it on Facebook and Cameo picked it up and she thought it was awesome too. And so we wanted to talk about this story and how it relates to stuff going on in real life. So what it's, I guess, symbolic of. Cameo, do you wanna maybe summarize the story quickly for us? Or do you want me to do that?
[00:02:30] Cameo: I want you to do that. You're better at that kind of thing.
[00:02:33] Bruce: All right, I'll go ahead and I'll summarize it. So the idea is, so in the story, you've got this group that's doing machine learning, which first of all, I thought that was cool because I'm into machine learning. They're trying to come up with a machine learning algorithm that will generate political statements that will lead to people becoming polarized over the statements. And so they keep trying to play with this algorithm and no matter what, the guy who's like the programmer, who's the one who's telling the story, no matter what he did, it would just come up with statements that were just obviously true. And so he thought it must be broken. So he grabs one of his coworkers, Shiri, and she says, I don't understand what's wrong with the algorithm either. It's just coming up with statements that are obviously false. And they start to argue over, no, no, these statements are obviously true.
[00:03:26] Bruce: And she goes, no, it's obviously false. And soon they're like in this massive argument and they're starting to hate each other because they can't agree. And they pull in other coworkers. And it turns out every time they pull in new coworkers that one side, one person will see the statements as obviously false, and the other person will see the statement as obviously true. And then that leads to a divide between the new coworkers and slowly this company gets ripped apart by trying to argue over whether the machine, whether the code is producing obviously false statements or obviously true statements. They end up with a lawsuit going on with this guy suing the person who owns the company. And then it finally strikes them. The machine learning algorithm is working. It's doing exactly what it was meant to do. It was polarizing people. And so he goes out and they do various, once they realize what they have, they're not quite sure what to do with it.
[00:04:21] Bruce: So they try calling the Defense Department and offering to give an example. And they end up accidentally taking out a third world country using the machine learning algorithm as a way of trying to show it to them, to the Defense Department, how the algorithm worked. And then he starts to realize that all the news articles that are coming out, the different things that keep happening in the news, that they are all on the list of statements coming out of the machine learning algorithm. And he realizes somebody's got this algorithm, which they call Shiri's Scissor, because it splits people. Somebody's got this algorithm and they're using it to generate fake news stories or real news stories. And it's leading to the polarization and the downfall of the entire country. And so obviously this is a fictional story, but it's very interesting that this is what it feels like to be living right now in our very polarized environment, where things just seem so obviously true or false to everybody and we can't agree on which it is.
[00:05:30] Bruce: And we can't even agree on the existence of a middle ground, it feels like a lot. Cameo, I want you to give your thoughts here too. Maybe you have somewhat different take than me on the story.
[00:05:40] Cameo: Well, no, actually I have the same exact take. And right after reading the story, I was thinking about a conflict in my own life, actually with a person who works with me, where he has, or within our communication, we regularly are running into our own personal Shiri's scissor of a statement that he'll make to me that I'm sure isn't designed to be that, has this almost instant, makes me feel totally at conflict with him, right? And it's something benign that's anti-agile to me, that like, well, I apologize to the customer for the fact that we went over budget, and I'm like, no, we're agile. That's not actually a thing we can do, because, and look at all these decisions that they make, you know, I like, there were all of these things that were like a Shiri's Scissor within our regular interactions. And since reading this article, I've kind of noticed it a lot throughout all sorts of interactions that people have with each other.
[00:06:48] Cameo: Yeah, and just in day to day life, I think you start to see these kinds of phrases being used really commonly, especially across memes. On Facebook, like memes are, end up being like they typically, that's their focus is to be purposefully decisive.
[00:07:12] Bruce: Yes, divisive to...
[00:07:14] Cameo: Yeah, sorry, divisive.
[00:07:16] Bruce: Yeah, no, and you and I had a Facebook post about that too. One of my friends had posted that and he did an article on it that you liked. But he was pointing out that Facebook memes, they intentionally leave one impression with a liberal and one impression with a conservative, and that's not a bug, that's a feature. They're trying to make one side feel one way and one side feel another way. They're trying to intentionally pull out either exaltation of, oh yes, I so much agree, or really deep anger, right? They're not trying to make some sort of even-handed statement that's true or something like that. They're intentionally trying to seek out and make both sides react strongly.
[00:08:01] Cameo: But in opposite ways. The importance is that, that it's designed to manipulate both sides. And that's, it's a scary thing that's happening to us. And it makes me wonder, has it happened before in human history? You look back at the news sheets that they would print out and newsies, the newsboys out, trying to sell their papers for a nickel or a penny or however much you sold a paper for in like 1902. I'm certain that that same kind of thing, in the way that the language or the one street corner, you might have one guy talking one way and another street corner, another guy talking another way, you know, and probably that same kind of conflict, but the way we communicate and the power that we communicate with right now is also just, it's unprecedented in human history.
[00:08:56] Bruce: So let me, actually a couple things I wanna mention here. I read a book once written by a guy whose job it was to come up with controversial news stories to be able to create news coverage for his company. He worked for, I think it was called American Apparel, which had some really controversial ads.
[00:09:18] Cameo: Yeah, yeah, yeah, I remember a lot of, they routinely got lambasted and really criticized for very controversial stuff.
[00:09:30] Bruce: So here's the thing that's interesting. The ads that were so controversial never ran as real ads and were never intended, according to this guy who wrote the book anyhow, never were intended to be run as real ads. They existed for no purpose except to get bad press so that American Apparel would end up in national news. So he would actually be hired, so he claims, to create these ads that they knew they weren't gonna use because they would have something controversial. They would have explicit nudity or something like that in it, right?
[00:10:05] Cameo: Yeah, they were gonna go so far past the realm of what's socially acceptable that the only possible outcome was fury and indignation across the country.
[00:10:15] Bruce: So he would create the fake ad, and then he would put a fake blog post up somewhere, lambasting his own ad. Then he would call some bigger blogger, and he would say, look what people are reacting to over here, and that blogger would pick it up, and then another blogger would pick it up, and then another blogger would pick it up. And then once enough bloggers had picked it up, he would call the news. He'd say, look at this news story about all these bloggers that are so angry over this American Apparel ad, and then the national news would pick it up, and now American Apparel had gotten what they wanted, which was now that they're a nationally known brand. It didn't matter to them that it was bad press, you know, all press is good press as far as they're concerned. Now, actually, I'm not sure if this story is true, but this is what he claimed happened in his book.
[00:11:05] Bruce: I haven't done enough research to, but he then went through and he explained that this is how people are using the internet to manipulate the national news, and thereby manipulate us. He talked about there was some movie that a friend of his made and had hired him, and he did the same thing. He purchased a billboard for the movie. Then he went out and he graffitied his own billboard.
[00:11:32] Cameo: Sure, sure, sure.
[00:11:34] Bruce: And then he did a blog post on how angry people were about this movie, and then he got other bloggers to pick it up, and then it went to the national news. And so that was the technique that he was doing over and over again to create the, to basically just create a news story out of nothing, so that he could get something into the national news and therefore get attention. And that was what his job was, was to create this sort of tension and upsetness to get things to go. Now, he made an interesting point. He claims that back in the old days of the newsies, that yellow journalism was the norm, just like it's become the norm today.
[00:12:14] Cameo: Right.
[00:12:15] Bruce: And he claims that the thing that broke yellow journalism was the subscription model, and the thing that broke the subscription model was the internet. So we had yellow journalism because the newsie had to sell the newspaper on the side of the road. So the only way you're going to get that thing sold is to intentionally run news stories that are going to get people upset.
[00:12:34] Cameo: Sure, absolutely.
[00:12:36] Bruce: So you have this era of yellow journalism that's historical, and then it goes away, and because they're now doing subscription models. You pay for the newspaper, you're paying every month anyhow. So now, what's actually going to be rewarded is at least the appearance of balance. The idea of that. Sure. Okay. So then newspaper models break. The Internet breaks all the newspaper models and you have to get clicks. Okay.
[00:13:04] Cameo: Uh-huh.
[00:13:05] Bruce: So now, you're suddenly back into the era of yellow journalism, although now at light speed, you know, at Internet speed. So you have to be able to get your news stories out there. You have to be able to get people to click. Now, I've seen like some newspapers claim this story isn't true. They say, well, actually newspapers are moving towards an online model. New York Times and Washington Post, you have a subscription model. I'm still not sure I buy that point of view because the way they still get their sales is they make you want to read the article and then you can't, and you need to pay money to get a subscription.
[00:13:44] Cameo: Absolutely, I agree, they're still using the same thing to get the click into the paywall.
[00:13:49] Bruce: Right. It seems to me that there's at least some credibility to this guy's story, that we're back into the era of yellow journalism and that's one of the main reasons why we do see suddenly so much polarization, is that that's the way you make sales, that's the way you get your story out, is you have to enrage people and you have to enrage both sides. You have to make sure both sides are enraged. It's got to be worded just right to make both sides really feel like, one side's got to feel like they were wronged and the other side's got to feel like it was obviously true and that's really what they're targeting today. Right. Let me tell you my own story about this. I accidentally got stuck in a big argument on Facebook with some friends. I had come across this news story and the title for the news story, it said that Stanford or some famous university, I don't remember which one it was, was creating a new standard to accommodate women in math.
[00:14:58] Unidentified speaker: Okay.
[00:15:00] Bruce: It's like, oh my gosh, that is so horrifying.
[00:15:04] Cameo: It is awful.
[00:15:05] Bruce: Okay, so I click on the link, which is what it's trying to get me to do. And it turns out that the story is actually that they've wondered if maybe having math tests be timed is favoring one style over another of math. That you've got some people who-
[00:15:25] Cameo: That could end up adversely affecting one gender versus the other.
[00:15:29] Bruce: Yeah, but over something that isn't really related to whether you're good at math or not. Right?
[00:15:35] Cameo: Sure, sure.
[00:15:36] Bruce: There's no law of the universe out there that says, you know, if you can do a math problem in 15 minutes, you're much, much better than someone who can do it in 16 minutes. Right? I mean, there's nothing obvious about a time thing. And they weren't giving women more time. They were giving everyone more time. Okay, so-
[00:15:55] Cameo: Oh, that's a pretty interesting detail.
[00:15:58] Bruce: Yes.
[00:15:59] Cameo: So their solution wasn't gender specific at all.
[00:16:02] Bruce: That's right. They were simply experimenting with the idea that it's possible that one gender had more of one style, and therefore they were penalizing that style and there was no reason to. And so what they ended up actually doing is they only changed it for undergrads. They didn't change it for graduate students. Which, that's a fairly good evolutionary change. You don't just go change everything all at once, you experiment. And then what they found is the result was that they, I guess they had, there was like four categories or quadrants of students. The top quadrant, it made no difference. The second quadrant, it did in fact turn out that more women, now that they're being given extra 15 minutes on the test, were scoring better. So the second quadrant had changed. And I think the other quadrants, it didn't matter.
[00:16:56] Cameo: Oh, interesting.
[00:16:59] Bruce: And so it wasn't even a huge change, it was only an extra 15 minutes. And the result wasn't a huge result change. It only affected the second quadrant, right? It didn’t affect the first quadrant at all. And an experiment like this really strikes me as something that's worth trying. There's nothing obvious about how math should be connected to a time test. So I post this on Facebook and I'm upset now. I'm upset because I feel that the title of the article misled me. And so I'm not really talking about the content of the article. I'm just simply pointing out, it really bothers me that the news, I hate the news media. The news media is so, just our era of the news media with yellow journalism. It is, the ethics of journalism are just terrible today. And maybe they've always been bad, but they're really bad today.
[00:17:47] Cameo: Sure.
[00:17:48] Bruce: And so I'm really just talking about how bothered I am that the news media intentionally wrote a title for an article to make it sound like this university was giving extra time to women only, when really they were being even handed, right? And the moment I put, so the moment I put that up, my conservative friends on Facebook just start lambasting me. And I consider myself a conservative. I'm probably not a fairly standard conservative anymore.
[00:18:19] Cameo: I would call you non-traditional conservative.
[00:18:23] Bruce: But I'm definitely not a liberal.
[00:18:24] Unidentified speaker: I'm like no, no, not even close.
[00:18:27] Cameo: You're way, way, way more conservative than you are anything else.
[00:18:30] Bruce: Right. In fact, whenever somebody asks me, I always say I'm kind of a traditional conservative.
[00:18:34] Unidentified speaker: You know, I think you are.
[00:18:36] Cameo: You're kind of conservative that most liberals wish would come back, honestly. And people who actually believe in the Constitution, believe in being fiscally conservative.
[00:18:48] Bruce: Right.
[00:18:49] Cameo: Yes.
[00:18:50] Bruce: So I'm a never Trumper. I'm very, I never vote for Trump. Yeah. And a lot of conservatives are never Trumpers. That's a perfectly normal thing for conservatives to feel because Trump is not a very good representative of traditional conservative values and views. Anyhow, my conservative friends just start lambasting me. And they're so upset. Now they're not upset about the title of the article. They could care less. The only thing they're upset about is that this university had changed something to try to accommodate women at all. And that they felt this was wrong. And I'm like talking with them. I'm trying to just talk with them. And I'm just like, I don't understand why giving 15 more minutes obviously means that, and the analogies they're using, the analogy they keep using is things like, well, let's just lower our standards for Navy SEALs so that we can get more women in.
[00:19:46] Bruce: It's like, this is nothing like that. This isn't even remotely like that, right? There's nothing obvious about a timed test. There's nothing obvious that means you're better at math. If you wanted someone to go do math and you wanted them to do it well, is there some reason why you would prefer someone who's lightning quick but gets it wrong a little more often over someone who's slow and plodding but gets it right more often, right?
[00:20:12] Cameo: Yeah, that actually is a bigger question. We could almost have a whole podcast about that.
[00:20:19] Bruce: So, and there's probably room for both types of people.
[00:20:22] Cameo: Sure.
[00:20:22] Bruce: But it's not obvious that one of those deserves a better grade than the other, right?
[00:20:26] Cameo: No, I absolutely agree. And it is interesting that that made, that that's the part that made them so, I'm not surprised at all, at all. If you watch on social media, anytime that there's anything that could veer a little bit into anything being changed that seems preferential to, generally to almost any, what we consider minority, although I don't know why we would consider women a minority, but an underrepresented, not men, and generally white men kind of category. Anytime you see anything that seems in the least bit preferential to anybody in one of those groups, you will watch people jump on like, why don't you just let crippled people be Navy SEALs? That's what we want, right? Now that's the America we want.
[00:21:16] Bruce: It's funny just how much venom it brought out, right? Because I wasn't, the way I was posting that article and what I was concerned about was so different than the way everybody else viewed the article.
[00:21:28] Cameo: Right.
[00:21:29] Bruce: And it was kind of an eye-opener to the fact that I don't fit in well anymore.
[00:21:37] Cameo: Well, and that particular thing, it revealed was a Shiri's Scissor within our culture. And you know who the click was designed to catch. The trap was that you clicked on because you were a little indignant that somebody would suggest such a thing and you were curious is that those other people that were so indignant at the article, that's who it was designed to catch. And who knows how they, I mean, it's just interesting. So let's talk about bots in all of this for a minute. You know, they say the prevalence of bots is really high across all of kind of social media. I think projections are somewhere in the range of 25 to 30% of Facebook accounts are fake and likely bots.
[00:22:28] Bruce: Wow.
[00:22:29] Cameo: Yeah, they really, really, really high number. And the same on Twitter, like just the numbers are really, really high. And as far as I have read, they're not doing a great job combating them at all. And as just kind of a side note, we regularly respond to federal like RFPs and RFQs for work, you know. And there's this category of project funding that's called SBIRs or STTRs. And they're kind of innovation fundings through the government for very specific things that are innovations that they are actively looking for. And a recent one was to build a machine learning algorithm and probably kind of a little mini platform to combat people within the Navy sharing bot propaganda, because they know it is such a big problem and they know that the propaganda and the bots are a big problem across the board, but they find that a lot of times people in the military have very distinct feelings that can be easily manipulated by bots.
[00:23:40] Cameo: So they actually are trying to invest money into innovations to prevent a very particular problem. So anyway, all these bots on the internet, all spreading who knows what agenda. You can't assume that they have one agenda or the other. There's probably, it's not like there's some big shadow bot creator, it's, sure it's the Russians and the Chinese, but it's also like just hundreds of thousands of individual people trying to create clickbait in the form of bots, some of them to build up big lists that they can sell to other people. In fact, I had read once that, you know how on Facebook for a while, there was this kind of proliferation of, here's my 82-year-old grandmother, here's a picture of granny with a little picture. Let's get her 100,000 likes to show her the excitement of the Internet. Or she went out on her first date, let's show her how exciting that was.
[00:24:39] Cameo: You'd see these things get shared and millions of likes. All of that was generally being written as little programs, little bots to go out and generate these things so that they could turn around and sell lists of people who are following things to people who buy such things. So you've got this kind of underbelly of machines essentially, that are being trained to go out and do. In fact, it's the basis of this article that they were building a machine learning algorithm that was designed to be divisive.
[00:25:16] Unidentified speaker: So it’s interesting to me.
[00:25:18] Bruce: So actually I read an article about this. That is actually the other side of this. You’re talking about them intentionally being divisive. I read an article that pointed out that even if you weren't intentionally being divisive, that that would be divisive. So let's say that you have an Instagram algorithm that's going to go out and get you likes or whatever. So you got a bunch of, let's say, young ladies that are on Instagram, and they want to get likes because that's a very natural thing for any human being to want. And so you've got a big group of people doing it, and some of them end up getting lots of likes and some of them don't. And what are the ones that are getting lots of likes? When you start getting lots of likes, that causes the algorithm to put you out there more because it wants more and more people to like it. It's kind of a runaway self-prophecy sort of thing.
[00:26:15] Bruce: Okay, so let's just say that the algorithm has nothing in it that's particularly biased. It's just simply going to exploit whatever natural human tendencies actually exist. Well, one of those might well be that if the girl looking for the like is wearing a miniskirt, that more men are going to like it, okay? And so suddenly the algorithm is automatically optimizing for fewer clothes equals more likes.
[00:26:46] Cameo: Sure.
[00:26:46] Bruce: Okay, even if there was nothing originally programmed in it to do that, all right, that would naturally just come out of such an algorithm. This is what the article was claiming anyhow. So, and then you look at like YouTube, why is it that conspiracy theories, they pointed out that when you start off into YouTube, you end up watching whatever is your preference. You're going to watch more conservative stuff or more liberal stuff. The moment that it detects that you're either conservative or you're liberal, it's going to now start feeding you kind of garbage stories. Because those are the ones that really get people upset and interested. And so the algorithm will naturally tend towards extremism. And you're going to start being automatically fed more and more extremist viewpoints. Even if there was nothing in the algorithm that originally meant to do that.
[00:27:41] Bruce: Because the algorithm is what the algorithm is, the way the machine learning works, right? It automatically tries to exploit whatever it can to make a prediction. And if human beings have a natural, let's call it a bug, it's probably not accurate, but let's call it a bug. A natural bug that we get caught up in extremism under certain circumstances, it's going to find and exploit that reality at some point, right? Even if no one who programmed it had any idea that's what they were doing, that would naturally happen if that's in some sort of tendency towards that, okay? Well, again, I don't really know how true these things are. These are just different conjectured ideas that people are putting out there, trying to figure out what's going on and what do we do about it. I do think there is something to that. At least as far as outrage goes, it seems really obvious that people share stuff that outrages, and other things just don't get shared as much.
[00:28:39] Cameo: But you started that statement that that might not necessarily indicate ill intent.
[00:28:47] Bruce: Right.
[00:28:47] Cameo: Well, and generally, I agree that that's true. So I was scrolling through Facebook this morning, and I follow a page called DadLab, and every day he posts, it's this British guy and his, like, nine-year-old kid. Every day they post little crafts that are both a little bit science-y and fun. So as benign as Facebook gets. Today, the post was this little merry-go-round you could make with a toilet paper roll and it's a ghost that goes around the thing. The first post, the first response to this post is, I almost want to pull up my phone and look at it. It was something like, they can't make us give up our freedoms to be able to try and protect everybody around us. It was an anti-mask post, but it never said the word mask. It was just like they can't attack our freedoms this way. And a lot of people responded to that. I had this, I clicked into the person's name and looked at what I could see of their profile.
[00:29:56] Cameo: And I had this moment of like, I wonder if this is a bot. Well, because here's this no reason for there to be any disagreement. It's so far removed from needing to be politicized, but wouldn't it be easier to build a bot that just didn't discriminate on the types of posts it was trying to cause? If you don't care what kind of posts you go and start fights on, if you're just trying to start fights everywhere you go and keep division constant, that's how you'd go about it, is by dropping things in irrelevant places, that might get people riled up, because people were disagreeing right there on the stupid clown, ghost thing about their personal freedoms being attacked or protecting each other. It's just, I don't know, because if there are that many bots that are playing around on these platforms, a lot of them probably do have ill intent. We just don't actually understand what their ill intent is, or maybe just making us hate each other is a good enough intent.
[00:31:10] Bruce: It's interesting you say that. Obviously, the whole Russian thing with the last election, that is definitely how people, the way it got ended up in the news story, which unfortunately, the news did a very, very terrible job with the whole Russian Trump thing. But the way that all got started was the discovery that the Russians had this, I can't remember what the name of the group was, but the group that was doing the bots. When they actually started doing that, the bots half the time were supporting Hillary Clinton, and half the time were supporting Trump.
[00:31:47] Cameo: Yeah, absolutely.
[00:31:49] Bruce: They did not care who won initially. They were just trying to stir up discontent amongst US voters. Then at some point, when it turned out that it looked like Hillary was going to win, they switched over to supporting Trump primarily.
[00:32:08] Cameo: Interesting.
[00:32:09] Bruce: The conjecture here, obviously, there's a lot we don't know, but the conjecture here is that they weren't actually trying to get Trump elected. They had decided that was what would cause the most discontent. Since Hillary Clinton was going to win, that they wanted to rile up Trump voters as much as possible right before the election so that when Hillary Clinton won, it would do the most damage. Then Trump ended up winning. That was one of the main things that then led to the later story about that there might be some collusion between Trump and Russia. I mean, you can't prove a negative, but let's just say there's zero evidence that there was ever any collusion between Trump and Russia. That statement alone probably will get some people upset.
[00:32:54] Unidentified speaker(s): It's the truth. Oh no, we started talking about politics.
[00:33:01] Bruce: I read the Mueller report. I actually distilled it down and put a blog post about it. It's broken up into two sections. One part is the investigation into connections between Trump and Russia, and then the other half is, did Trump obstruct justice? The Mueller report itself concludes that there was no collusion between Trump and Russia. You can read through all the examples of every single connection between Trump and Russia that existed. They're exactly what you probably would have expected of any politician. There's just nothing there. I know that some people got really upset over the idea that Trump was so open to getting dirt from a foreign country on his competitor. I'm not saying that's okay because it's not. But it is common practice. That wasn't something Trump invented. Based on this, there just doesn't seem to be any real connection between Trump and Russia.
[00:33:59] Bruce: I was telling somebody, I said, if you're going to keep claiming that Trump's in collusion with foreign powers, you probably ought to claim China at this point, because at least China hasn't been investigated. We have investigated Russia and we didn't find anything. You might be better off just claiming China at this point and trying to get an investigation over there or something like that. That probably all started just because they had made a decision, well, let's support Trump because he's going to lose. Their whole goal was to just simply sow discontent as much as possible. It's interesting. I read another article and I kind of understand where the Russians are coming from. If you're anywhere else in the world, the election in the US affects you.
[00:34:48] Unidentified speaker: Absolutely.
[00:34:49] Bruce: Whoever wins as president, that's a big deal. If you're in Sweden or China, just pick any country, Latin America.
[00:34:59] Cameo: Any country.
[00:35:01] Bruce: Who wins as president matters to you in a way that I could care less, to the opposite of the degree to which I care about who the Prime Minister of Britain is.
[00:35:10] Cameo: Although maybe we should care more, honestly.
[00:35:14] Bruce: Maybe we should care more, but it's not likely to have a giant impact on my life in the way it's going to have a giant impact on their lives.
[00:35:21] Cameo: Sure. No, I agree.
[00:35:23] Bruce: And so I can understand why, since they're non-citizens and they don't get a vote on this really important thing that affects their lives, I can understand why there would be this desire to go try to influence the election in whatever means you can get away with. And I think that's what's really going on when it comes to the Russia thing. Now, I'm actually not sure Russia makes that much of a difference. I mean, if you go and look at the number of bots, the amount of money they put into that, it's unlikely that one organization impacted much of anything when it came to the election, right? I mean, clearly there are other forces at work that were within the United States that would have been a much, much larger impact than anything the Russians could have even conceived up, right? So it's unlikely that the Russians even changed the outcome of the election at all because they were only pouring a couple million or something into it.
[00:36:17] Bruce: It was not much money at all. [The amount of] money that was flying around at election time by comparison was just absolutely enormously large, all within the United States, right? So I do think though, I can see why other foreign powers would want to influence the election if they could, and I can see why the Americans should probably start realizing, hey, it used to be really hard for foreign countries to influence our election very much, because there was no internet. Now they can, so of course they're going to try to. We probably ought to make new laws. We probably ought to respond to that new threat, that new circumstance, and figure out how to deal with that and create new legal standards and new ethics around, is it okay to accept dirt from a foreign power? Is it okay to accept money from a foreign power under what circumstances? I'm sure they have laws around this already, but to refine those, that probably does make sense to try to figure out what we really want to allow, and the new standards around that.
[00:37:22] Bruce: But I doubt that… When we talk about bots, there's a lot of organizations using bots, I would imagine. Sure. It's not even just bots too. Trump's campaign used a machine learning group, and it was one of the first uses of, I can't remember their name, but it's a famous name. It's not coming to me off top of my head though. There was a group that used machine learning for him to target voters. They had worked out an algorithm that targeted the US voters that they either needed to get out to vote, that they knew were going to vote for Trump if they got them out to vote, or they were on the edge. They had figured out how to target on social media, the ones on the edge, and then feed them ads and what they needed to push them over into voting for Trump. I'm pretty sure both sides are doing that now, but at the time, it was something brand new.
[00:38:21] Bruce: Trump's campaign had better access to that than the other campaign. Now, this would all be American money, American citizens, so this is not a foreign power. But even in this case, and honestly, I would be hard pressed to say this is anything but legitimate. Isn't this just good campaigning?
[00:38:40] Unidentified speaker: It's good marketing, right?
[00:38:42] Cameo: Good marketing manipulation and reaching out to the people who are on the edge and making sure. We talk about marketing automation all the time. And even taking machines out of it, across almost all of, especially Instagram is infamous for this. The algorithm, like you say, it responds to people liking things by showing it to other people to like, right? That's what it's designed to do. And so very prevalent are pods of real people who, when somebody is posting, they have pods of thousands of people who are going to go on and like each other's stuff so that they can boost the algorithms. It happens on LinkedIn, too. I'm sure it happens on Facebook, although I don't know, Facebook's kind of a funny place, who knows? But those are real people doing fake actions to manipulate real things, but for their own purposes.
[00:39:45] Bruce: Yeah, and I guess the question that comes to my mind from all this is, what do we do about this? Because some of it actually feels legitimate, right? I mean, I hate the outcomes. I wouldn't expect a campaign to do anything except try to campaign as best they can. And certainly, I would never be in favor of a law that tried to stop from using machine learning to target the voters that you needed most to target. That would be so wrong to do that.
[00:40:15] Cameo: Sure.
[00:40:17] Bruce: And if that's true, I have a hard time imagining ever being in favor of a law that like, say, told YouTube they have to change their algorithms for likes because it's causing people too much to head towards extremes.
[00:40:34] Cameo: Yeah, absolutely.
[00:40:36] Bruce: I don't know what we do about this, right? There's got to be, and I'm sure there is a solution to this. I just don't know what it is at the moment. How do we, and then the other flip side of this is because so much communication goes through a very small set of companies, Twitter, Facebook, things like that, YouTube, Google, they end up with this really disproportionate amount of censorship power.
[00:41:03] Cameo: Oh, yes. Let's talk about that for a minute because you've been, that's been happening a lot, I think, recently.
[00:41:09] Bruce: Yes. In fact, I have a friend, one of my fairly extreme conservative friends who recently just left Facebook because he kept getting banned for a couple of days or a couple of weeks. He told me what he was getting banned over and I'm assuming he's telling me the truth, but he isn't a liar, so I think he's probably telling the truth. It was stuff that it's really hard to believe you should be banned over it. One of them was it had a little golden book with Hitler on the front, and it said, so it looks like a kid's book, and the title was something like learning to refer to people as Hitler, so you can win an argument or something like that.
[00:41:54] Cameo: Super benign in a lot of ways.
[00:41:56] Bruce: Right. I guess it was just the fact that it was Hitler that got him banned. Again, these are private companies. From a certain point of view, this isn't the government. The freedom of speech laws are specifically about the government not being able to ban things, because the government has a unique monopoly on violence. Facebook has no armies that I have to worry about. Facebook should be able to decide their own community standards, whatever that happens to be. Then that shouldn't be legislated. Dear heavens, no. Yet in the end, we end up with this situation where I'm very uncomfortable. Facebook is one of the better companies in terms of they're hated, precisely for the reason that I like them, which is that they refuse to… Like Twitter: Jack Dorsey, he will decide I'm not even going to take certain kinds of ads or something like that. That makes him popular.
[00:42:57] Bruce: But in a lot of ways, that's the end of free speech at that time. He's got a right to do that too. I'm not saying he doesn't. But in some ways, the fact that Facebook is just kind of more neutral, that's exactly what we would want, but that's what makes them so hated also. Even with Facebook where they probably are the most neutral of the social media companies, they're still banning things that make me go, huh?
[00:43:24] Cameo: There's been a couple of these big conspiracy things that happens, like a plandemic and all of the big social media things, banned it and took it off whenever it would show up, spent outsized efforts pulling down those videos every time they would get shared. And I was watching the whole thing, and I think when you start to have that level of censorship, it helps facilitate the rise of this whole conspiracy-like sickness that's happening. Because if these big media giants are deciding what we get to see, you know what? I don't love people sharing things that are obviously incorrect or stupid. And to me, it's like, why not let people go and watch something like that without it being censored and decide for themselves that it's ridiculous to think that you have the technology to insert some tracker in you with your inoculation. It's madness.
[00:44:32] Bruce: Let me actually tell you, a lot of these things we're talking about, I don't have a clue how to fix, but that one you just mentioned, I actually do think I know how to fix. So going back to Karl Popper's philosophy, critical rationalism, a lot of the things that we're seeing from a certain point of view, the fact that we're suddenly not beholden to the mainstream media, you could actually make a case that's a good thing, right? That there's so many alternatives out there, right? And I hate to say this too loud, but I was actually kind of pleased that, I won't watch Fox News because I know it's propaganda, I won't go anywhere near it. But I was actually kind of pleased they came into existence, because it sort of broke the power that the mainstream media had to determine narrative on their own. What has it been mostly good or bad? Probably mostly bad at this point, but in the long run, I still kind of hold to the idea that at least we're getting multiple viewpoints available to us, even if people are kind of choosing echo chambers at the moment.
[00:45:33] Bruce: So from a critical rational standpoint, that should be viewed as a good thing. How do you deal with bad news stories? How do you deal with people on YouTube? I saw a video on YouTube that claimed that you could stop the coronavirus by putting a hairdryer up to your nose and blowing hot air into your nose.
[00:45:55] Cameo: Okay, cool, cool.
[00:45:58] Bruce: And it said this worked for a cold. I had a cold at the time, so I decided to try it. And it didn't do anything. And okay, but here's the thing. The fact that I tried to try it, I knew going into it, it was probably false, right? And there was this giant firestorm of comments on the video talking about why it was false. And the guy who made the video, he at least knew enough medical stuff that he could defend himself. And he was up trying to explain why their arguments were wrong. And there was this discussion going on about what the nature of a cold is, what the nature of a virus is, where it actually exists in the body. And it was really interesting discussion, right? And I was learning stuff from the conflict that was going on in the comments. And then you [YouTube] took the whole video down.
[00:46:51] Cameo: Because they're protecting us from false information.
[00:46:53] Bruce: That's correct.
[00:46:54] Cameo: Right.
[00:46:56] Bruce: You know what? I want that video back up. And I want those comments back up. What they need to do is they need to think in terms of Karl Popper's philosophy. And they need to be able to empower the people who are the viewers to easily put criticisms up.
[00:47:15] Cameo: Yes.
[00:47:15] Bruce: That are easily available that prove or disprove what's being claimed in the video. So that the video, you can go make false videos all you want, but it will become trivial for people out there to be able to show that it's making false statements. Okay, you gotta make that so that's an easy thing to do. And then you kinda need to trust that the truth's gonna come out that way, rather than censoring things.
[00:47:43] Cameo: Sure.
[00:47:44] Bruce: You will, you know, if we're gonna have these extreme conspiracy theory videos, great. Let's leave them. But let's make it so that it's really easy, just trivial, to click on links, connected to that video, that show you that there's something wrong with the video, that it's making false statements, okay? Then people need to make choices after that, okay? We want to empower people to be able to get information. One of the things that people get worried about is that false news stories spread, you know, six times faster, that's the number I always hear, than true news stories. Okay, maybe that's true, okay? But we need to make it so it's easy to see that they're false news stories, then let them continue to spread along the information that shows that they're false. And I think this is just a matter of figuring out the right computer platform so that it becomes, think about Wikipedia.
[00:48:34] Bruce: Wikipedia has the right approach, where anyone can go write whatever they want on Wikipedia for any entry, which at some level, you look at that and you compare it to everything we're talking about with Shiri's Scissor, it should be a disaster and it's not.
[00:48:50] Cameo: Right. Okay. It's effective.
[00:48:52] Bruce: It's effective. And the reason why is because they forced the conflict, the conflict was good, right? The bad thing is shutting down the conflict. The conflict has to take place. If you're going to decide what goes on Trump's Wikipedia page, you have to choose to word things in such a way that the other side is going to let it pass or has to let it pass because it's sourced. It's something that they can quote and they can show you the source. And it forces them to get down to facts, not spin. In many ways, even though even Wikipedia has somewhat of a bad reputation, they're a better news source than most news sources, right? The very fact that they have to synthesize everything, the end result, especially on controversial items, is that I can go to Wikipedia on any controversial item, and I'm pretty much guaranteed I'm gonna get both sides of the story, and that I'll become aware of both sides of the story.
[00:49:52] Bruce: And it's really hard to do that anywhere else. And I think the Wikipedia model is the right model. We just need to adapt that to YouTube. We need to adapt that to Facebook stories. We need to adapt that to absolutely everything, so that it's not that someone's out there deciding what to shut down. It's that we're going to let the bad news stories run. We're going to let them run as far as they want, but they're going to come with truth attached. And [that’s] the way we're going to deal with this from now on. And I really think that's the correct solution. That's the correct critical rationalist solution to this problem. And it doesn't solve all the problems we've talked about today, but the one you just mentioned here at the last is to do that. And I don't even think this is necessarily a difficult problem to solve. I mean, like, I can't right off the top of my head tell you this is how you would make an interface that would make it trivial to attach truth to a false story, right?
[00:50:45] Bruce: But it’s not that hard to start coming up with ideas that you could then test out and figure out what works. I really wish we would move in this direction. The only other thing I can think of that we might have to go to is there are platforms out there that simply, platforms that are like Facebook, platforms that are like YouTube, that are like Patreon, except that they refuse to do anything but just let people do whatever they want. They don't decide for people. None of these have really taken off though. I don't see how they can at the moment compete with the big platforms. They're usually suboptimal in terms of how good their interfaces are, how good their algorithms are.
[00:51:30] Cameo: Well, it's also hard to fight against dominance and establishment. Ultimately, the rise of a platform like that would have to happen at the kid level, or at the young adult level where they adopted it and started using it, and then had the prevalence get to the level it would so that people would switch over. I think we're a long, and I could be wrong, maybe one day it's like Yahoo just goes away and Facebook just goes away. But I think it takes a lot to change the trajectory of the amount of people that use Facebook and how it's used.
[00:52:12] Bruce: Yeah, I agree. I think the best long-term solution, it seems to me like this would benefit Facebook. If you're Facebook, you probably don't want to spend, I don't know how much money they spend on censors. It's got to be a lot. They've got to have people are complaining all the time. It's very natural for people to try to use reporting to Facebook as a way of shutting down statements that they don't like.
[00:52:38] Cameo: Sure.
[00:52:38] Bruce: We live in a culture now that's divided like that. So every weapon at your-
[00:52:43] Cameo: Report this [unclear].
[00:52:45] Bruce: Right. You're using every weapon at your disposal. Sure.
[00:52:50] Unidentified speaker: Right.
[00:52:50] Bruce: Some people are. So if there's anything, if you make a Facebook post, it has a picture of Hitler, you can get upset over that and you can choose to go report it, and then Facebook is going to be forced to go send somebody to respond to that and to look at it and to make a decision. We can imagine that they're not going to be super consistent in how they make decisions. Whatever the leanings of that individual investigator are probably is going to make a big difference. Facebook probably doesn't want to have to pay for all these people to go investigate things. So it does seem like there could be some real value in democratizing it, letting the audience decide, okay, I'm going to attach truth statements to this. You could probably even figure out a way to adapt. This would be harder, but you could probably get a way to adapt it to safety of content.
[00:53:41] Bruce: Make it so that on Instagram, yeah, sure, you can let people do whatever they want on Instagram, just about. Maybe there's some level that you stop that's fairly extreme. But you let a lot get away, but then people can decide, this is PG-13 or something along those lines. Then people who don't want to see the PG-13 post, it just never even comes up for them, thereby lowering the number of likes that are available to you. It seems like you could come up with a good algorithm that would create the balance that we all wish we had without actually undermining the freedom of the company, and would be to their advantage because they don't have to hire so many people to monitor everything. Right?
[00:54:22] Cameo: Right.
[00:54:23] Bruce: [Let] the audience monitor. So, that's what I think the correct solution is for as far as how to handle the big media companies. And to your point, I don't see them going away. The thing that will cause them to go away will be some sort of entirely new idea that we can't even conceive right now.
[00:54:39] Cameo: Sure.
[00:54:39] Bruce: That replaces the need for them. Just like Amazon versus Walmart or whatever. Although both of those are doing well.
[00:54:50] Cameo: Well, and I wouldn't want to say Walmart was winning, but they're certainly not losing.
[00:54:56] Bruce: Well, that's actually a separate topic, right? That's actually a very interesting point. Walmart is a good example of a company that was dominant, that came under siege by a complete disrupter, Amazon, something that was unforeseen. And then figured out how to take advantage of their previous dominance, the fact that they had a footprint on the ground near you.
[00:55:25] Cameo: Very effectively, too.
[00:55:27] Bruce: Yeah, and innovative, very innovative, and almost perfect example of how you end up with two really good options. It benefited everybody because they were willing to pursue, they were willing to think not to just roll over and die, but to say, okay, what advantage do we have over Amazon? How do we exploit that?
[00:55:48] Cameo: Yeah, and they're powerfully effective, and still, they are fighting the fight with guns blazing. We have a client right now that we've been building technology for, and they provide 1099 delivery drivers, and Walmart's their biggest customer, and Walmart pays a lot to delivery drivers to do deliveries. But I bought a year membership to free delivery for, I paid $89 for a full year of all the free deliveries that I want, and Walmart's paying delivery drivers $10 a delivery. So they're totally willing to lose money on every single delivery that they're going to make to me after 10, which I did that weeks, months ago, because that's going to keep me coming back to ordering. And they poured money into a really great online interface. So it's super easy for me to order groceries every week from them.
[00:56:47] Bruce: Yes. And you know, it's funny, when they first did the grocery pickup thing, they were terrible at it. It almost kept us from using them again because of how bad they were at first, where you would go to pick stuff up, and there'd be nobody there to help you. But then they just started getting good at it, and it only took like a month before they really sorted out the bugs in the system. And now it works really well.
[00:57:14] Cameo: So I was probably one of the most fervent early adopters of that to the level that I used to show people, and mostly because they killed it on their UI of their app, the ordering app. I used it as an example of great e-commerce experience for multiple clients when we would be in product discovery workshops. I was pulling it up all the time saying, like, you want to see how to deliver great e-commerce? Let me show you this Walmart grocery app, because it's really fantastic. It was just that good, and you're right. They were not doing a great job on the pickup. I would wait 25, 30 minutes when I would go in to pick up the groceries. But I was willing to forgive it, because it was easy to order online, and I'm just sitting in my car, so big deal, right?
[00:58:02] Bruce: In many ways, this is what we're talking about, though. It sounds like a tangent. Let me tie it back to what we're talking about. Walmart and Amazon, their whole viewpoint is, particularly Walmart post the Amazon era, where they had no choice but to become like this, to stay competitive. But Amazon's the one who started this whole idea. We're just going to make things really convenient for the customer. We're going to always think in terms of how do we make this so frictionless for the customer that they're going to just keep buying more and more from us, and they were the first to do the free delivery club and things like the free club. So Walmart is now doing that too, and they're thinking in terms of what's best for the customer. How do we make the customer the most satisfied? And it's interesting to note, Amazon as a company doesn't have the best reputation.
[00:58:50] Unidentified speaker: They don't.
[00:58:51] Bruce: Neither does Walmart. Right? Right. We know that they maybe don't take care of their employees the best or whatever, right? And yet people won't stop using them because the one person that they're really taking care of is their customer, right? They're making sure that their customer [experience] is always just as easy as possible, right? This is really what Facebook needs to do, right? With as far as fake news stories and things like that. When you go in and you say, I'm going to ban you because you broke some very vague community standard rule, you're automatically offending some group of people that some of them maybe are bad people, but a lot of them are just people, right? And they really probably need to be thinking more in terms of what's going to be the right experience for users, which probably means you don't ban people. It probably means you don't make heavy-handed decisions.
[00:59:47] Bruce: You've got to figure out how to let the people have the experience that they want, but everybody can feel safe. I gave a few suggestions about how you might do that, how you might allow people to mark PG-13 level or something like that, how you allow people to easily attach truth to a false story, that it has to follow it around. Something along those lines… It would be more customer-centric, it would be more user-centric, it would allow a better experience for them as well as us. And I think it would get the truth out there. The thing that the truth has an advantage on, maybe people get outraged over false things and therefore it spreads faster. But the truth has one really big advantage, which is you can't refute it. That's a huge difference. A false story can be refuted. A true story cannot be refuted.
[01:00:47] Cameo: I agree conceptually, but we're also seeing, and we talked about this in the spring, we're also seeing a swing of conceptualization across our culture where people refuse truth even when it's blatant because they've convinced themselves that there's an infrastructure that’s hiding the truth, that they know more, and that the truth that the rest of us accept is wrong.
[01:01:19] Bruce: I agree. And I think that that is part of what's coming out of polarization is this kind of choosiness over what you believe the truth to be. But if you're going to be on Facebook and if you're going to want to go post for a story that, let's say it's a false story, but you sincerely believe it to be true, deep within you, right? You end up posting it and you're forced to post it along with the counterstories, right? It sort of doesn't matter at this point. You're going to have to think about, well, I may be empowering the other side if I post this fake, you believe it to be a true story, but I post this fake story because it's going to come along with this counterargument that, actually, I don't know if I want people to see that counterargument. Because it kind of bothers me that it's so good.
[01:02:11] Cameo: You're more rational than the vast majority of people posting on Facebook.
[01:02:17] Bruce: I think that's where I'm coming from [on] this. Popper's philosophy, it's not rooted in individuals. This is something I think people get wrong about critical rationalism a lot. They try to think in terms of, how do I personally be more rational? That's great. I'm not saying there's something wrong with going and trying to be more rational, but I kind of feel like what Karl Popper would say to that is, well, you got to be a little careful with trying to make yourself more, and he actually did say this over something else. I'm reapplying it to this. He said, trying to, Francis Bacon said, you need to remove prejudice from your mind and you need to just see, and Popper said, I totally am against doing that, because the problem with thinking that you, of trying to remove prejudice from your mind is that you might think you succeeded. But in reality, you still have your biases, right?
[01:03:12] Bruce: To some degree, I think that's just the way this works, right? Is critical rationalism doesn't work at the level of the individual. You don't go try to figure out how you're going to be more rational. The danger of trying to figure out how I'm going to be more rational is that you might think you are. It works across groups. It works across the conflict between groups. It works across people. He would make statements to the effect that science needs, there's a benefit within science to being ideological. There's benefit. We want to think of science as this non-ideological, non-biased body of knowledge. You say, no, that's not true, right? Ideas need people that are really ideological and prejudiced and they want that idea to be true, whether it's true or not, because that idea needs to get tested. If everybody was just trying to be completely unbiased in science, a lot of really good ideas would die before they got tested.
[01:04:15] Cameo: Because especially when you take radical concepts that are hard for our brain to comprehend like quantum physics, as a great example, it's really easy to reject those out of hand because they seem fake.
[01:04:34] Bruce: Yes. Popper says that he thinks that if all the scientists in the world suddenly became unbiased, that science would cease to function. I’ll have to find the quote [uncertain: ‘but he actually said it in effect’]. I guess I'm saying it should work the same way everywhere. It should work that way with news stories. It should work that way with everything. It's okay that the world is full of people who want to fool themselves. It's okay that people are ideological. It's okay that people are prejudiced to a certain viewpoint. What we want is we want them to have to compete. In fact, if we really get down to it, if I were to say how biased and prejudiced are liberals compared to conservatives, it's a dumb question, because they're both so deeply biased. Ridiculously so. That isn't what matters. The fact that there's nobody in this mix that is anything but biased does not matter as long as we get the system right, as long as we get it so that they're forced to compete and they're forced to improve their arguments and stories because otherwise they're going to get their clock cleaned by the others.
[01:05:45] Cameo: Let's bring this back to Shiri's Scissors. I'm going to call on you a little bit with your, since I know you're in a deep learning class. The problem with Shiri's Scissors is that it has a tendency to divide people before they can be critical. Is there an answer in our, so much of censorship on Facebook, it does end up being automated. I would assume that algorithms and machines are responsible for more bans than individuals marking somebody as a ban.
[01:06:27] Bruce: That's my understanding, yes, is that most of it is automated.
[01:06:31] Cameo: Then since we know they are investing heavily in machine learning technologies and use and building better robots, what's the secret sauce to make Shiri's Scissor not such a powerful thing? Is there?
[01:06:49] Bruce: Yeah, and now outside of the answer I already gave, which was a good one, by the way, which is that we need to make it easy for the alternative viewpoint to travel along.
[01:07:01] Cameo: Right.
[01:07:02] Bruce: I honestly don't know. I think this is why a lot of people are scared by this. Like on Twitter, I've seen people say, we need to pass laws that require the algorithm writers to not favor extremism. That is such an extreme response. That's a cure that is so much worse than disease, it's just crazy.
[01:07:26] Cameo: Well, and also shows a level of ignorance about what's happening with how those algorithms are actually behaving.
[01:07:37] Bruce: Are you familiar with GPT-2 and 3?
[01:07:41] Cameo: I am not.
[01:07:42] Bruce: You've got to go look this up. This is an amazing thing. OpenAI, they just released GPT-3. I hope I'm saying that right. I'm going to double check that I'm saying it right.
[01:07:53] Cameo: OpenAI API, GPT-3 family with many speeds. It looks like you are.
[01:07:59] Bruce: Okay, so GPT-3 is this amazing. So 2 was amazing. 3 blows your socks off. GPT-2, you could start writing something. You could say, you could start a news story with a single sentence, whatever, and then it would write the rest for you. It would sound like a real news story. So you could actually auto-generate fake news. So there was a lot of concern over this. So OpenAI, which is Elon Musk’s group. It's Elon Musk’s group. So they actually didn't release the full model because they were worried that it would get compromised and used to generate fake news stories and things like that. Okay. So GPT-3 is the same idea. So basically the algorithm, what it does, it looks at what words came before and then it predicts what's the next word. And then once it's predicted that next word, you can then take that new stream with that new word it's added, and it can predict the next word, and then the next word, and then the next word.
[01:09:04] Bruce: And by doing this, it will write completely, it looks like it's a human writing stuff, right? I mean.
[01:09:10] Cameo: And I assume that this is the technology or similar technology to what Google's actively using inside of Gmail, where you can just hit the space bar and it will fill in your entire email. I've written whole emails where I haven't put any actual content in myself.
[01:09:29] Bruce: It's called the transformer, but it's not something I'm a great expert in, but this is since I am studying machine learning, I have to know about some of these things.
[01:09:37] Cameo: Sure.
[01:09:37] Bruce: And so it's amazing with GPT-3, there are so many parameters in the neural network. There's like, I can't remember how many, but there's just a very large number of parameters in the neural network. So it is so good at predicting the next word that it creates completely comprehensible things, right? And it keeps track of what it said before within a window of 250 tokens. I can't remember how many, but 2,000 tokens or something like that. Token being a word. It keeps track of what it said, and it will make sure that what it's saying is consistent with what was said before.
[01:10:09] Cameo: Wow.
[01:10:10] Bruce: And it can fool you, like it will write news stories, but they also released a bot that could tell you if this news story was written by a human or by GPT-2 or GPT-3. And I can't tell. They would give examples. They would show, here's these different articles, one that was written by a human, one that wasn't. You don't know which was which. And I would read through it, and I couldn't tell. I couldn't tell which was human and which one wasn't.
[01:10:38] Cameo: Wow.
[01:10:39] Bruce: And I would feed it to the bot, and the bot would immediately answer, and it would know which one was which.
[01:10:45] Cameo: Seriously?
[01:10:46] Bruce: Yeah.
[01:10:46] Cameo: Oh, interesting. I'm reading this now, and it's the crazy part of our world, that this kind of stuff, I'm a pretty big nerd, but just reading this, it says, GPT-3 was trained on hundreds of billions of words and is capable of coding in CSS, JSX, Python, among others. And since GPT-3's training data was all-encompassing, it does not require further training for distinct language tasks.
[01:11:17] Bruce: Yes, it's a one-shot or a few-shot learner. So like you can say, you can give an example. You can say, I want an English sentence, colon, sentence in Chinese. And then you give it a few examples, and then you just simply give it the English and it will automatically write the Chinese translation. It figures out just by context, oh, you're looking for a translation and it puts it there. It's amazing what it can do. Some of the examples, like you go on Twitter and they're keeping track of the code. It can code. You can give it examples. You can say, I want to create a window with a button, blah, blah, blah, in English, and then you can give it an example of code, and then you can just start giving it English sentences and it will code them.
[01:12:03] Unidentified speaker(s): Okay, so, let's wrap up for today.
[01:12:08] Cameo: Because I have to go and read this and I'm about to geek out on it.
[01:12:14] Unidentified speaker: I’m not going to [unclear] for a little while.
[01:12:18] Cameo: Because this is really, really cool. And, you know, I mean, it's funny because you start, you see manifestation of technology in your day to day, you know, especially by really forward-thinking groups like Google, you know, they're always pushing the envelope, Apple. But to read about what these kinds of technologies are capable of is a little bit awe-inspiring and overwhelming. Yeah.
[01:12:42] Bruce: By the way, if you go, there's a, there's an app on your phone that if you paid the money, it will play Dungeons and Dragons with you using GPT-3. And it will be the dungeon master. So it's one of the easier ways to go interact with it and go try it out.
[01:13:00] Cameo: I want to have access to it to see what it'll write for me.
[01:13:04] Bruce: Yeah, let's be honest, it still can't pass the Turing test. It can write an article that I can't tell was written by a computer. But if you could interact with it, it's not too hard to figure out, like, oh, it's got no memory past a certain point. You're not dealing with a human. So, but it's an amazing leap forward. And the reason why it's so good is because it's been trained on the whole internet, right? So what it's coming back with is sentence structures that some human wrote at some point. That's why it's so good.
[01:13:38] Cameo: Right, right.
[01:13:38] Bruce: It's about how to statistically run between words and it's going to come back with information that was somewhere on the internet at some point, right?
[01:13:48] Cameo: Well, it's because language, while being an aspect of intellect, is not what defines intellect. And so having language and being able to use language is not the same thing as having an intellect to be able to use and a mind to be able to use, which is why it doesn't pass the Turing test. There's not actually a mind, per se.
[01:14:10] Bruce: There's no mind there. It's completely stupid still, right?
[01:14:14] Cameo: Yeah, it's a dumb generator.
[01:14:17] Bruce: It will seem like a mind at first because it’s putting out stuff that was written by a person with a real mind, right? Finding the right words to string together that came from real people. But beyond that, there's nothing behind it, right? It's just simply predicting the next word, and then the next word, and then the next word, and then the next word. So, but anyhow, the way, and the point of all this aside was that we can write bots that fight bots, right?
[01:14:43] Unidentified speaker: It's-
[01:14:45] Bruce: It’s possible to write bots that will find the fake bots that there’s no real person behind and remove them. We, there's always gonna be a war of technology and ideas like that, but we can keep up with them. There are always solutions to them because stuff written by GPT-3 still has no mind behind it and so it's still detectable as long as you've got the right machine learning algorithm to detect it. So anyhow, that was this, we've gone on a bit long here. This turned out to be a fascinating subject and gave us a chance.
[01:15:20] Cameo: The longer we do this, the longer each of our episodes seems to get. Okay, well, this was a fantastic conversation.
[01:15:31] Unidentified speaker: Thanks.