Stuff You Should Know - SYSK Selects: How the Deep Web Works

Episode Date: April 4, 2020

Perhaps you didn’t realize that when you search the web you’re only skimming the surface. In fact, the types of web pages that turn up in your search engine results represent only a mere fraction ...of the total web. Immerse yourself in the Deep web and its dark corners in this classic episode. Learn more about your ad-choices at https://www.iheartpodcastnetwork.comSee omnystudio.com/listener for privacy information.

Transcript
Discussion (0)
Starting point is 00:00:00 On the podcast, Hey Dude, the 90s called, David Lasher and Christine Taylor, stars of the cult classic show, Hey Dude, bring you back to the days of slip dresses and choker necklaces. We're gonna use Hey Dude as our jumping off point, but we are going to unpack and dive back into the decade of the 90s.
Starting point is 00:00:17 We lived it, and now we're calling on all of our friends to come back and relive it. Listen to Hey Dude, the 90s called on the iHeart radio app, Apple Podcasts, or wherever you get your podcasts. Hey, I'm Lance Bass, host of the new iHeart podcast, Frosted Tips with Lance Bass. Do you ever think to yourself, what advice would Lance Bass
Starting point is 00:00:37 and my favorite boy bands give me in this situation? If you do, you've come to the right place because I'm here to help. And a different hot, sexy teen crush boy bander each week to guide you through life. Tell everybody, ya everybody, about my new podcast and make sure to listen so we'll never, ever have to say. Bye, bye, bye.
Starting point is 00:00:57 Listen to Frosted Tips with Lance Bass on the iHeart radio app, Apple Podcasts, or wherever you listen to podcasts. Hello everyone, happy Saturday. Chuck here with another Saturday Selects Pick. This week, how the deep web works, January 22nd, 2014. This is a good one everyone.
Starting point is 00:01:15 The deep web is deep and dark and scary, or at least it can be, and we dove into that. It's changed a lot over the past six years, but this is a pretty good early peak at the deep web, and I was proud of this one. So, give a listen, I hope you enjoy it. Have a great weekend. Welcome to Step You Should Know,
Starting point is 00:01:34 a production of iHeart Radio's How Stuff Works. Hey, and welcome to the podcast. I'm Josh Clark, and there's Charles W. Chuck Bryant. Howdy. And that makes the stuff you should know. That's right. Mine is Jerry, but with no.
Starting point is 00:01:53 That's right. You lose a Jerry, gain a no. One step forward, and another step forward. Oh, man. For a Jerry, you've just been wailing on her today. Well, I'm not gonna say two steps back, with no, sitting five feet away. Well, it could be one and one.
Starting point is 00:02:10 One step forward with no, one step back for not having Jerry. You're saying it's a step forward not having Jerry, and a step forward having no. I'm just trying to make everyone like me. I'm doing a poor job of it. You do a great job of it. Everybody loves the Chuck.
Starting point is 00:02:29 Not everybody. Who doesn't? I have some mortal enemies. Mortal enemies? Yeah, they want to kill me. I'm trying to kill you. Well, Chuck, I will tell you what. If they did want to kill you,
Starting point is 00:02:43 and wanted to hire a hit man, the deep web is a good place to start looking. Yep. Quite a segue. It's been a while. Did that one up? You did, unintentionally. Unintentionally, I spotted it and went after it.
Starting point is 00:02:55 Yeah, this is about both the deep and dark web, which are two different things. The dark web is part of the deep web. Thank you. But the deep web isn't necessarily dark, all dark. Right, yeah, that's very well put. The dark web is the nefarious things that go on in the deep web.
Starting point is 00:03:12 Not necessarily nefarious, but the purposefully hidden stuff. Yeah, that's true, because there are some good things on the dark web. I totally misspoke. Yeah, well, you know what? I think that it's great that you confess to it. Yep.
Starting point is 00:03:23 You feel better? I do. Man, this is a really upfront kind of episode, isn't it? It's a very honest, we're bearing it off in 2014. What is going on? Yep, I am. So, do you have a fancy intro story? No, you'd think I would.
Starting point is 00:03:37 All right. My intro gets buried later on. It's a great intro, but it just, I'll use it as the intro. Okay, go ahead. Okay. A chuck. Yes.
Starting point is 00:03:51 Have you heard of our favorite band, Iron Maiden? Yeah, sure. So Iron Maiden is arguably the most awesome band of all time. Oh, dude. All right. I'm not a huge fan. But you wouldn't be like, I hate Iron Maiden. They suck.
Starting point is 00:04:08 Of course not. No, because it'd make you crazy. Yeah, that's right. Iron Maiden's been around for a while. They're pretty smart. They know what they're doing. And recently, they figured out a way to maximize their touring dollars.
Starting point is 00:04:22 By flying your own plane? Well, Bruce Dickinson always did. Yeah. He's a certified pilot. That's gotta be efficient. I would imagine. Plus fun, unless Bruce was partying too hard and then they got to fly to the next city that night.
Starting point is 00:04:36 He wouldn't do that. I hope not. No. Because that's dangerous. I mean, driving drunk is bad enough, but flying drunk, I can only imagine. Sure. And it's probably not just drunk.
Starting point is 00:04:47 You know what I'm saying? No, no, no. He's straight. Straight edge. Has he always been? I don't know. I can't verify that. Well, anyway, Bruce and the boys figured out
Starting point is 00:04:57 that a good way to figure out where to decide to tour would be to figure out where their music was getting pirated the most. That sounds reasonable. It does sound reasonable. It provides you with evidence of an established fan base and a fan base that is unwilling to pay for your record, but would probably pay to see you live.
Starting point is 00:05:25 How does that reason? Well, they like your music, but they don't want to pay for your CD. So why would they go see you live and pay? Because it's different. Like seeing a live show is way different than buying a CD. You can't get a live show. You could get a video of a live show.
Starting point is 00:05:41 It's still not the same experience. A live show is a live show. Plus everybody always knows that anybody involved in the very entrenched in the old guard music industry does any band, doesn't make any money on their records and make it on touring. So going to see a band live also is kind of a true act of fandom
Starting point is 00:06:00 because you're contributing directly to your band that you like, you know? So what they did was they hired a company to look at BitTorrent sites and find the regions where their music was most pirated. And they created a tour map from it and went and played those regions. Did you, do you have the number one
Starting point is 00:06:20 Iron Maiden pirated region? No. Oh, okay. But we're going to say Rio. All right. They're huge in South America. That's my guess. We'll look it up afterward. I guess Rio.
Starting point is 00:06:32 And so they were like, we're going to start our tour in Rio. Yeah. And it wasn't just that one place, but it was basically a tour that was built on the areas where their music was most pirated. It was a stroke of genius, but they couldn't have done it without harvesting the deep web because BitTorrent sites,
Starting point is 00:06:51 when you search BitTorrent, it doesn't, the average search engine doesn't respond with a list of BitTorrent activity. It'll just send you to a BitTorrent site, which means that those pages of BitTorrent activity, which are web pages, and they do exist, they're part of what's called the deep web.
Starting point is 00:07:10 That's right. The surface web, as we know it, and search engines that we all use, like Google and Bing, supposedly only have access to about 0.03% of what is truly on the worldwide web. That's like scary and weird and thrilling all at the same time.
Starting point is 00:07:29 Right. 0.03%. Yeah. And anything else that's buried is the deep web. And it's not necessarily, the deep web is not when you're purposely trying to hide things. It just may not be cataloged and indexed.
Starting point is 00:07:45 And maybe behind a password. Sure, maybe one of those timed sites that don't let you access data after a certain amount of time, could be anything with a captcha involved, anything that's not hyperlinked. There's lots of reasons that something could find itself buried in the deep web.
Starting point is 00:08:03 Right. And you make a good point is to separate the deep web and the dark web. So let me give you an example of deep web. Okay. Aside from those BitTorrent sites. There's this company called BrightPlanet and they had this,
Starting point is 00:08:15 they provide deep web harvesting and they had this primer on, what is the deep web? And one of the examples they use was, if you look up government grants on a traditional search engine, it will probably provide you with www.grants.gov as one of the first returns.
Starting point is 00:08:32 Straight up. When you go on to Grants.gov, you can then search and find pages of all these different government grants. You can search by keyword, you can browse, but those pages aren't gonna come up on your normal Google search. Right.
Starting point is 00:08:46 You have to go to the site, which means that those pages of the actual grants are part of the deep web. Yeah. Your bank account, your checking account online, if you have mobile banking or online banking, it has a web page all to its own right now. And if I searched Chuck Bryant's checking account,
Starting point is 00:09:06 it would not come back. I would not get that because it's behind a password. It's a website page, it's a web page, but it's password encrypted, therefore it's part of the deep web. Twitter, until it index tweets, used to be you couldn't search tweets, individual tweets, now you can.
Starting point is 00:09:25 So that made them formerly a part of the deep web, actual tweets. Yeah, or every company on the planet has some sort of internal employee pages, like internal.discovery that only we can access, and you can't Google search any of that stuff. Right, or somebody could conceivably access it, maybe it depends on the page,
Starting point is 00:09:49 but you have to know the exact URL. So the idea is if it's blind, if search engines are blind to it, it's part of the deep web. If search engines can index it and bring it back as a return results, search results, it's part of the surface web. Yeah, because that's all a search engine is doing.
Starting point is 00:10:09 They are, we might should do a full podcast on search engines at some point, but the general thing is there is an index of data, and they use spiders or crawlers, because it is a web, to crawl around and locate domain names and hyperlinks, and basically index all that in what they think will be most helpful
Starting point is 00:10:30 to what you're looking for. Right, so Chuck Bryant's bank account. There are some web pages out there that contain information related to that keyword search. So a search engine will keep an index with that keyword search, with the URLs, the locations, the page content, some of the page content,
Starting point is 00:10:50 the meta tags, or the metadata, and other very brief sketch information about those pages associated with the keyword for an index, which means that when you type in Chuck Bryant's bank account. You gotta quit saying that. Sorry, I thought about it as I was saying it the last time, but when you type in birds of paradise.
Starting point is 00:11:12 Bank account. Bank account. Search engine goes and accesses the index. It doesn't have to go all the way across every page on the web that it can find. It just goes to its indices, and that's how search results are returned so quickly. It's not going across the internet. It's already got the spider crawlers,
Starting point is 00:11:33 the bots doing that constantly. This search engine is just going to the indexes that the bots have created from their searches. Yeah, and it is super shallow. I mean, we said 0.03%. We do, our whole job is researching online, mainly, and we run into this all the time where you feel like you're getting a very slim portion
Starting point is 00:11:54 of what you're trying to find out, because so many of the best medical journals and things like this don't just pop up as, it's more likely to be some headline from scenen.com and not like a Harvard medical journal paper that could really help you out. Yeah, and I mean, you can get deeper and deeper with your keyword skills and your search skills,
Starting point is 00:12:18 but for the most part, yeah, the first returns, the first results, depending on what you search for, are going to be, like you said, superficial. Yeah, but even if you're a super sleuth, a Google master, like we all think we are, I mean, how much can that be bumping it up, 0.1? Yeah, well, a lot of the problem too, though, Chuck, is so much of science is behind a paywall.
Starting point is 00:12:41 Yeah, yeah. A really, really, really expensive paywalls, too, which is... Like, here's the first eight lines of this awesome medical research paper. Exactly, if you want it, give us $1,200. Yeah. Yeah, which is a problem in and of itself, not necessarily related to this,
Starting point is 00:12:56 but with current search engine technology, you have, like you said, a superficial result from a query. On the other end of the spectrum, and this is kind of what search engines are dealing with now, the deeper you go into the deep web, again, the surface web is 0.03% of all of the web pages on the entire internet. So the further you go into it, the more data you have,
Starting point is 00:13:21 and you eventually can run into the problem of what's called big data, which not capitalized B or D, which refers to companies like Google and that can dig and harvest and maintain a large amount of data. Yes, it's basically data that's so much and so unwieldy, you can't even process and search it.
Starting point is 00:13:43 It's not even helpful. Yeah, it's like a really bad internet search. Yeah, pretty much. So the current state of search engine design or creation is balancing that, figuring out how to get less superficial without running into the big data problem of incoherent data due to just massive amounts of returns. And you might think that these search engines
Starting point is 00:14:11 do a great job, because oh, I can always find out what I need, but you don't know what you're missing, you know? Right. So it's sort of not even correct to say that. I always find out what I need, because you may not even know you need it, because it's hidden.
Starting point is 00:14:24 That's true, and I mean, you're missing quite a bit. ["Stuff You Should Know"] ["Stuff You Should Know"] On the podcast, pay dude the 90s called David Lasher and Christine Taylor, stars of the co-classic show, Hey Dude, bring you back to the days of slip dresses and choker necklaces.
Starting point is 00:14:49 We're gonna use Hey Dude as our jumping off point, but we are going to unpack and dive back into the decade of the 90s. We lived it, and now we're calling on all of our friends to come back and relive it. It's a podcast packed with interviews, co-stars, friends, and nonstop references to the best decade ever. Do you remember going to Blockbuster?
Starting point is 00:15:09 Do you remember Nintendo 64? Do you remember getting Frosted Tips? Was that a cereal? No, it was hair. Do you remember AOL Instant Messenger and the dial-up sound like poltergeist? So leave a code on your best friend's beeper, because you'll want to be there
Starting point is 00:15:21 when the nostalgia starts flowing. Each episode will rival the feeling of taking out the cartridge from your Game Boy, blowing on it and popping it back in as we take you back to the 90s. Listen to Hey Dude, the 90s called on the iHeart radio app, Apple Podcasts, or wherever you get your podcasts.
Starting point is 00:15:38 Hey, I'm Lance Bass, host of the new iHeart podcast, Frosted Tips with Lance Bass. The hardest thing can be knowing who to turn to when questions arise or times get tough, or you're at the end of the road. Ah, okay, I see what you're doing. Do you ever think to yourself, what advice would Lance Bass and my favorite boy bands
Starting point is 00:15:54 give me in this situation? If you do, you've come to the right place, because I'm here to help. This, I promise you. Oh, God. Seriously, I swear. And you won't have to send an SOS, because I'll be there for you.
Starting point is 00:16:07 Oh, man. And so will my husband, Michael. Um, hey, that's me. Yep, we know that, Michael. And a different hot, sexy teen crush boy bander each week to guide you through life, step by step. Oh, not another one. Kids, relationships, life in general can get messy.
Starting point is 00:16:22 You may be thinking, this is the story of my life. Just stop now. If so, tell everybody, yeah, everybody, about my new podcast and make sure to listen, so we'll never, ever have to say bye, bye, bye. Listen to Frosted Tips with Lance Bass on the iHeart radio app, Apple Podcasts, or wherever you listen to podcasts.
Starting point is 00:16:41 ["Stuff You Should Go"] ["Stuff You Should Go"] Okay, there's apparently 550 million registered domains on the internet. Yeah, and that's, I looked at like just in 2012, I think there are only like 250 or something. I mean, it seems like it's doubled in the last couple of years. Right, so there's 550 million domains
Starting point is 00:17:09 for example. Yeah, a lot of them are garbage. Yes, but howstuffworks.com is one domain. And I asked Tracy Wilson, who's the site director and runs Stuff Fumus and History class, it's one of the co-hosts, how many pages there are at How Stuff Works? She said roughly at least 50,000. So one domain out of 550 million
Starting point is 00:17:30 has 50,000 pages itself, right? So you kind of get an idea of the scope. And the deep web is anywhere from 400 to 500 times bigger than the surface web. And like you said, you don't know what you're missing because you don't know what's out there because your search returns aren't bringing you back anything. Yeah, I mean, there's a lot of important stuff out there.
Starting point is 00:17:52 We talked about medical papers. Apparently there's engineering databases, financial information, a lot of things that could really help research, but you just can't find it. Right, unpublished blog posts. Just basically anything that a person creates on the internet, if a page is created, it's part of the deep web.
Starting point is 00:18:17 Yeah, and unless you take this stuff down, it's living there forever just gathering dust. Exactly, so, and it's not just necessarily engineering databases or medical information, there's also a lot of shady stuff too. The dark web. That's the dark web. Yeah, the dark web is when these sites intentionally
Starting point is 00:18:40 reroute you, well, we'll get to how they do it, but basically it's an intentional anonymity. Oh, it just happens to be buried on the deep web because it's not indexed. It is purposely hidden from the surface web so people can't track the person searching for something or the end website, I guess. Like, those are all just private, essentially.
Starting point is 00:19:06 And privacy advocates are way into it. You're not necessarily a child pornographer, although there is a lot of that kind of stuff on the dark web. There's also a lot of good that happens on the dark web. Yeah, the anonymity and privacy and the desire for it isn't in and of itself proof of wrongdoing. Of course not.
Starting point is 00:19:24 No, which is frequently pointed out as that, but incorrectly. Yeah, if I don't want the NSA in my business, people are like, well, what are you doing? Right, exactly. Like, nothing. I just don't want them in my business. Precisely.
Starting point is 00:19:36 That's an answer that's good enough. That answer is good enough. And for a lot of people, they say, well, then I need to go to the dark web to maintain anonymity. Or to hire a hit man. Right, to kill Chuck Bryant. That you could do.
Starting point is 00:19:51 That's crazy. You could do, there was a site for a while. I don't know if you'd heard of it or not. It's called Silk Road, which got shut down. And I tease Chuck, I know you've heard of it. It's like the most famous dark website of all time. Yeah, the feds busted Ross Ulbricht, who may or may not be Dread Pirate Roberts,
Starting point is 00:20:12 which was the online name that they said, he's the guy running this. And he is now saying, actually, that's not me. But all those Bitcoins are mine. So you can't seize those Bitcoins. And it's in courts now. They're trying to determine whether or not it counts as something that you can seize as an asset from a criminal.
Starting point is 00:20:33 And they're saying that this is literally a case that no court has ever heard before. Yeah. It's never been questioned whether you could seize cryptocurrency. Yeah, and you should listen to our podcast on Bitcoins, by the way, from not too many months ago. That's a good one.
Starting point is 00:20:49 But it's essentially just encrypted digital currency. And they have a really, really fascinating circumstantial case against Ulbricht, not just for operating the Silk Road site. Yeah, that's where you could buy drugs and things, by the way. Right, which being the operator of that in and of itself shouldn't be a crime.
Starting point is 00:21:08 I'm sure that they would have prosecuted them for that if they'd been able to get their hands on them for just that. But apparently they also have him for at least two hired contract killings. One, he, I guess, hired an undercover cop to do it. And the guy went to the person who he was taking the hit out on and said,
Starting point is 00:21:32 this guy's trying to kill you. I need you to cooperate. And I'm gonna take pictures of you dead and send them to this guy. And Ulbricht apparently gave him like 40 grand upfront and another 40 after he saw the photos. So like... In Bitcoins?
Starting point is 00:21:47 No, I think in cash. Although, no, it would have been in Bitcoins. You're right. Yeah. So who knows? It could have been two Bitcoins at the time or 5,000. Well, Silk Road 2.0 launched in November. Is it out now?
Starting point is 00:21:59 It's out and there are other copycatters like the black market reloaded. And... Which that went down for a little while after Silk Road went down, but then it went back up, I think. Yeah, like, I don't know, man. I hate to say you shouldn't try and fight crime,
Starting point is 00:22:13 but you're not gonna stop this stuff when one, you know, you cut off the head of one and another grows right out of it in its place, you know? It's true if the structure that's allowing for the anonymity can remain intact. Which is the dark web. Right, but it's not just the dark web. It's like how you traverse the dark web, like using Tor.
Starting point is 00:22:36 Yeah, I guess we haven't explained. The Onion Router, T-O-R, is what it's called. And it is software that you use to access the deep web and the dark web if you choose to. And it searches for these anonymous sites for you, like a search engine, but instead of.com or.org or.net, they end in.onion. The idea in Onion has many layers.
Starting point is 00:23:00 And that's how you access it through Tor. You have to buy it and install it on your computer. Right, well, you can get it for free. Oh, is it free? Yeah, Firefox had something that, it was basically a Tor bundle. And it was the most popular one. And you could download it for free.
Starting point is 00:23:16 But it's not a web browser itself. It's like an add-on to a web browser that allows anonymity. And it does two things. One, it bounces your trail all over the world from server to server. So it makes you and your activity extraordinarily difficult to track.
Starting point is 00:23:31 Yeah, it's not just like this computer went to this site. Right, it's like, that's that whole Onion thing. There's so many layers. It's like, we can't, we don't know who this is or where they are or what they're doing or anything like that. We just know right now that this particular person happens to be it.
Starting point is 00:23:45 There's a user on Silk Road, but we don't know who it is or anything. You can't track them because they're using Tor. The other thing is, you can't get into dot Onion domain sites, dark web sites, unless you're using Tor. Like they won't let you in unless you're an anonymous user. So Tor has this kind of twofold thing,
Starting point is 00:24:05 but there was recently a breach in it. And it turned out the FBI was using malware to break through the anonymity of Tor users. And yeah, and found out a lot of people on some sites that were hosted by something called Freedom Hosting, which apparently had a horrible reputation for being the repository on the web,
Starting point is 00:24:24 on the dark web for child pornography. Right. And knowingly, like basically just not doing anything about it. Yeah. So the FBI had a, they hacked the Freedom Hosting servers and inserted this malware.
Starting point is 00:24:41 So if you went to a Freedom Hosting site, any of them, not just necessarily a child pornography, but any site hosted by Freedom Hosting, which is like say GoDaddy for the dark web. Right. You would get this malware package that exploited a keyhole in Firefox's Tor bundle. It went into your computer,
Starting point is 00:25:01 said, hey, give me your Mac address, which is basically like your computer hardware, like serial numbers, your computers and your computer's loans tracking number. And then also tell me where the computer is. And it sent it back to a server, a mystery server in McLean, Virginia. And finally, after like a month,
Starting point is 00:25:22 the FBI was like, yeah, that was us. We got, we have everybody who went on that site's name and address and everything on them. So that sent a huge ripple. And Firefox fixed this loophole, but it sent a huge ripple through the dark web and deep web community. Saying like, whoa, whoa, we were anonymous before,
Starting point is 00:25:40 but now it's been shown definitively that the feds can find out who we are. So the anonymity is reduced if not taken away. Yeah, which defeats the whole purpose. Yeah, so if you don't have that, then you can keep lopping the heads off of these things and they're not gonna grow back because people are afraid, people will be afraid
Starting point is 00:26:00 because they won't feel like they're anonymous any longer. Well, Tor has a sort of an ironic background which we will get to right after this message break. Stuff you should know. On the podcast, Hey Dude, the 90s called David Lasher and Christine Taylor, stars of the cult classic show, Hey Dude, bring you back to the days of slip dresses
Starting point is 00:26:25 and choker necklaces. We're gonna use Hey Dude as our jumping off point, but we are going to unpack and dive back into the decade of the 90s. We lived it and now we're calling on all of our friends to come back and relive it. It's a podcast packed with interviews, co-stars, friends and non-stop references
Starting point is 00:26:42 to the best decade ever. Do you remember going to Blockbuster? Do you remember Nintendo 64? Do you remember getting Frosted Tips? Was that a cereal? No, it was hair. Do you remember AOL Instant Messenger and the dial-up sound like poltergeist?
Starting point is 00:26:55 So leave a code on your best friend's beeper because you'll wanna be there when the nostalgia starts flowing. Each episode will rival the feeling of taking out the cartridge from your Game Boy, blowing on it and popping it back in as we take you back to the 90s. Listen to Hey Dude, the 90s,
Starting point is 00:27:10 called on the iHeart Radio app, Apple Podcasts, or wherever you get your podcasts. Hey, I'm Lance Bass, host of the new iHeart Podcast, Frosted Tips with Lance Bass. The hardest thing can be knowing who to turn to when questions arise or times get tough or you're at the end of the road. Ah, okay, I see what you're doing.
Starting point is 00:27:28 Do you ever think to yourself, what advice would Lance Bass and my favorite boy bands give me in this situation? If you do, you've come to the right place because I'm here to help. This, I promise you. Oh, God. Seriously, I swear.
Starting point is 00:27:40 And you won't have to send an SOS because I'll be there for you. Oh, man. And so, my husband, Michael. Um, hey, that's me. Yep, we know that, Michael. And a different hot, sexy teen crush boy bander each week to guide you through life, step by step.
Starting point is 00:27:54 Oh, not another one. Kids, relationships, life in general can get messy. You may be thinking, this is the story of my life. Oh, just stop now. If so, tell everybody, yeah, everybody about my new podcast and make sure to listen so we'll never, ever have to say bye, bye, bye. Listen to Frosted Tips with Lance Bass
Starting point is 00:28:13 on the iHeart Radio app, Apple Podcast, or wherever you listen to podcasts. ["Stuff You Should Go"] Stuff you should go. All right, so we're back and we left you with the nugget that Tor has an interesting background. And the background of Tor is actually the US Naval Research Laboratory in 2003
Starting point is 00:28:39 launched this program for political dissidents and whistleblowers so they can get their message out without fear of reprisal. Right, and this is still a use of Tor. Like the New York Times, WikiLeaks, some other news agencies have Tor sites that if you want to go and contact the New York Times or WikiLeaks anonymously, you can go to their onion site
Starting point is 00:29:04 and upload documents or say, hey, I have some information I want to share, and you can do it anonymously. So the government, though, is basically law enforcement is trying to track down criminals using the software that the government created to begin with, so it's an interesting loop. But like we said, it's not all badness. If you live in a country where bad things are going on
Starting point is 00:29:30 and you don't feel safe getting on the regular web as a political dissident, you can do so on the dark web. It offers a virtual meeting place for sometimes people are trying to combat these oppressive regimes in their countries and they can't just hop on Facebook and organize a meeting because they'll get smacked down. Right, if you're a person who values privacy for whatever reason or no reason at all,
Starting point is 00:29:57 the deep web and the dark web offer file sharing services. Email is a big one, too. Like I know I can't remember the name of the one Edward Snowden's been using, but I think it got shut down. Like just the whole company shut down. Sorry, you're out of business now because you're helping Edward Snowden. But there are other email services.
Starting point is 00:30:20 Basically everything you have on the web, if you want to do it anonymously, you have to go to a company that operates on the dark web that uses Tor to route its information or your information. Yeah, the University of Luxembourg did a study where they tried to rank the most commonly accessed stuff on the dark web and sadly, while they did find a lot of things like child pornography,
Starting point is 00:30:45 there were also a lot of sites and chat rooms for human rights and freedom of information and just people that don't want to type in a search for how to grow marijuana and then the next time they go to their Gmail account, they're a bunch of ads for grow lights and you're going, huh, how'd that happen? Well, it happened because you're searching the surface web
Starting point is 00:31:13 with an IP that can be traced back to you and not even illegal activities like that. You want to research a Fitbit bracelet and then you go and they say, hey, Chuck, are you fat? You want to lose weight? Well, why else you want a Fitbit? All right, huh? Fatty?
Starting point is 00:31:31 Why would you want a Fitbit? Yeah, it's definitely creepy, you know? There's the big brother effect, I think. Yeah. Everyone feels it. There's the existence of the deep web, not necessarily the dark web, but just the deep web. All of those pages of information that are out there, some companies have figured out how to exploit it
Starting point is 00:31:48 or the fact that search engines, normal search engines aren't doing a good job of looking into the deep web. That company, Bright Planet, I mentioned, they have a deep web harvester, which is basically a proprietary search engine algorithm that goes into websites and gets everything. Like it doesn't form an index, it grabs every bit of text off of every site
Starting point is 00:32:13 associated with a URL. That sounds like big data. It is. But they're doing it for companies like Big Pharma or Big Government and saying like, oh, you want to know what your competitor's up to? Well, here's every letter of every word, of every strip of text on your competitor's website,
Starting point is 00:32:33 including all internal stuff, everything. Wow. Please give us $10 million for that search. There's also this site called Vocative, which uses something like Bright Planet's deep web harvesting, but it does it for journalism purposes. And it's basically, rather than searching, using Google, like you or I would, for a story idea, they're searching using a deep web harvester
Starting point is 00:32:58 to find all this other information that we wouldn't be able to find because we don't know how to search the deep web and writing stories like that. And there's some pretty interesting stuff that that site's put together already. I bet. Well, when you think about it, if you think
Starting point is 00:33:10 the internet is cool and you're only getting 0.03% of it, yeah, not bad. And the surface web is getting deeper. The deep web is getting deeper. Search engines are searching deeper. It's all like, and they're trying to anonymize more effectively. So it's like this cyber war is going on.
Starting point is 00:33:32 Oh, yes. That was another good one we did. What do we do, cyber war? One on cyber war, yeah. Yeah, I knew I'd heard that before. So there you go. I would have to say that this is one of those episodes where we did it, but it is not done.
Starting point is 00:33:48 No. No, sometimes we do them and it's like, that's it, there's nothing more to say about this topic. Yeah, I'm interested to see what happens with Ulbricht for sure. That's going to be a monit landmark case, you know? Yeah. If you want to know more about the deep web,
Starting point is 00:34:03 you can type deep web into the search engine and how stuff works. It'll bring back superficial results, only how stuff works stuff. But it's pretty good, so you'll be happy. And since I said search bar, that means it's time for listener mail. All right, Josh, I'm going to call this birthday shout out
Starting point is 00:34:22 that we rarely do. Okay. Hey, guys, I'm a long time listener, shamelessly writing to ask for a huge favor. Here's the sitch. I first became aware of your podcast with my last girlfriend, Natalie David, introduced me to it when we started dating
Starting point is 00:34:37 and I've heard a thank for getting me hooked as we spent a lot of time listening to your show and learning together. As huge supporters of your podcast, we were compelled last year to make the trip up from Virginia to New York when you were putting on your trivia night. And Natalie is the one who gave us
Starting point is 00:34:50 the Mike's on pants off t-shirts. Oh, okay, yeah. And David, her boyfriend, they were super cool, super nice. They sat at a table right near us, so I got to know him a little bit. And he says, anyhow, here's where the favor comes in. She moved to Shanghai, China to teach. And she's teaching little kids English.
Starting point is 00:35:10 That's nice. And sadly, they separated when she moved over there, which to me are always like the saddest breakups. Right, like there's nothing wrong. No, just moving to China. Sure. So they just thought it was probably the thing to do, but they, because I inquired back to David,
Starting point is 00:35:28 emailed him about this and he's like, oh no, you guys broke up and said, yeah, but we still really support each other and care about each other. And hopefully our paths will cross again one day. So anyway, Natalie David is in China. And because of this distance, I was at a loss when considering what to get her,
Starting point is 00:35:42 he made a donation to Cooperative for Education in her name. And I know you guys like to read those names of people who contribute, but in this case, I was hoping you would just do a little something more special by wishing her a happy birthday. So on January 26th, which I think should be very soon, Natalie, happy birthday.
Starting point is 00:35:58 Yeah, happy birthday. We remember you, I wear that shirt all the time. My wife thinks it's funny. And I hope you're doing well in China. And don't give up on David. Oh, wow. Just cause he's here in the stupid United States. Her new Chinese boyfriend is like,
Starting point is 00:36:13 what that guy just said? She's like, nothing. Wait, rewind that. So anyway, I hope you're doing well over there in China. And thanks again for all the support. And I hope you guys hope your paths cross again one day. That was very nice. And that is from David Austin Burry.
Starting point is 00:36:27 If you have a special request for Chucker Me or us, you can tweet to us at SYSKpodcast. You can join us on facebook.com slash stuff you should know. And if you want to send an email to Chuck, Jerry, and me, you can address it to stuffpodcast at howstuffworks.com. Stuff You Should Know is a production of iHeartRadio's How Stuff Works. For more podcasts from iHeartRadio,
Starting point is 00:36:54 visit the iHeartRadio app. Apple podcasts are wherever you listen to your favorite shows. On the podcast, Hey Dude, the 90s called, David Lasher and Christine Taylor, stars of the cult classic show, Hey Dude, bring you back to the days of slip dresses and choker necklaces.
Starting point is 00:37:15 We're gonna use Hey Dude as our jumping off point, but we are going to unpack and dive back into the decade of the 90s. We lived it. And now we're calling on all of our friends to come back and relive it. Listen to Hey Dude, the 90s called on the iHeartRadio app, Apple podcasts,
Starting point is 00:37:30 or wherever you get your podcasts. Hey, I'm Lance Bass, host of the new iHeart podcast, Frosted Tips with Lance Bass. Do you ever think to yourself, what advice would Lance Bass and my favorite boy bands give me in this situation? If you do, you've come to the right place because I'm here to help. And a different hot, sexy teen crush boy bander
Starting point is 00:37:50 each week to guide you through life. Tell everybody, yeah, everybody about my new podcast and make sure to listen. So we'll never ever have to say bye, bye, bye. Listen to Frosted Tips with Lance Bass on the iHeartRadio app, Apple podcast, or wherever you listen to podcasts.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.