24 KiB
World Wide Web
Want to make your own small website? See our how to.
World Wide Web (www or just the web) is (or was -- by 2023 mainstream web is dead) a network of interconnected documents on the Internet, which we call websites or webpages. Webpages are normally written in the HTML language and can refer to each other by hyperlinks ("clickable" links right in the text). The web itself works on top of the HTTP protocol which dictates how clients and servers communicate. Less knowledgeable people confuse the web with the Internet, but of course those people are retarded: web is just one of many services existing on the Internet (other ones being e.g. email or torrents). In order to browse the web you need an Internet connection and a web browser.
{ How to browse the web in the age of shit? Currently my "workflow" is following: I use the badwolf browser (a super suckless, very fast from-scratch browser that allows turning JavaScript on/off, i.e. I mostly browse small web without JS but can still do banking etc.) with a CUSTOM START PAGE that I completely own and which only changes when I want it to -- this start page is just my own tiny HTML on my disk that has links to my favorite sites (which serves as my suckless "bookmark" system) AND a number of search bars for different search engines (Google, Duckduckgo, Yandex, wiby, Searx, marginalia, Right Dao, ...). This is important as nowadays you mustn't rely on Google or any other single search engine -- I just use whichever engine I deem best for my request at any given time. ~drummyfish }
An important part of the web is also searching its vast oceans of information with search engines such as the infamous Google engine. Websites have human readable url addresses thanks to DNS.
Mainstream web is now EXTREMELY bloated, unusable and beyond saving, for more suckless alternatives see gopher. See also smol web.
Prior to the tragedy of mainstreamization the web used to be perhaps the greatest and most spectacular part of the whole Internet, the service that made Internet widespread, however it soon deteriorated by capitalist interests, commercialization and subsequent invasion of idiots from real world; by this date, in 2020s, it is one of the most illustrative, depressing and also hilarious examples of capitalist bloat. A good article about the issue, called The Website Obesity Crisis, can be found at https://idlewords.com/talks/website_obesity.htm. There used to be a tool for measuring website bloat (now dead) which worked like this: it computed the ratio of the page size to the size of its screenshot (e.g. YouTube, as of writing this, scored 35.7).
Currently there's a "vision" of so called "web 3" which is supposed to be the "next iteration" of the web with new "paradigms", making use of "modern" (i.e. probably shitty) technology such as bloackchain; they say web 3 wants to use decentralization to prevent central control and possibly things like censorship, however we can almost certainly guarantee web 3 will be yet exponentially amplified pile of bloat, garbage and a worse dystopia than our nightmares were able to come up with so far, we simply have to leave this ship sink. If web 3 is what web 2.0 was to web 1.0, then indeed we are doomed. Our prediction is that web will simply lose its status of the biggest Internet service just as Usenet did, or like TV lost its status of the main audiovisual media; web will be replaced by something like akin "islands of franchised social media accessed through apps"; it will still be around but will be just a huge ad-littered swamp inferior to teletext where the elderly go to share pictures no one wants to see and where guys go to masturbate.
How It Went To Shit
{ As of 2023 my 8GB RAM computer with multiple 2+ GHz CPUs has serious issues browsing the "modern" web, i.e. it is sweating on basically just displaying a formatted text, which if done right is quite comfortably possible to do on a computer with 100000 times lower hardware specs! In fact orders of magnitude weaker computers could browse the web much faster 20 years ago. Just think about how deeply fucked up this is: the world's foremost information highway and "marvel of technology" has been raped by capitalist soydevs so much that it is hundreds of thousands times less efficient than it should be, AND it wouldn't even require much effort to make it so. Imagine your car consuming 100000 litres of gasoline instead of 1 or your house leaking 99999 litres of water for any 1 litre of water you use. This is the absolute state of dystopian capitalist society. ~drummyfish }
________________________________________________________________________
| | | | | [X]|
| ~!ENLARGE PENIS WITH SNAKE OIL!~ | | CSS | | Video AD |
|__________________________________| | | | CONSOOOOOOOOOOOOO |
| U.S. PRESIDENT ASSASINATED | BUG | | OOOOOOOOOOOM BICH |
| | | |______________________|
| Article unavailable in your country. | LOL | [make account or suffer]|
| [log in to enable mouse scrolling] | | |
| ___________________________________| |___ Prove you're a |
| | |_______| | human, click all |
| | We masturbate over your privacy <3 | images of type 2 |
| | | quasars. |
| | Consent with spying? | [*] [*] [*] [*] |
| | _____ ______ | [*] [*] [*] [*] |
| | | YES | | OK | | _________________ |
| | """"" """""" |_ | FUCK MATURE MOMS||
| |_______________________________________________| || IN 127.0.0.1 ||
| | || CHAT NOW !!!1! ||
| | Your browser is 2 seconds old, please update || ||
| | to newest version to view this site. ||3000 NEW MESSAGES||
|_____|______________________________________________||_________________||
A typical website under capitalism, 2023. For potential far-future readers: this is NOT exaggeration, all websites LITERALLY look like this.
{ Ah this pseudoimage above made it to Encyclopedia Dramatica :D Thank you kind stranger <3 ~drummyfish }
Back in the day (90s and early 2000s) web used to be a place of freedom working more or less in a decentralized manner, on the principles of free speech, anarchism and, to the Yankee's dismay, even communism -- people used to run their own unique, non-commercial websites where they shared freely and openly, censorship was difficult to implement, unwelcome and therefore mostly non-existent and websites used to have a way better design, they were KISS, lightweight, safer, "open" (no paywalls, registration walls, country blocks, DRM, ...), MUCH faster and more robust as they were pure HTML documents, without scripts, "apps", jumpscare ads -- simply without bullshit. It was also the case that most websites were truly nice, useful and each one had a "soul" as they were usually made by passionate nerds who had a creative freedom and true desires to create a good website (and this still continued for a while after the invasion of businesses, i.e. commercial sites were still pretty bearable).
As the time marched on web used to stink more and more of shit, as is the fate of everything touched by the capitalist hand -- the advent of so called web 2.0 brought about a lot of complexity, websites started to incorporate and push client-side scripts (JavaScript, Flash, Java applets, ...) which led to many negative things such as incompatibility with browsers (kickstarting browser consumerism and update culture), performance loss and security vulnerabilities (web pages now became programs rather than mere documents) and more complexity in web browsers, which leads to immense bloat and browser monopolies (higher effort is needed to develop a browser, making it a privilege of those who can afford it, and those can subsequently dictate de-facto standards that further strengthen their monopolies). Another disaster came with social networks in mid 2000s, most notably Facebook but also YouTube, Twitter and others, which centralized the web and rid people of control. Out of comfort people stopped creating and hosting own websites and rather created a page on Facebook. This gave the power to corporations and allowed mass-surveillance, mass-censorship and propaganda brainwashing. As the web became more and more popular, corporations and governments started to take more control over it, creating technologies and laws to make it less free. By 2020, the good old web is but a memory and a hobby of a few boomers, everything is controlled by corporations, infected with billions of unbearable ads, DRM, malware (trackers, crypto miners, ...), there exist no good web browsers, web pages now REQUIRE JavaScript even if it's not needed in principle due to which they are painfully slow and buggy, there are restrictive laws and censorship and de-facto laws (site policies) put in place by corporations controlling the web. Official web standards, libraries and frameweworks got into such an unbelievably bloated, complicated, corrupted and degenerated state (look up e.g. Shadow DOM) that one cannot but stare in astonishment about the stupidity.
Mainstream web is quite literally unusable nowadays. { 2023 update: whole web is now behind cuckflare plus secure HTTPS safety privacy antipedophile science encrypted privacy antiterrorist democratic safety privacy security expert antiracist sandboxed protection and therefore literally can't be used. Also Google has been absolutely destroyed by the LLM AIs now. ~drummyfish } What people searched for on the web they now search on on a handful of platforms like Facebook and YouTube (often not even using a web browser but rather a mobile "app"); if you try to "google" something, what you get is just a list of unusable sites written by AIs that load for several minutes (unless you have the latest 1024 TB RAM beast) and won't let you read beyond the first paragraph without registration. These sites are uplifted by SEO for pure commercial reasons, they contain no useful information, just ads. Useful sites are buried under several millions of unusable results or downright censored for political reasons (e.g. using some forbidden word). Thankfully you can still try to browse the smol web with search engines such as wiby, but still that only gives a glimpse of what the good old web used to be.
{ More of web 2023 experience: if you want to Google something as simple as "HTML ampersand", just to get the HTML entity 5 character code, you basically get referred to a site that's 200 MB big, loads for about 1 minute (after you pass 10 checks for not being a robot), has 50 sections and subsections like "Who This Tutorial on Copypasting 5 Character is for", "What You Will Learn in This Tutorial", "Time Required for Reading This Tutorial" (which without these sections would be like 3 seconds), "Introduction: History of HTML" (starting with Stone Age) etc. There are of course about 7 video ads between each section and the next. Then finally there is the & code you can copy paste, buried in level 12 subsection ("HTML Code" -> "History of Programming Since Napoleon Bonaparte" -> "How Ada Lovelace Invented Computer Science" -> "How Tim Berners-Lee Stole The Idea For Web from His Wife" -> "Why Women Only Crews For Next Space Mission are a Good Idea" -> "How This All Finally Gets Us to HTML Amp Entity" -> ...). Then of course there follow about 600 more sections like "Methodology Used to Create This Copypasting Tutorial" etcetc. until "Conclusion: What We Have Learned about the HTML Amp Entity and History of Feminism"; but at least you don't have to scroll through that; anyway at this point you are already suicidal and don't even want to write your HTML anymore. ~drummyfish }
WHY does every fucking SINGLE ONE, EVERY SINGLE WEBSITE ON EARTH have to have ads on it now? EVERY.SINGLE.WEBSITE.HAS.ADS. Everyone single FUCKING WEBSITE HAS ADS -- why? No, you fucking don't need money to run a website, stop giving this moronic argument. Don't you have $0.00000001 to pay for a domain and raspberri pi? Stop that fucking shit. Back then website didn't have ads and existed you idiot. Make a website without ads else spare us this shit and take it down.
History
As with most groundbreaking inventions the web didn't appear out of nowhere, as may seem in retrospect -- the ideas it employed were tried in times prior, for example the NABU network did something similar even 10 years before the web; likewise Usenet, the BBS networks and so on. Nevertheless it wouldn't be until the end of 1980s that all the right ingredients came together in the right mix, under ideal circumstances and with a bit of luck to get really popular.
World Wide Web was invented by an English computer scientist Tim Berners-Lee. In 1980 he employed hyperlinks in a notebook program called ENQUIRE and he saw the idea was good. On March 12 1989 he was working at CERN where he proposed a system called "web" that would use hypertext to link documents (the term hypertext was already around). He also considered the name Mesh but settled on World Wide Web eventually. He started to implement the system with a few other people. At the end of 1990 they already had implemented the HTTP protocol for client-server communication, the HTML, language for writing websites, the first web server and the first web browser called WorldWideWeb. They set up the first website http://info.cern.ch that contained information about the project (still accessible as of writing this).
In 1993 CERN made the web public domain, free for anyone without any licensing requirements. The main reason was to gain advantage over competing systems such as Gopher that were proprietary. By 1994 there were over 500 web servers around the world. WWW Consortium (W3M) was established to maintain standards for the web. A number of new browsers were written such as the text-only Lynx, but the proprietary Netscape Navigator would go to become the most popular one until Micro$oft's Internet Explorer (see browser wars). In 1997 Google search engine appeared, as well as CSS. There was a economic bubble connected to the explosion of the Web called the dot-comm boom.
Interesting between 2000 and 2010 a mobile alternative to the web, called WAP, briefly came to the scene. Back then mobile phones were significantly weaker than PCs so the whole protocol was simplified, e.g. it had a special markup language called WML instead of HTML. But as the phones got more powerful they simply started to support normal web and WAP had to say goodbye.
Around 2005, when YouTube, Twitter, Facebook and other shit websites (or shall we say "webshites"?) started to appear and stole the mainstream popularity, so called Web 2.0 began to form. This was a shift (or shall we say "shit"?) in the web's paradigm towards more ugliness and hostility such as more JavaScript, bloat, interactivity, websites as programs, Flash, social networks etc. This would be the beginning of the web's downfall.
How It Works
It's all pretty well known, but in case you're dumb...
Users browse the Internet using web browsers, programs made specifically for this purpose. Pages on the Internet are addressed by their URL, a kind of textual address such as http://www.mysite.org/somefile.html. This address is entered into the web browser, the browser retrieves it and displays it.
A webpage can contain text, pictures, graphics and nowadays even other media like video, audio and even programs that run in the browser. Most importantly webpages are hypertext, i.e. they may contain clickable references to other pages -- clicking a link immediately opens the linked page.
The page itself is written in HTML language (not really a programming, more like a file format), a relatively simple language that allows specifying the structure of the text (headings, paragraphs, lists, ...), inserting links, images etc. In newer browsers there are additionally two more important languages that are used with websites (they can be embedded into the HTML file or come in separate files): CSS which allows specifying the look of the page (e.g. text and font color, background images, position of individual elements etc.) and JavaScript which can be used to embed scripts (small programs) into webpages which will run on the user's computer (in the browser). These languages combined make it possible to make websites do almost anything, even display advanced 3D graphics, play movies etc. However, it's all huge bloat, it's pretty slow and also dangerous, it was better when webpages used to be HTML only.
The webpages are stored on web servers, i.e. computers specialized on listening for requests and sending back requested webpages. If someone wants to create a website, he needs a server to host it on, so called hosting. This can be done by setting up one's own server -- so called self hosting -- but nowadays it's more comfortable to buy a hosting service from some company, e.g. a VPS. For running a website you'll also want to buy a web domain (like mydomain.com), i.e. the base part of the textual address of your site (there exist free hosting sites that even come with free domains if you're not picky, just search...).
When a user enters a URL of a page into the browser, the following happens (it's kind of simplified, there are caches etc.):
- The domain name (e.g.
www.mysite.org) is converted into an IP address of the server the site is hosted on. This is done by asking a DNS server -- these are special servers that hold the database mapping domain names to IP addresses (when you buy a domain, you can edit its record in this database to make it point to whatever address you want). - The browser sends a request for given page to the IP address of the server. This is done via HTTP (or HTTPS in the encrypted case) protocol (that's the
http://orhttps://in front of the domain name) -- this protocol is a language via which web servers and clients talk (besides websites it can communicate additional data like passwords entered on the site, cookies etc.). (If the encrypted HTTPS protocol is used, encryption is performed with asymmetric cryptography using the server's public key whose digital signature additionally needs to be checked with some certificate authority.) This request is delivered to the server by the mechanisms and lower network layers of the Internet, typically TCP/IP. - The server receives the request and sends back the webpage embedded again in an HTTP response, along with other data such as the error/success code.
- Client browser receives the page and displays it. If the page contains additional resources that are needed for displaying the page, such as images, they are automatically retrieved the same way (of course things like caching may be employed so that they same image doesn't have to be readownloaded literally every time).
Cookies, small files that sites can store in the user's browser, are used on the web to implement stateful behavior (e.g. remembering if the user is signed in on a forum). However cookies can also be abused for tracking users, so they can be turned off.
Other programming languages such as PHP can also be used on the web, but they are used for server-side programming, i.e. they don't run in the web browser but on the server and somehow generate and modify the sites for each request specifically. This makes it possible to create dynamic pages such as search engines or social networks.
How To (Sc)rape And Hack The Web
A great deal of information on the Internet is sadly presented via web pages in favor or normies and disfavor of hackers who would like to just download the info without having to do clickity click on seizure inducing pictures while dodging jumpscare porn ads. As hackers we aim to write scripts to rape the page and force it to give out its information without us having to suck its dick. With this we acquire the power to automatically archive data, hoard it, analyze it, do some netstalking, discover hidden gems, make our own search engines, create lulz such as spambots etc. For doing just that consider the following tools:
- General CLI downloaders like wget and curl. You download the resource and then use normal Unix tools to process it further. Check out the man pages, there exist many options to get around annoying things such as redirects and weirdly formatted URLs.
- Text web browsers like links, lynx and w3m -- these are excellent! Check out especially the
-dumpoption. Not only do they handle all the crap like parsing faulty HTML and handling shitty encryption bullshit, they also nicely render the page as plain text (again allowing further use of standard Unix tools), allow easily filling out forms and all this kind of stuff. - Libraries and scraping specific tools: there exist many, such as the BeautifulSoup Python library -- although these tools are oftentimes very ugly, you may just abuse them for a one time throwaway script.
- Do it yourself: if a website is friendly (plain HTTP, no JavaShit, ...) and you just want to do something simple like extract all links, you may well just program your scraper from scratch let's say in C, it won't the that hard.
- ...