The surface web [the visible web] is the most popular subsection amongst the three types of web. The surface web’s target audience is the general public catering to different needs and wants. The other two subsections are the dark web and the deep web which serve different purposes with different characteristics.
Read also: THE SURFACE, DEEP, AND DARK WEB
Origins of the surface web:
Tim Berners-Lee an English engineer and computer scientist created the first-ever web browser and named it WorldWideWeb and later renamed to Nexus later. The modern-day equivalent to the browser released 3 decades ago would be Google Chrome and Mozilla Firefox.
Three decades ago was when the surface web originated. This was after the first browser came into existence. In other words, it’s like phonebooks from the nineties where the phonebooks consisted of everyone’s registered landline numbers or addresses. When trying to understand the search engines indexing the same idea can be applied.
Search Engine Indexing:
This is a process where the search engine processes and stores information from a huge database [INDEX]. It is easier and faster to browse and retrieve the stored information. Not only if there were no stored data then the search engine also will have no medium to look for a matching keyword to display results.
So the results are usually displayed off other webpages, in addition to this all webpages on the surface web are indexed. When you search for anything, matches are displayed off the stored index pages containing HTML/WEBPAGES/WEBSITES. which contain various types of data.
So how do search engines discover new information automatically?
Crawling. This is a process where a search engine sends automated robots [also famously knows as “crawlers” and “spiders”] to find newly updated content. The route taken by these crawlers is website links. There are other factors that come into play here and for good reasons.
For example two factors namely:
- Rankings of websites: As of January 2020 there are 1.74 Billion websites. To get better search results in content creators will now have to provide the best content and work their way up their rankings. Moreover, the quality of the results will improve because now the content owners are more experienced working their way to the top of rankings.
- The legitimacy of content: We live in a day and age where the amount of individuals/ organizations who scam people or people who create content for the sake of creating content is increasing. Crawling filters the best results out. Alternatively, the percentages of misguiding and inaccurate information reduce.