Working of a Search Engine

on

 Hi readers!

Welcome back to my Blog. In this, I will tell you about:

  1. Crawling
  2. Indexing
  3. Ranking & Serving

  • Crawling:
If you want to create a Search Engine like Google, firstly, you have to crawl the World Wide Web which will send some Bots also called Spiders. Spiders are software programs that visits each and every websites in the world, copies all the pages and information and saves it into your server. In this case, it is Google server.

The Bots or the Spiders gets this data as Google as already crawled most of the websites, so they have information and they look them up from there. Also, the owners of the websites called Webmasters, submit their data of the websites on Google called Sitemaps. Google looks on those sitemaps and ensues that every web page on the World Wide Web i.e. Internet is visited. 

When Google initially started, it took 90 days for Google to crawl all the web pages on World Wide Web. So, the page which got crawled on its first day, the next time it got crawled was on the 91st day and in between those 90 days if someone looked at that page, they would look the same page again and again even though the website may have changed. So, it was very common at that stage, that whenever one clicked on a link, it showed that the page does not exists. But now these things doesn't happen, as Google started Crawling the entire World Wide Web within a day and sometimes it crawls the entire WWW many times a day.

  • Indexing:
After the Google has crawled all the pages which are stored in the databases, Google create and index for them. Google looks at all the words that it sees on Internet and indexes them like an index of a book which tells Google that which words are in which pages of the database which helps Google return much faster results from the database. Now, Google has created various types of indexes for different platforms like sports websites, educational websites, crowdfunding websites, portal websites, business websites, etc. And Google ultimately makes sure that it give faster results.

  • Ranking & Serving:
For every search result, Google brings up millions of relevant websites. Google rank those websites in a way that the most relevant search result will be shown at the top of the Search Engine Results Page (SERP).

There are 200+ factors through which Google determines the relevance of a search result. The most important factor is Page Rank. Page Rank is determined to the notation of worthiness of a website. The higher the Page Rank, the higher its worthiness and authoritativeness. Google determines the Page Rank of the web site or web page is by looking at the number of back links or referrals pointing to a particular website. Each link pointing to your website from another website adds to your website's Page Rank.

But it is not just the Page Rank which determines the SERP rank, other factors that determine SERP rank are like quality of content, a secure and accessible website, mobile friendliness, page speed, user experience, etc.

See you until next time :)

Regards,
Hritik Wahi

Comments

Post a Comment