Thursday 15 November 2012

Googlebot(Spider):How google works behind Search Engine

                     Googlebot(Spider) works


Most of the people work on internet are't aware about how Google Search Engine works so they are so much comfortable with the searches because of lack of knowledge .Google is not so simple as we think because there are lots of tallented people working everyday . Google Search Engine have a Human like thinking for every website on web and provide its Ranking  . In this blog i will tell you how Googlebot
Works behing Google Search Engine.  .

Googlebot :-  Googlebot are the Google Web Crawling Robot which find and retrieve the page on the web and given in the hand of Google Indexer. Googlebots are not using any new techniqe for 
finding the search pages.It work like Web Browser ,by sending the request to Web Server and download the entire page and handed over to the indexer Server.Indexer stored these Web Page by their Keywords in Doc Server .

Googlebot Finding the Page in two ways: 1. URL-(http://www.indiayatra.biz/)
                                                                    2. Findig Link through Web Crawling. 


Screen shot of web page for adding a URL to Google.

Techniques:

1. Fresh Crawl : Fresh crawl is important technique of Googlebot because most of the Website (like News) have change there content everyday. so to keep the Google Indexer Uptodate Fresh Crawling downloading these pages on daily bases and handed over to the Indexer.

2. Deep Crawl : As the name suggest it work on the deep links,when Googlebot fetch a page then it put all the links apper inside the page into the Queue for further Crawling.It is possible that Deep craling take a lot of time.   


In the next blog i will tell you how Google Query Processor

No comments:

Post a Comment