How does a web search engine work?
: How does a web search engine work? A Search Engine contains three parts: 1) Web Crawling First part is the spider which is also called the crawler or bot. This spider part visits a web page, reads it, and then follows links to other pages within the site. This process is often referred to as crawling or spidering. Crawling of a website is done on a very regular basis, frequency of which is determined by the frequency with which website adds the content. It can vary from once in a month to several times in a day. The spiders visit a website following links from other website or website submission it received. Slide 6: 2) Indexing The content that spider finds is sent to its database or index as it is popularly known. This index is like a huge book that contains a copy of web page or cache, that the spider finds out. It also stores the structure and the way pages are linked to each other. This information would be updated every time there is a change in content or linking. There could
