When did search engines start using Sitemap files, and why?
Around August 2005, Google came up with Sitemap files in an effort to index website content with more accuracy. With the increasing amount of websites posting new daily content and with the growing number of URLs featuring dynamic content, it became necessary for major search engines to develop a code which prepares the websites’ contents in a way which facilitates the crawling process from one month to the next.