Sitemap: http://www.cluster2.hostgator.co.in/sitemap.xml User-agent: * Disallow: /assets/ Crawl-Delay: 300