# vestacp autogenerated robots.txt User-agent: * Crawl-delay: 10 User-agent: * Disallow: / User-agent: Bingbot User-agent: Googlebot User-agent: Slurp Allow: / Sitemap: http://mrifarabi.com/sitemap.xml