Sitemap: https://intstaffing.net/robots.txt User-agent: * Crawl-Delay: 20 User-agent: Semrushbot-SA Allow: / User-agent: Semrushbot-SI Allow: / Disallow: /category/ Disallow: /tag/ Disallow: /author/