stf.sk.ca
robots.txt

Robots Exclusion Standard data for stf.sk.ca

Resource Scan

Scan Details

Site Domain stf.sk.ca
Base Domain stf.sk.ca
Scan Status Ok
Last Scan2025-10-06T00:05:48+00:00
Next Scan 2025-11-05T00:05:48+00:00

Last Scan

Scanned2025-10-06T00:05:48+00:00
URL https://stf.sk.ca/robots.txt
Domain IPs 104.21.42.97, 172.67.160.175, 2606:4700:3032::6815:2a61, 2606:4700:3037::ac43:a0af
Response IP 104.21.42.97
Found Yes
Hash ff8e561e4d3874dc46e107e0fd021e0635c0f07d664890a972dccff76887866b
SimHash 73891c44e532

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /forms-and-publications
Disallow /professional-resources/events-calendar
Disallow /product/

Comments

  • Optionally disallow some other common WordPress paths:
  • Disallow: /wp-includes/
  • Disallow: /wp-content/plugins/
  • Disallow: /wp-content/themes/
  • Disallow search results to be indexed
  • Sitemaps can also be specified, which is good for SEO
  • Sitemap: https://yourdomain.com/sitemap_index.xml