Log In Sign Up

intact.ca
robots.txt

Robots Exclusion Standard data for intact.ca

Resource Scan

Scan Details

Site Domain intact.ca
Base Domain intact.ca
Scan Status Ok
Last Scan2024-06-13T03:11:50+00:00
Next Scan 2024-07-13T03:11:50+00:00

Last Scan

Scanned2024-06-13T03:11:50+00:00
URL https://www.intact.ca/robots.txt
Domain IPs 2600:9000:2024:4800:14:3522:84c0:93a1, 2600:9000:2024:4c00:14:3522:84c0:93a1, 2600:9000:2024:5000:14:3522:84c0:93a1, 2600:9000:2024:5600:14:3522:84c0:93a1, 2600:9000:2024:6c00:14:3522:84c0:93a1, 2600:9000:2024:9000:14:3522:84c0:93a1, 2600:9000:2024:c000:14:3522:84c0:93a1, 2600:9000:2024:c00:14:3522:84c0:93a1, 65.8.161.11, 65.8.161.124, 65.8.161.13, 65.8.161.87
Response IP 3.160.246.120
Found Yes
Hash ff30e6ed005010201439995b8b3e838be62ec07b29e65269e1d114a972394580
SimHash e17c19024777

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

siteauditbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.intact.ca/sitemaps-1-sitemap.xml
sitemap https://www.intact.ca/sitemaps-1-sitemap.xml
sitemap https://www.intact.ca/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.intact.ca/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site
  • Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site
Back to top