leeroy.ca
robots.txt

Robots Exclusion Standard data for leeroy.ca

Resource Scan

Scan Details

Site Domain leeroy.ca
Base Domain leeroy.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-23T19:34:30+00:00
Next Scan 2025-11-21T19:34:30+00:00

Last Successful Scan

Scanned2024-07-07T10:32:20+00:00
URL https://leeroy.ca/robots.txt
Redirect https://www.leeroy.ca/robots.txt
Redirect Domain www.leeroy.ca
Redirect Base leeroy.ca
Domain IPs 18.161.97.108, 18.161.97.22, 18.161.97.28, 18.161.97.70, 2600:9000:238d:1000:1f:902:5980:93a1, 2600:9000:238d:1200:1f:902:5980:93a1, 2600:9000:238d:4e00:1f:902:5980:93a1, 2600:9000:238d:5600:1f:902:5980:93a1, 2600:9000:238d:7600:1f:902:5980:93a1, 2600:9000:238d:aa00:1f:902:5980:93a1, 2600:9000:238d:d400:1f:902:5980:93a1, 2600:9000:238d:e000:1f:902:5980:93a1
Redirect IPs 18.66.218.100, 18.66.218.121, 18.66.218.26, 18.66.218.46, 2600:9000:23d0:1a00:1f:902:5980:93a1, 2600:9000:23d0:4e00:1f:902:5980:93a1, 2600:9000:23d0:5200:1f:902:5980:93a1, 2600:9000:23d0:7600:1f:902:5980:93a1, 2600:9000:23d0:9400:1f:902:5980:93a1, 2600:9000:23d0:b400:1f:902:5980:93a1, 2600:9000:23d0:e00:1f:902:5980:93a1, 2600:9000:23d0:fe00:1f:902:5980:93a1
Response IP 18.165.171.126
Found Yes
Hash f4721e1baa7a71eb7fd4c26ad386dfa15a3f4ea8286b131b075bbf6402e87baa
SimHash 632a197625b2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.leeroy.ca/en/sitemaps-1-sitemap.xml
sitemap https://www.leeroy.ca/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.leeroy.ca/
  • live - don't allow web crawlers to index cpresources/ or vendor/