agilityworld.ca
robots.txt

Robots Exclusion Standard data for agilityworld.ca

Resource Scan

Scan Details

Site Domain agilityworld.ca
Base Domain agilityworld.ca
Scan Status Ok
Last Scan2026-02-16T17:18:37+00:00
Next Scan 2026-03-18T17:18:37+00:00

Last Scan

Scanned2026-02-16T17:18:37+00:00
URL https://agilityworld.ca/robots.txt
Redirect https://www.agilityworld.ca/robots.txt
Redirect Domain www.agilityworld.ca
Redirect Base agilityworld.ca
Domain IPs 199.34.228.59
Redirect IPs 199.34.228.59
Response IP 199.34.228.59
Found Yes
Hash 7914b2440a2ef494121b83a324ba86f4250f9e5754f732641cfef59fd706898b
SimHash 6244d8762eb3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /contact-equipment.html
Disallow /jumps--weaves.html
Disallow /crates--trialing.html

Other Records

Field Value
sitemap https://www.agilityworld.ca/sitemap.xml