thetechrobo.ca
robots.txt

Robots Exclusion Standard data for thetechrobo.ca

Resource Scan

Scan Details

Site Domain thetechrobo.ca
Base Domain thetechrobo.ca
Scan Status Ok
Last Scan2026-03-02T03:10:41+00:00
Next Scan 2026-03-16T03:10:41+00:00

Last Scan

Scanned2026-03-02T03:10:41+00:00
URL https://thetechrobo.ca/robots.txt
Domain IPs 104.21.21.139, 172.67.199.25, 2606:4700:3036::ac43:c719, 2606:4700:3037::6815:158b
Response IP 172.67.199.25
Found Yes
Hash 2aa899e97a3a70f4f0c0e9fd525a85a5a60b1ce85f6c552aab11c02b2604a3f4
SimHash 6920dc62c391

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4