web-hosting.ca
robots.txt

Robots Exclusion Standard data for web-hosting.ca

Resource Scan

Scan Details

Site Domain web-hosting.ca
Base Domain web-hosting.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-18T19:56:57+00:00
Next Scan 2025-12-17T19:56:57+00:00

Last Successful Scan

Scanned2024-10-31T18:32:17+00:00
URL https://web-hosting.ca/robots.txt
Domain IPs 104.21.74.226, 172.67.164.14, 2606:4700:3035::ac43:a40e, 2606:4700:3036::6815:4ae2
Response IP 104.21.74.226
Found Yes
Hash 86c0544840b6d0e792156794a9b4248b12d8364e24a95125f4adf916f13b0df7
SimHash ef7af8a7ebfb

Groups

*

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /stats/

emailsiphon

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

the informant

Rule Path
Disallow /

netzip-downloader

Rule Path
Disallow /

net vampire

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

reget

Rule Path
Disallow /