vanseawall.ca
robots.txt

Robots Exclusion Standard data for vanseawall.ca

Resource Scan

Scan Details

Site Domain vanseawall.ca
Base Domain vanseawall.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-19T03:08:12+00:00
Next Scan 2025-07-03T03:08:12+00:00

Last Successful Scan

Scanned2025-06-04T03:03:35+00:00
URL https://vanseawall.ca/robots.txt
Domain IPs 104.152.168.31
Response IP 104.152.168.31
Found Yes
Hash 318edadb73a7e508a076f3f5ae2e13651fcc83c1fce4bce4e07c4ca187ff69ca
SimHash 883caa286e83

Groups

*

Rule Path
Disallow /cgi-bin/

sbider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /iklan/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mozilla/5.0 (compatible;contxbot/1.0)

Rule Path
Disallow