canadabiz.net
robots.txt

Robots Exclusion Standard data for canadabiz.net

Resource Scan

Scan Details

Site Domain canadabiz.net
Base Domain canadabiz.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-23T03:28:50+00:00
Next Scan 2024-12-22T03:28:50+00:00

Last Successful Scan

Scanned2022-12-02T13:08:52+00:00
URL https://canadabiz.net/robots.txt
Redirect https://www.canadabiz.net/robots.txt
Redirect Domain www.canadabiz.net
Redirect Base canadabiz.net
Domain IPs 94.23.208.201
Redirect IPs 94.23.208.201
Response IP 94.23.208.201
Found Yes
Hash 40537f05803728185f1aa5f072fc6bcbc3d53627ff874a9af4d6ff6c074363f5
SimHash d05dc2604733

Groups

*

Rule Path
Allow /

magpie-crawler

Rule Path
Disallow /

wikido

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

exabot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

xenu

Rule Path
Disallow /