Log In Sign Up

calgarydirect.info
robots.txt

Robots Exclusion Standard data for calgarydirect.info

Resource Scan

Scan Details

Site Domain calgarydirect.info
Base Domain calgarydirect.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-30T18:20:26+00:00
Next Scan 2025-12-07T18:20:26+00:00

Last Successful Scan

Scanned2025-11-22T18:19:46+00:00
URL https://calgarydirect.info/robots.txt
Domain IPs 104.21.26.105, 172.67.135.222, 2606:4700:3032::6815:1a69, 2606:4700:3035::ac43:87de
Response IP 104.21.26.105
Found Yes
Hash 6580bfefec23133c4fd924213c1703f741b9e29d1d109ddfb8bd130fd46a4131
SimHash 2d6152a244f5

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

bingpreview

Rule Path
Allow /

adidxbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

facebookbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookexternalhit/1.0

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookcatalog

Rule Path
Allow /

facebookcatalog/1.0

Rule Path
Allow /

meta-externalfetcher

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

gptbot

Rule Path
Allow /

anthropic ai bot

Rule Path
Allow /

perplexity ai bot

Rule Path
Allow /

deepseek

Rule Path
Allow /

gemini

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top