shastalake.com
robots.txt

Robots Exclusion Standard data for shastalake.com

Resource Scan

Scan Details

Site Domain shastalake.com
Base Domain shastalake.com
Scan Status Ok
Last Scan2025-09-25T08:45:07+00:00
Next Scan 2025-10-02T08:45:07+00:00

Last Scan

Scanned2025-09-25T08:45:07+00:00
URL http://shastalake.com/robots.txt
Domain IPs 160.153.91.2
Response IP 160.153.91.2
Found Yes
Hash 90c24d3c136a52eec11f3dcba1018b10ee37a6aa5d4b1e157b28398ae0992c43
SimHash 2956d3015191

Groups

google

Rule Path
Disallow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

mediapartners (googlebot)

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

googlebot-video (googlebot)

Rule Path
Disallow

yahoo! slurp

Rule Path
Disallow

slurp

Rule Path
Disallow

bingbot

Rule Path
Disallow

bing

Rule Path
Disallow

msnbot

Rule Path
Disallow

*

Rule Path
Disallow /