Log In Sign Up

planetspirit.com
robots.txt

Robots Exclusion Standard data for planetspirit.com

Resource Scan

Scan Details

Site Domain planetspirit.com
Base Domain planetspirit.com
Scan Status Ok
Last Scan2025-08-26T20:31:46+00:00
Next Scan 2025-09-09T20:31:46+00:00

Last Scan

Scanned2025-08-26T20:31:46+00:00
URL https://planetspirit.com/robots.txt
Redirect https://www.planetspirit.com/robots.txt
Redirect Domain www.planetspirit.com
Redirect Base planetspirit.com
Domain IPs 104.16.71.48, 104.16.72.48
Redirect IPs 104.16.71.48, 104.16.72.48
Response IP 104.16.72.48
Found Yes
Hash 35a43f88b9930c6559503cc7f75d45c791a676391f169b2443a63920d7d71fe7
SimHash 8dd3d421f5d1

Groups

*

Rule Path
Disallow /

mediapartners-google
google-display-ads-bot
adsbot-google-mobile
googlebot
bingbot
slurp
duckduckbot
yandexbot
facebot
applebot

Rule Path
Disallow /*-del
Back to top

Comments

  • This robots.txt file disallows all engines/crawlers/indexers by default.
  • Global directives, but not always obeyed.
  • Named directive(s) specifically disallowing the most common engines/crawlers/indexers.
  • Prevent the indexing of any sites that are no longer active but still accessible online.
Back to top