heavensbest.com
robots.txt

Robots Exclusion Standard data for heavensbest.com

Resource Scan

Scan Details

Site Domain heavensbest.com
Base Domain heavensbest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-17T03:40:27+00:00
Next Scan 2026-05-18T03:40:27+00:00

Last Successful Scan

Scanned2024-01-07T00:03:40+00:00
URL https://heavensbest.com/robots.txt
Redirect https://www.heavensbest.com/robots.txt
Redirect Domain www.heavensbest.com
Redirect Base heavensbest.com
Domain IPs 104.21.24.64, 172.67.217.81, 2606:4700:3031::ac43:d951, 2606:4700:3035::6815:1840
Redirect IPs 104.21.24.64, 172.67.217.81, 2606:4700:3031::ac43:d951, 2606:4700:3035::6815:1840
Response IP 172.67.217.81
Found Yes
Hash 7367b9f936c9e4303442b7c4e889f6b75557fa37ee8c3da01344c5131d58b0cc
SimHash fa1568928901

Groups

*

Rule Path
Disallow /admin/
Disallow /ctrl/

comodospider/nutch-1.0

Rule Path
Disallow /

Comments

  • shiny rocks !!!
  • https://www.youtube.com/watch?v=SbNLqVCAG5s
  • http://www.youtube.com/watch?v=hmVJ7mqOOdU