buildarocketboy.com
robots.txt

Robots Exclusion Standard data for buildarocketboy.com

Resource Scan

Scan Details

Site Domain buildarocketboy.com
Base Domain buildarocketboy.com
Scan Status Ok
Last Scan2024-09-22T02:27:21+00:00
Next Scan 2024-10-22T02:27:21+00:00

Last Scan

Scanned2024-09-22T02:27:21+00:00
URL https://buildarocketboy.com/robots.txt
Redirect https://www.buildarocketboy.com/robots.txt
Redirect Domain www.buildarocketboy.com
Redirect Base buildarocketboy.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.142, 76.76.21.98
Response IP 76.76.21.142
Found Yes
Hash 7ba1d4ff3d9cfe6449f2cf1170df6147ac02373c260bb4bdb8cfcff32bd7f940
SimHash 0930cb80e7f1

Groups

*

Rule Path
Disallow /404

*

Rule Path
Allow /

Comments

  • Block all crawlers list
  • Allow all crawlers

Warnings

  • 1 invalid line.