buildarocketboy.com
robots.txt

Robots Exclusion Standard data for buildarocketboy.com

Resource Scan

Scan Details

Site Domain buildarocketboy.com
Base Domain buildarocketboy.com
Scan Status Ok
Last Scan2024-10-22T02:27:30+00:00
Next Scan 2024-11-21T02:27:30+00:00

Last Scan

Scanned2024-10-22T02:27:30+00:00
URL https://buildarocketboy.com/robots.txt
Domain IPs 18.155.68.25, 18.155.68.35, 18.155.68.52, 18.155.68.9, 2600:9000:23d2:1e00:1:cc77:11c0:93a1, 2600:9000:23d2:2e00:1:cc77:11c0:93a1, 2600:9000:23d2:3600:1:cc77:11c0:93a1, 2600:9000:23d2:4000:1:cc77:11c0:93a1, 2600:9000:23d2:6e00:1:cc77:11c0:93a1, 2600:9000:23d2:7000:1:cc77:11c0:93a1, 2600:9000:23d2:8200:1:cc77:11c0:93a1, 2600:9000:23d2:9800:1:cc77:11c0:93a1
Response IP 18.155.68.25
Found Yes
Hash 7ba1d4ff3d9cfe6449f2cf1170df6147ac02373c260bb4bdb8cfcff32bd7f940
SimHash 0930cb80e7f1

Groups

*

Rule Path
Disallow /404

*

Rule Path
Allow /

Comments

  • Block all crawlers list
  • Allow all crawlers

Warnings

  • 1 invalid line.