for.herospark.co
robots.txt

Robots Exclusion Standard data for for.herospark.co

Resource Scan

Scan Details

Site Domain for.herospark.co
Base Domain herospark.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-20T18:48:38+00:00
Next Scan 2025-10-19T18:48:38+00:00

Last Successful Scan

Scanned2025-05-27T22:26:17+00:00
URL https://for.herospark.co/robots.txt
Domain IPs 104.26.6.185, 104.26.7.185, 172.67.75.123, 2606:4700:20::681a:6b9, 2606:4700:20::681a:7b9, 2606:4700:20::ac43:4b7b
Response IP 104.26.7.185
Found Yes
Hash 0244a28e08b53072581cce41cc61d6117a67d602120a27b3d6ed3e39d8ba8b70
SimHash b2850d8f7170

Groups

mj12bot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: