imgbox.com
robots.txt

Robots Exclusion Standard data for imgbox.com

Resource Scan

Scan Details

Site Domain imgbox.com
Base Domain imgbox.com
Scan Status Ok
Last Scan2024-11-09T16:24:47+00:00
Next Scan 2024-11-16T16:24:47+00:00

Last Scan

Scanned2024-11-09T16:24:47+00:00
URL https://imgbox.com/robots.txt
Domain IPs 212.63.223.235, 212.63.223.236
Response IP 212.63.223.236
Found Yes
Hash 76e20ae027ea9e0fe8f62bd64aff4b7586eaceac691b2a62a912b6e5c31a35b0
SimHash a68d0d8d6570

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /