corporatesdb.com
robots.txt

Robots Exclusion Standard data for corporatesdb.com

Resource Scan

Scan Details

Site Domain corporatesdb.com
Base Domain corporatesdb.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-14T09:09:59+00:00
Next Scan 2025-02-12T09:09:59+00:00

Last Successful Scan

Scanned2023-10-21T18:38:34+00:00
URL https://corporatesdb.com/robots.txt
Domain IPs 104.21.12.100, 172.67.152.21, 2606:4700:3031::6815:c64, 2606:4700:3035::ac43:9815
Response IP 104.21.12.100
Found Yes
Hash 85d883ce7b10c535e44b3c827f39a777a928589a4e8efb2016061fb6b32d3a9d
SimHash 6314f042e734

Groups

*

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449