northstarshoes.com
robots.txt

Robots Exclusion Standard data for northstarshoes.com

Resource Scan

Scan Details

Site Domain northstarshoes.com
Base Domain northstarshoes.com
Scan Status Ok
Last Scan2024-06-28T22:00:21+00:00
Next Scan 2024-07-28T22:00:21+00:00

Last Scan

Scanned2024-06-28T22:00:21+00:00
URL https://northstarshoes.com/robots.txt
Redirect https://www.northstarshoes.com/robots.txt
Redirect Domain www.northstarshoes.com
Redirect Base northstarshoes.com
Domain IPs 2a05:d014:f4d:10b0:4cf7:69ce:106b:d813, 2a05:d014:f4d:10b0:e24e:3fe8:487f:1510, 35.157.152.55, 52.29.197.251
Redirect IPs 23.52.40.34, 23.52.40.41, 2600:1417:3f::b81c:eb59, 2600:1417:3f::b81c:eb5b
Response IP 23.59.168.178
Found Yes
Hash 17a217fe06c1f2c4c1fad6703f1164189bde3ac87af342bd42e75126e38d3f42
SimHash 651cd446c735

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Warnings

  • `request-rate` is not a known field.