jenwoodhouse.com
robots.txt
Robots Exclusion Standard data for jenwoodhouse.com
Resource Scan
Scan Details
Site Domain | jenwoodhouse.com |
Base Domain | jenwoodhouse.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-02T08:45:23+00:00 |
Next Scan | 2024-12-01T08:45:23+00:00 |
Last Successful Scan
Scanned | 2024-02-06T08:41:07+00:00 |
URL | https://jenwoodhouse.com/robots.txt |
Domain IPs | 104.21.68.56, 172.67.187.190, 2606:4700:3033::6815:4438, 2606:4700:3037::ac43:bbbe |
Response IP | 104.21.68.56 |
Found | Yes |
Hash | 665ba13f45d424d93858daecf708e1d58ee7cbf011bec23ea5c5ea2773237680 |
SimHash | 6d255c49e31b |
Groups
*
Rule | Path |
---|---|
Disallow | /plans/ |
Disallow | /wp-content/uploads/catablog/originals/ |
Disallow | /wp-includes/sodium-compat/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |