styleseeker.com.au
robots.txt
Robots Exclusion Standard data for styleseeker.com.au
Resource Scan
Scan Details
Site Domain | styleseeker.com.au |
Base Domain | styleseeker.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-22T12:41:50+00:00 |
Next Scan | 2024-11-20T12:41:50+00:00 |
Last Successful Scan
Scanned | 2024-04-02T12:27:04+00:00 |
URL | https://styleseeker.com.au/robots.txt |
Domain IPs | 104.21.53.65, 172.67.209.169, 2606:4700:3033::ac43:d1a9, 2606:4700:3037::6815:3541 |
Response IP | 172.67.209.169 |
Found | Yes |
Hash | 1605e97f258fcd5d9d322f2b6e978b5f4b7c0d1bc5e296d126883170324a4aa8 |
SimHash | 10584440987a |
Groups
*
Rule | Path |
---|---|
Disallow | /_wp/ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Warnings
- 2 invalid lines.
Comments