healthclubmanagement.co.uk
robots.txt
Robots Exclusion Standard data for healthclubmanagement.co.uk
Resource Scan
Scan Details
Site Domain | healthclubmanagement.co.uk |
Base Domain | healthclubmanagement.co.uk |
Scan Status | Ok |
Last Scan | 2024-10-25T01:18:08+00:00 |
Next Scan | 2024-11-24T01:18:08+00:00 |
Last Scan
Scanned | 2024-10-25T01:18:08+00:00 |
URL | https://healthclubmanagement.co.uk/robots.txt |
Redirect | https://www.healthclubmanagement.co.uk/robots.txt |
Redirect Domain | www.healthclubmanagement.co.uk |
Redirect Base | healthclubmanagement.co.uk |
Domain IPs | 104.21.75.65, 172.67.215.184, 2606:4700:3033::6815:4b41, 2606:4700:3033::ac43:d7b8 |
Redirect IPs | 104.21.75.65, 172.67.215.184, 2606:4700:3033::6815:4b41, 2606:4700:3033::ac43:d7b8 |
Response IP | 172.67.215.184 |
Found | Yes |
Hash | e4dc29e402988f03b7c52f981938aad3156fe9c62be9cc7e4c76e4e030c14b27 |
SimHash | 521dc472e093 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
- `user agent` is not a known field.