businessvans.co.uk
robots.txt
Robots Exclusion Standard data for businessvans.co.uk
Resource Scan
Scan Details
| Site Domain | businessvans.co.uk |
| Base Domain | businessvans.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-01T11:58:25+00:00 |
| Next Scan | 2024-06-08T11:58:25+00:00 |
Last Scan
| Scanned | 2024-06-01T11:58:25+00:00 |
| URL | https://businessvans.co.uk/robots.txt |
| Domain IPs | 104.26.8.123, 104.26.9.123, 172.67.75.33, 2606:4700:20::681a:87b, 2606:4700:20::681a:97b, 2606:4700:20::ac43:4b21 |
| Response IP | 104.26.9.123 |
| Found | Yes |
| Hash | b46b4e8fa095ddb87cb73b030005da64400c9228dfec33c47483b9f70b3cc1de |
| SimHash | e8095cc8eab2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-login.php |
| Disallow | /wp-admin/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |