startours.co.uk
robots.txt
Robots Exclusion Standard data for startours.co.uk
Resource Scan
Scan Details
Site Domain | startours.co.uk |
Base Domain | startours.co.uk |
Scan Status | Ok |
Last Scan | 2024-05-04T00:17:12+00:00 |
Next Scan | 2024-06-03T00:17:12+00:00 |
Last Scan
Scanned | 2024-05-04T00:17:12+00:00 |
URL | https://startours.co.uk/robots.txt |
Domain IPs | 104.21.26.226, 172.67.139.125, 2606:4700:3034::ac43:8b7d, 2606:4700:3037::6815:1ae2 |
Response IP | 104.21.26.226 |
Found | Yes |
Hash | b7bdc1ad5d726062c008073e011783189e74bbc318a196302c6b4db8b7cc9754 |
SimHash | 8ca540a2cbad |
Groups
*
Rule | Path |
---|---|
Disallow | /Areas |
Disallow | /Admin |
Disallow | /bin |
Disallow | /Views |
Disallow | /*.zip |
Disallow | /*.xls |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |