rowleydownload.co.uk
robots.txt
Robots Exclusion Standard data for rowleydownload.co.uk
Resource Scan
Scan Details
| Site Domain | rowleydownload.co.uk |
| Base Domain | rowleydownload.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-16T06:19:36+00:00 |
| Next Scan | 2024-10-16T06:19:36+00:00 |
Last Scan
| Scanned | 2024-09-16T06:19:36+00:00 |
| URL | https://rowleydownload.co.uk/robots.txt |
| Domain IPs | 13.33.88.121, 13.33.88.48, 13.33.88.71, 13.33.88.97 |
| Response IP | 13.33.88.97 |
| Found | Yes |
| Hash | e2ed6201862f276e314ed963fd1ad4d555c226a4221554cc4910e495cd184f06 |
| SimHash | e8295e420f93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blog |
| Disallow | /tmp |
| Disallow | /nocrawl |
| Disallow | /analytics |
| Disallow | /documentation |
| Disallow | /documentation.latest |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.rowleydownload.co.uk/sitemap.xml.gz |