motorhype.co.uk
robots.txt
Robots Exclusion Standard data for motorhype.co.uk
Resource Scan
Scan Details
| Site Domain | motorhype.co.uk |
| Base Domain | motorhype.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-24T06:35:33+00:00 |
| Next Scan | 2024-10-01T06:35:33+00:00 |
Last Scan
| Scanned | 2024-09-24T06:35:33+00:00 |
| URL | https://motorhype.co.uk/robots.txt |
| Domain IPs | 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c |
| Response IP | 104.16.150.108 |
| Found | Yes |
| Hash | d149696d3015059f7cd9fa9a38e6d081d440e2481031c587980b59dd4f5a681c |
| SimHash | ee77c820fc90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-json/ |
| Disallow | /?rest_route=%2F |
| Disallow | /?s=* |
| Disallow | /search/* |
| Disallow | /page/*/?s=* |
| Disallow | /cdn-cgi/bm/cv/ |
| Disallow | /cdn-cgi/challenge-platform/ |
*
| Rule | Path |
|---|---|
| Disallow | /refer/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.motorhype.co.uk/sitemap_index.xml |
| sitemap | https://www.motorhype.co.uk/news-sitemap.xml |
| sitemap | https://www.motorhype.co.uk/forums/sitemap.xml |
Comments