dsp.co.uk
robots.txt
Robots Exclusion Standard data for dsp.co.uk
Resource Scan
Scan Details
Site Domain | dsp.co.uk |
Base Domain | dsp.co.uk |
Scan Status | Ok |
Last Scan | 2025-08-10T18:43:15+00:00 |
Next Scan | 2025-09-09T18:43:15+00:00 |
Last Scan
Scanned | 2025-08-10T18:43:15+00:00 |
URL | https://dsp.co.uk/robots.txt |
Redirect | https://www.dsp.co.uk/robots.txt |
Redirect Domain | www.dsp.co.uk |
Redirect Base | dsp.co.uk |
Domain IPs | 199.60.103.174, 199.60.103.74 |
Redirect IPs | 199.60.103.2, 199.60.103.254, 2606:2c40::c73c:6702, 2606:2c40::c73c:67fe |
Response IP | 199.60.103.2 |
Found | Yes |
Hash | 508e98cda1cbaac101111f47df48a1ceb87bf1296020e059dbe0b9b8720cf538 |
SimHash | 2840ceb1c3b3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /_hcms/preview/ |
Disallow | /hs/manage-preferences/ |
Disallow | /MyFontsWebfontsKit.css |
Disallow | /hs/preferences-center/ |
Disallow | /*?*hs_preview=* |
Disallow | /*?*hsCacheBuster=* |