radicalwebdesign.co.uk
robots.txt
Robots Exclusion Standard data for radicalwebdesign.co.uk
Resource Scan
Scan Details
Site Domain | radicalwebdesign.co.uk |
Base Domain | radicalwebdesign.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-08T00:06:02+00:00 |
Next Scan | 2024-10-08T00:06:02+00:00 |
Last Scan
Scanned | 2024-09-08T00:06:02+00:00 |
URL | https://radicalwebdesign.co.uk/robots.txt |
Domain IPs | 104.21.88.154, 172.67.223.179, 2606:4700:3031::ac43:dfb3, 2606:4700:3037::6815:589a |
Response IP | 172.67.223.179 |
Found | Yes |
Hash | b16be5d94c13f2d065a7a57deb9a7a85f64f40cde16af20377c9d816d436f6c3 |
SimHash | ee96cc30bea0 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-json/ |
Disallow | /cdn-cgi/bm/cv/ |
Disallow | /cdn-cgi/challenge-platform/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://radicalwebdesign.co.uk/sitemap_index.xml |
Comments