charnwoodwebdesign.co.uk
robots.txt

Robots Exclusion Standard data for charnwoodwebdesign.co.uk

Resource Scan

Scan Details

Site Domain charnwoodwebdesign.co.uk
Base Domain charnwoodwebdesign.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-20T00:58:07+00:00
Next Scan 2025-09-21T00:58:07+00:00

Last Successful Scan

Scanned2025-08-21T00:57:53+00:00
URL https://charnwoodwebdesign.co.uk/robots.txt
Domain IPs 185.151.30.140, 2a07:7800::140
Response IP 185.151.30.140
Found Yes
Hash 405b1a0f76fe2bf343f9d41605d8aca715dd39def8bb5e39447e0be345f07865
SimHash 6511dc546515

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://charnwoodwebdesign.co.uk/sitemap_index.xml