craftboxes.co.uk
robots.txt

Robots Exclusion Standard data for craftboxes.co.uk

Resource Scan

Scan Details

Site Domain craftboxes.co.uk
Base Domain craftboxes.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-15T12:36:05+00:00
Next Scan 2025-07-14T12:36:05+00:00

Last Successful Scan

Scanned2024-02-28T08:58:27+00:00
URL https://craftboxes.co.uk/robots.txt
Domain IPs 104.21.89.63, 172.67.156.226, 2606:4700:3030::6815:593f, 2606:4700:3035::ac43:9ce2
Response IP 104.21.89.63
Found Yes
Hash fba6cfd60df1f13b6839c314a8b4cb0a6a9d9e0a52da43c1b2b46ddad3beab2f
SimHash 610043408d92

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /forms/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://craftboxes.co.uk/sitemap_index.xml