carpentersgroup.co.uk
robots.txt

Robots Exclusion Standard data for carpentersgroup.co.uk

Resource Scan

Scan Details

Site Domain carpentersgroup.co.uk
Base Domain carpentersgroup.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-08-18T04:15:20+00:00
Next Scan 2024-10-17T04:15:20+00:00

Last Successful Scan

Scanned2024-05-28T03:50:59+00:00
URL https://carpentersgroup.co.uk/robots.txt
Redirect https://www.carpentersgroup.co.uk/robots.txt
Redirect Domain www.carpentersgroup.co.uk
Redirect Base carpentersgroup.co.uk
Domain IPs 51.132.213.11
Redirect IPs 51.132.213.11
Response IP 51.132.213.11
Found Yes
Hash 319699ab00391234936353a0da94855c35a0aa6f474cb16be19b409feebcaf48
SimHash 230e5806cf10

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/
Disallow /app_plugins/
Disallow /usync/

ninjabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.carpentersgroup.co.uk/sitemap.xml