thisisdigital.co.uk
robots.txt

Robots Exclusion Standard data for thisisdigital.co.uk

Resource Scan

Scan Details

Site Domain thisisdigital.co.uk
Base Domain thisisdigital.co.uk
Scan Status Ok
Last Scan2025-10-13T23:19:58+00:00
Next Scan 2025-10-20T23:19:58+00:00

Last Scan

Scanned2025-10-13T23:19:58+00:00
URL https://thisisdigital.co.uk/robots.txt
Domain IPs 64.225.83.76
Response IP 64.225.83.76
Found Yes
Hash 733991e934c3cfa806f38360bd09c6685bec1b2352ee0b34990ce5ceaea0d4ba
SimHash c1501d563792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://thisisdigital.co.uk/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://thisisdigital.co.uk/
  • live - don't allow web crawlers to index cpresources/ or vendor/