thameswater.co.uk
robots.txt

Robots Exclusion Standard data for thameswater.co.uk

Resource Scan

Scan Details

Site Domain thameswater.co.uk
Base Domain thameswater.co.uk
Scan Status Ok
Last Scan2024-09-12T01:22:52+00:00
Next Scan 2024-10-12T01:22:52+00:00

Last Scan

Scanned2024-09-12T01:22:52+00:00
URL https://www.thameswater.co.uk/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 8b449ad379ddadc30512e2902f30213d4627bcd014c29c2a0ce09c209d1160db
SimHash 0848ea624770

Groups

*

Rule Path
Allow /
Disallow /leak/api/
Disallow /sitecore/
Disallow /dist/
Disallow /config
Disallow /health/

Comments

  • Generating robots.txt for host: www.thameswater.co.uk