understandingstandards.org.uk
robots.txt

Robots Exclusion Standard data for understandingstandards.org.uk

Resource Scan

Scan Details

Site Domain understandingstandards.org.uk
Base Domain understandingstandards.org.uk
Scan Status Ok
Last Scan2025-08-27T04:59:24+00:00
Next Scan 2025-09-10T04:59:24+00:00

Last Scan

Scanned2025-08-27T04:59:24+00:00
URL https://understandingstandards.org.uk/robots.txt
Domain IPs 80.75.66.219
Response IP 80.75.66.219
Found Yes
Hash 0f4791b7e11c953ac4571f298e80c5362eb6e2fe5d87ef9fee9b8c3cc60becc0
SimHash b4916a48cff2

Groups

*

Rule Path
Disallow /test/
Disallow /assets/
Disallow /Forgotten/
Disallow /Contact-US/

Comments

  • robots.txt for our home directory
  • to disallow all (*) robots from searching certain areas