hwb.gov.wales
robots.txt

Robots Exclusion Standard data for hwb.gov.wales

Resource Scan

Scan Details

Site Domain hwb.gov.wales
Base Domain gov.wales
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T19:42:41+00:00
Next Scan 2024-12-06T19:42:41+00:00

Last Successful Scan

Scanned2024-04-18T18:49:42+00:00
URL https://hwb.gov.wales/robots.txt
Domain IPs 18.161.97.16, 18.161.97.22, 18.161.97.63, 18.161.97.93
Response IP 18.165.171.36
Found Yes
Hash 44f3f8eafdf064cf69acb05f23ee4dfc9ab5b3d67d81c64246bc29f7e438789a
SimHash 4150c1524731

Groups

*

Rule Path
Allow /