curateddomains.co.uk
robots.txt

Robots Exclusion Standard data for curateddomains.co.uk

Resource Scan

Scan Details

Site Domain curateddomains.co.uk
Base Domain curateddomains.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-21T11:22:28+00:00
Next Scan 2025-11-04T11:22:28+00:00

Last Successful Scan

Scanned2025-10-05T19:25:41+00:00
URL https://curateddomains.co.uk/robots.txt
Domain IPs 185.151.30.140, 2a07:7800::140
Response IP 185.151.30.140
Found Yes
Hash 44fb755b8d1496e610116804f8d3abdab8b2d7b3a77270b9e5621b8f981d2aaa
SimHash f911fd014596

Groups

*

Rule Path
Disallow /privacy-policy/
Disallow /terms-and-conditions/
Disallow /domain-sale-terms-and-conditions/