shorturls.co.uk
robots.txt

Robots Exclusion Standard data for shorturls.co.uk

Resource Scan

Scan Details

Site Domain shorturls.co.uk
Base Domain shorturls.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T01:35:57+00:00
Next Scan 2025-12-05T01:35:57+00:00

Last Successful Scan

Scanned2025-10-12T19:35:15+00:00
URL https://shorturls.co.uk/robots.txt
Domain IPs 185.199.220.55
Response IP 185.199.220.55
Found Yes
Hash 89f8e967aba0ed101bc8cfb9eb03efe0eacb697c6eb1e91e9b37a045053635fd
SimHash 4a04d8c3cb12

Groups

*

Rule Path
Allow /
Disallow /go/
Disallow /demo/

Other Records

Field Value
sitemap http://www.shorturls.co.uk/sitemap.xml