yoursiteworth.co.uk
robots.txt

Robots Exclusion Standard data for yoursiteworth.co.uk

Resource Scan

Scan Details

Site Domain yoursiteworth.co.uk
Base Domain yoursiteworth.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/3/2025, 10:14:34 PM
Next Scan 5/3/2025, 10:14:34 PM

Last Successful Scan

Scanned3/5/2025, 10:14:15 PM
URL https://yoursiteworth.co.uk/robots.txt
Domain IPs 216.45.58.2
Response IP 216.45.58.2
Found Yes
Hash 5676ec063cb1c95b58564b363796f392539ea2fd22083a2f137e41d1f268ec90
SimHash 6840d892c211

Groups

*

Rule Path
Disallow /admin/
Disallow /images/
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

teoma

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10