dayoutwiththekids.co.uk
robots.txt

Robots Exclusion Standard data for dayoutwiththekids.co.uk

Resource Scan

Scan Details

Site Domain dayoutwiththekids.co.uk
Base Domain dayoutwiththekids.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T03:23:14+00:00
Next Scan 2024-12-06T03:23:14+00:00

Last Successful Scan

Scanned2024-05-11T02:54:22+00:00
URL https://dayoutwiththekids.co.uk/robots.txt
Redirect https://www.dayoutwiththekids.co.uk/robots.txt
Redirect Domain www.dayoutwiththekids.co.uk
Redirect Base dayoutwiththekids.co.uk
Domain IPs 104.22.76.198, 104.22.77.198, 172.67.15.87, 2606:4700:10::6816:4cc6, 2606:4700:10::6816:4dc6, 2606:4700:10::ac43:f57
Redirect IPs 104.22.76.198, 104.22.77.198, 172.67.15.87, 2606:4700:10::6816:4cc6, 2606:4700:10::6816:4dc6, 2606:4700:10::ac43:f57
Response IP 104.22.77.198
Found Yes
Hash 57aa35a2b10798956ba49c538a93314b49b971723c2af64c9017938e30f025a8
SimHash 2f2ddcf46311

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /account/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /things-to-do?keyword*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.dayoutwiththekids.co.uk/sitemapindex.xml
sitemap https://dayoutwiththekids.co.uk/sitemap.xml