shadestation.co.uk
robots.txt

Robots Exclusion Standard data for shadestation.co.uk

Resource Scan

Scan Details

Site Domain shadestation.co.uk
Base Domain shadestation.co.uk
Scan Status Ok
Last Scan2024-09-30T07:03:08+00:00
Next Scan 2024-10-30T07:03:08+00:00

Last Scan

Scanned2024-09-30T07:03:08+00:00
URL https://shadestation.co.uk/robots.txt
Redirect https://www.shadestation.co.uk/robots.txt
Redirect Domain www.shadestation.co.uk
Redirect Base shadestation.co.uk
Domain IPs 104.22.42.155, 104.22.43.155, 172.67.28.175, 2606:4700:10::6816:2a9b, 2606:4700:10::6816:2b9b, 2606:4700:10::ac43:1caf
Redirect IPs 104.22.42.155, 104.22.43.155, 172.67.28.175, 2606:4700:10::6816:2a9b, 2606:4700:10::6816:2b9b, 2606:4700:10::ac43:1caf
Response IP 104.22.42.155
Found Yes
Hash a7345e91ba820d8d56bab7d8a91f97f9624c98f204de72ca271d7dc612c08265
SimHash 65055c05a7b3

Groups

*

Rule Path
Disallow /admin
Disallow /newprescriptionajax.php
Disallow /style-blog/wp-admin
Disallow /style-blog/wp-includes

Other Records

Field Value
crawl-delay 5

bingbot
baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image

Rule Path
Disallow /admin
Disallow /newprescriptionajax.php
Disallow /style-blog/wp-admin
Disallow /style-blog/wp-includes

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.shadestation.co.uk/feeds/sitemap_shade_1.xml

Comments

  • Robots.txt file from http://www.shadestation.co.uk/robots.txt