thepharmacist.co.uk
robots.txt

Robots Exclusion Standard data for thepharmacist.co.uk

Resource Scan

Scan Details

Site Domain thepharmacist.co.uk
Base Domain thepharmacist.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-25T01:39:09+00:00
Next Scan 2024-12-24T01:39:09+00:00

Last Successful Scan

Scanned2024-08-27T01:38:08+00:00
URL https://thepharmacist.co.uk/robots.txt
Domain IPs 104.21.67.38, 172.67.211.245, 2606:4700:3031::ac43:d3f5, 2606:4700:3037::6815:4326
Response IP 172.67.211.245
Found Yes
Hash f21d12fe7a4d21e09b8abf29fe9800cb0c97eb889709d5ba1fca36563f4dceee
SimHash 2951dbd1d611

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

teoma

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.thepharmacist.co.uk/sitemap_index.xml