guttercleaningdirectory.co.uk
robots.txt

Robots Exclusion Standard data for guttercleaningdirectory.co.uk

Resource Scan

Scan Details

Site Domain guttercleaningdirectory.co.uk
Base Domain guttercleaningdirectory.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-27T08:08:10+00:00
Next Scan 2024-10-11T08:08:10+00:00

Last Successful Scan

Scanned2024-09-12T07:02:19+00:00
URL https://guttercleaningdirectory.co.uk/robots.txt
Redirect https://www.guttercleaningdirectory.co.uk/robots.txt
Redirect Domain www.guttercleaningdirectory.co.uk
Redirect Base guttercleaningdirectory.co.uk
Domain IPs 66.147.230.40
Redirect IPs 66.147.230.40
Response IP 66.147.230.40
Found Yes
Hash e88f6b255a6d62afb9f0da4b4998f13c437ffc08eb97734ac9022978fe1d0ef1
SimHash 484cd6955513

Groups

facebookexternalhit

Rule Path
Disallow /api/
Allow /

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

yahoo-slurp

Rule Path
Allow /

slurp

Rule Path
Allow /

sitegurucrawler

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

bing preview bot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.guttercleaningdirectory.co.uk/sitemap.xml