approvedroofers.co.uk
robots.txt

Robots Exclusion Standard data for approvedroofers.co.uk

Resource Scan

Scan Details

Site Domain approvedroofers.co.uk
Base Domain approvedroofers.co.uk
Scan Status Ok
Last Scan2024-09-23T11:27:31+00:00
Next Scan 2024-09-30T11:27:31+00:00

Last Scan

Scanned2024-09-23T11:27:31+00:00
URL https://approvedroofers.co.uk/robots.txt
Redirect https://www.approvedroofers.co.uk/robots.txt
Redirect Domain www.approvedroofers.co.uk
Redirect Base approvedroofers.co.uk
Domain IPs 66.147.230.95
Redirect IPs 66.147.230.95
Response IP 66.147.230.95
Found Yes
Hash 15fed602db852564abbce09e87bb3dda5eb2fa447b2ca61c0eca71d4cc836de4
SimHash 6954c455d193

Groups

facebookexternalhit

Rule Path
Disallow /api/
Allow /

*

Rule Path
Disallow /cgi-bin/
Disallow */?s*
Disallow */page/*

Other Records

Field Value
sitemap https://www.approvedroofers.co.uk/sitemap.xml