bexleygs.co.uk
robots.txt

Robots Exclusion Standard data for bexleygs.co.uk

Resource Scan

Scan Details

Site Domain bexleygs.co.uk
Base Domain bexleygs.co.uk
Scan Status Ok
Last Scan2025-10-25T23:40:15+00:00
Next Scan 2025-11-08T23:40:15+00:00

Last Scan

Scanned2025-10-25T23:40:15+00:00
URL https://bexleygs.co.uk/robots.txt
Redirect https://www.bexleygs.co.uk/robots.txt
Redirect Domain www.bexleygs.co.uk
Redirect Base bexleygs.co.uk
Domain IPs 54.194.24.28
Redirect IPs 18.171.91.41
Response IP 18.171.91.41
Found Yes
Hash 0743c14c12281f2c42f7efe411a7f455e9b91cac649969669b241e0ccf77d3dd
SimHash 6908dc55e613

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bexleygs.co.uk/googlesitemap.asp