bobsbusiness.co.uk
robots.txt

Robots Exclusion Standard data for bobsbusiness.co.uk

Resource Scan

Scan Details

Site Domain bobsbusiness.co.uk
Base Domain bobsbusiness.co.uk
Scan Status Ok
Last Scan2024-10-24T20:32:45+00:00
Next Scan 2024-11-23T20:32:45+00:00

Last Scan

Scanned2024-10-24T20:32:45+00:00
URL https://bobsbusiness.co.uk/robots.txt
Redirect https://www.bobsbusiness.co.uk/robots.txt
Redirect Domain www.bobsbusiness.co.uk
Redirect Base bobsbusiness.co.uk
Domain IPs 18.155.68.11, 18.155.68.21, 18.155.68.35, 18.155.68.86
Redirect IPs 2600:9000:2200:1000:d:ab30:5740:93a1, 2600:9000:2200:9800:d:ab30:5740:93a1, 2600:9000:2200:b000:d:ab30:5740:93a1, 2600:9000:2200:de00:d:ab30:5740:93a1, 2600:9000:2200:e600:d:ab30:5740:93a1, 2600:9000:2200:ec00:d:ab30:5740:93a1, 2600:9000:2200:f400:d:ab30:5740:93a1, 2600:9000:2200:fa00:d:ab30:5740:93a1, 54.192.18.38, 54.192.18.48, 54.192.18.52, 54.192.18.78
Response IP 18.155.68.21
Found Yes
Hash da2e8e7d8eb3c77799f656799d349311f96be96b9aca966ab56bbeb9ba6601d6
SimHash 41408c7003f3

Groups

*

Rule Path
Allow /
Disallow /landing/*/
Disallow /resources-iso/*/

Other Records

Field Value
sitemap https://www.bobsbusiness.co.uk/sitemap.xml

Warnings

  • `host` is not a known field.