bobsbusiness.co.uk
robots.txt

Robots Exclusion Standard data for bobsbusiness.co.uk

Resource Scan

Scan Details

Site Domain bobsbusiness.co.uk
Base Domain bobsbusiness.co.uk
Scan Status Ok
Last Scan2024-08-25T20:32:23+00:00
Next Scan 2024-09-24T20:32:23+00:00

Last Scan

Scanned2024-08-25T20:32:23+00:00
URL https://bobsbusiness.co.uk/robots.txt
Redirect https://www.bobsbusiness.co.uk/robots.txt
Redirect Domain www.bobsbusiness.co.uk
Redirect Base bobsbusiness.co.uk
Domain IPs 52.84.229.103, 52.84.229.28, 52.84.229.4, 52.84.229.96
Redirect IPs 2600:9000:2003:a00:d:ab30:5740:93a1, 2600:9000:2003:aa00:d:ab30:5740:93a1, 2600:9000:2003:ac00:d:ab30:5740:93a1, 2600:9000:2003:b600:d:ab30:5740:93a1, 2600:9000:2003:c400:d:ab30:5740:93a1, 2600:9000:2003:c800:d:ab30:5740:93a1, 2600:9000:2003:de00:d:ab30:5740:93a1, 2600:9000:2003:f200:d:ab30:5740:93a1, 52.84.229.103, 52.84.229.28, 52.84.229.4, 52.84.229.96
Response IP 52.84.229.28
Found Yes
Hash da2e8e7d8eb3c77799f656799d349311f96be96b9aca966ab56bbeb9ba6601d6
SimHash 41408c7003f3

Groups

*

Rule Path
Allow /
Disallow /landing/*/
Disallow /resources-iso/*/

Other Records

Field Value
sitemap https://www.bobsbusiness.co.uk/sitemap.xml

Warnings

  • `host` is not a known field.