streetguide.co.uk
robots.txt

Robots Exclusion Standard data for streetguide.co.uk

Resource Scan

Scan Details

Site Domain streetguide.co.uk
Base Domain streetguide.co.uk
Scan Status Ok
Last Scan2024-11-14T04:45:40+00:00
Next Scan 2024-11-21T04:45:40+00:00

Last Scan

Scanned2024-11-14T04:45:40+00:00
URL https://streetguide.co.uk/robots.txt
Domain IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Response IP 104.26.4.133
Found Yes
Hash d1fe1e4085940db5e93532df7e149a3639f49b0286559d6bcb2b053325ef5c22
SimHash 6801b8c031b7

Groups

*

Rule Path
Disallow /api/*

Other Records

Field Value
sitemap https://streetguide.co.uk/sitemap/sitemap-a.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-b.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-c.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-d.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-e.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-f.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-g.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-h.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-i.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-j.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-k.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-l.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-m.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-n.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-o.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-p.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-r.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-s.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-t.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-v.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-w.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-y.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-z.xml
sitemap https://streetguide.co.uk/sitemap/sitemap-extras.xml