Log In Sign Up

bellwaylondon.co.uk
robots.txt

Robots Exclusion Standard data for bellwaylondon.co.uk

Resource Scan

Scan Details

Site Domain bellwaylondon.co.uk
Base Domain bellwaylondon.co.uk
Scan Status Ok
Last Scan2024-05-28T14:27:06+00:00
Next Scan 2024-06-04T14:27:06+00:00

Last Scan

Scanned2024-05-28T14:27:06+00:00
URL https://bellwaylondon.co.uk/robots.txt
Redirect https://www.bellwaylondon.co.uk/robots.txt
Redirect Domain www.bellwaylondon.co.uk
Redirect Base bellwaylondon.co.uk
Domain IPs 108.139.10.107, 108.139.10.45, 108.139.10.69, 108.139.10.95, 2600:9000:26ca:2c00:c:f09:ba00:93a1, 2600:9000:26ca:3c00:c:f09:ba00:93a1, 2600:9000:26ca:800:c:f09:ba00:93a1, 2600:9000:26ca:9400:c:f09:ba00:93a1, 2600:9000:26ca:9a00:c:f09:ba00:93a1, 2600:9000:26ca:d600:c:f09:ba00:93a1, 2600:9000:26ca:de00:c:f09:ba00:93a1, 2600:9000:26ca:e200:c:f09:ba00:93a1
Redirect IPs 13.226.2.114, 13.226.2.43, 13.226.2.45, 13.226.2.6, 2600:9000:21f8:2600:c:f09:ba00:93a1, 2600:9000:21f8:3200:c:f09:ba00:93a1, 2600:9000:21f8:3800:c:f09:ba00:93a1, 2600:9000:21f8:5800:c:f09:ba00:93a1, 2600:9000:21f8:6600:c:f09:ba00:93a1, 2600:9000:21f8:7200:c:f09:ba00:93a1, 2600:9000:21f8:de00:c:f09:ba00:93a1, 2600:9000:21f8:f400:c:f09:ba00:93a1
Response IP 108.157.60.15
Found Yes
Hash 18d0887ede802c0ad4d0f4a599f032ec037ca2636da75f75874aaeff22d1a69c
SimHash 63501d762d13

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Back to top

Other Records

Field Value
sitemap https://www.bellwaylondon.co.uk/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.bellwaylondon.co.uk/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top