denbies.co.uk
robots.txt

Robots Exclusion Standard data for denbies.co.uk

Resource Scan

Scan Details

Site Domain denbies.co.uk
Base Domain denbies.co.uk
Scan Status Ok
Last Scan2025-11-07T01:41:55+00:00
Next Scan 2025-12-07T01:41:55+00:00

Last Scan

Scanned2025-11-07T01:41:55+00:00
URL https://denbies.co.uk/robots.txt
Redirect https://www.denbies.co.uk/robots.txt
Redirect Domain www.denbies.co.uk
Redirect Base denbies.co.uk
Domain IPs 104.21.3.211, 172.67.131.52, 2606:4700:3032::ac43:8334, 2606:4700:3036::6815:3d3
Redirect IPs 104.21.3.211, 172.67.131.52, 2606:4700:3032::ac43:8334, 2606:4700:3036::6815:3d3
Response IP 104.21.3.211
Found Yes
Hash 6989362dfa72671801459450782408cbca174f3635053d5f8eefc02fd4780a2b
SimHash cb094c502f31

Groups

googlebot

Rule Path
Allow *.css*
Allow *.js*

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-content/plugins/
Allow /wp-content/themes/
Allow /wp-content/cache/
Disallow /xmlrpc.php

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap http://www.denbies.co.uk/sitemap.xml

Comments

  • Googlebot
  • Global