benfleetdentalcentre.com
robots.txt

Robots Exclusion Standard data for benfleetdentalcentre.com

Resource Scan

Scan Details

Site Domain benfleetdentalcentre.com
Base Domain benfleetdentalcentre.com
Scan Status Ok
Last Scan2026-03-19T20:43:20+00:00
Next Scan 2026-03-26T20:43:20+00:00

Last Scan

Scanned2026-03-19T20:43:20+00:00
URL https://benfleetdentalcentre.com/robots.txt
Domain IPs 104.21.67.71, 172.67.217.129, 2606:4700:3030::6815:4347, 2606:4700:3032::ac43:d981
Response IP 104.21.67.71
Found Yes
Hash e1f8c4d7874bc32bf9313db16ce15e77b14f33b1d08d2464f8f2450260b92efa
SimHash e3281d523711

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://benfleetdentalcentre.com/sitemaps-4-sitemap.xml

Comments

  • robots.txt for https://benfleetdentalcentre.com/
  • default - don't allow web crawlers to index cpresources/ or vendor/