thebayshorelife.com
robots.txt

Robots Exclusion Standard data for thebayshorelife.com

Resource Scan

Scan Details

Site Domain thebayshorelife.com
Base Domain thebayshorelife.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-08T21:24:28+00:00
Next Scan 2025-02-06T21:24:28+00:00

Last Successful Scan

Scanned2023-10-14T08:55:53+00:00
URL https://thebayshorelife.com/robots.txt
Domain IPs 104.21.36.95, 172.67.191.198, 2606:4700:3030::ac43:bfc6, 2606:4700:3032::6815:245f
Response IP 172.67.191.198
Found Yes
Hash 2d85295610bb80a81a2e01fdb3da70e99ce42b66d69fe9bea2dba0799bc4780b
SimHash 41601d763792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://thebayshorelife.com/sitemaps-5-sitemap.xml

Comments

  • robots.txt for https://thebayshorelife.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/