baywoodgreens.com
robots.txt

Robots Exclusion Standard data for baywoodgreens.com

Resource Scan

Scan Details

Site Domain baywoodgreens.com
Base Domain baywoodgreens.com
Scan Status Ok
Last Scan2025-03-17T20:42:43+00:00
Next Scan 2025-04-16T20:42:43+00:00

Last Scan

Scanned2025-03-17T20:42:43+00:00
URL https://www.baywoodgreens.com/robots.txt
Domain IPs 104.21.42.138, 172.67.206.29, 2606:4700:3030::ac43:ce1d, 2606:4700:3037::6815:2a8a
Response IP 172.67.206.29
Found Yes
Hash 878846fea672ba1cd9949cdd9fa7b30c919209e5160c9753bf667447527532c4
SimHash 4c411ac44ff1

Groups

*

Rule Path
Disallow /README.md
Disallow /README.txt
Disallow /admin/
Disallow /node/
Disallow /account/user/
Disallow /account/
Disallow /account/register/
Disallow /account/password/
Disallow /account/login/
Disallow /account/logout/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.baywoodgreens.com/sitemap.xml

Comments

  • robots.txt Potnets
  • Files
  • Paths (clean URLs)
  • Block all crawlers for /account
  • Allow all crawlers