originalbotanica.com
robots.txt

Robots Exclusion Standard data for originalbotanica.com

Resource Scan

Scan Details

Site Domain originalbotanica.com
Base Domain originalbotanica.com
Scan Status Ok
Last Scan2024-06-09T07:51:43+00:00
Next Scan 2024-06-16T07:51:43+00:00

Last Scan

Scanned2024-06-09T07:51:43+00:00
URL https://originalbotanica.com/robots.txt
Domain IPs 104.26.10.204, 104.26.11.204, 172.67.68.47, 2606:4700:20::681a:acc, 2606:4700:20::681a:bcc, 2606:4700:20::ac43:442f
Response IP 104.26.10.204
Found Yes
Hash 1819783ceaa6e58b1820ac0f795d2616380c5417213a277dd6c4bd6ca2d4fa90
SimHash 431019567712

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://originalbotanica.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://originalbotanica.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/