hartley-botanic.com
robots.txt

Robots Exclusion Standard data for hartley-botanic.com

Resource Scan

Scan Details

Site Domain hartley-botanic.com
Base Domain hartley-botanic.com
Scan Status Ok
Last Scan2024-05-28T22:57:14+00:00
Next Scan 2024-06-27T22:57:14+00:00

Last Scan

Scanned2024-05-28T22:57:14+00:00
URL https://hartley-botanic.com/robots.txt
Domain IPs 104.26.12.164, 104.26.13.164, 172.67.71.101, 2606:4700:20::681a:ca4, 2606:4700:20::681a:da4, 2606:4700:20::ac43:4765
Response IP 172.67.71.101
Found Yes
Hash 70f4025423a069b91f05c90338a6b76cd00513515ef43fe34945ad7bdba1c25b
SimHash 494c4a90f593

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://hartley-botanic.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK