hilandscigars.com
robots.txt

Robots Exclusion Standard data for hilandscigars.com

Resource Scan

Scan Details

Site Domain hilandscigars.com
Base Domain hilandscigars.com
Scan Status Ok
Last Scan6/7/2025, 1:54:32 AM
Next Scan 6/21/2025, 1:54:32 AM

Last Scan

Scanned6/7/2025, 1:54:32 AM
URL https://hilandscigars.com/robots.txt
Domain IPs 104.21.43.38, 172.67.218.222, 2606:4700:3032::ac43:dade, 2606:4700:3034::6815:2b26
Response IP 104.21.43.38
Found Yes
Hash 6bfe81c66257e1a91f7e4ab4e2686f554cf08159a60b70f9c1c131d2defecd8a
SimHash f105d073eb12

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /cigar-brand/

Other Records

Field Value
sitemap https://www.hilandscigars.com/sitemap_index.xml

Comments

  • Sitemap
  • Crawler Setup
  • System
  • Paths