thecigarstore.com
robots.txt

Robots Exclusion Standard data for thecigarstore.com

Resource Scan

Scan Details

Site Domain thecigarstore.com
Base Domain thecigarstore.com
Scan Status Ok
Last Scan2024-06-14T23:12:09+00:00
Next Scan 2024-07-14T23:12:09+00:00

Last Scan

Scanned2024-06-14T23:12:09+00:00
URL https://thecigarstore.com/robots.txt
Redirect https://www.thecigarstore.com/robots.txt
Redirect Domain www.thecigarstore.com
Redirect Base thecigarstore.com
Domain IPs 104.21.93.127, 172.67.209.229, 2606:4700:3033::6815:5d7f, 2606:4700:3033::ac43:d1e5
Redirect IPs 104.21.93.127, 172.67.209.229, 2606:4700:3033::6815:5d7f, 2606:4700:3033::ac43:d1e5
Response IP 172.67.209.229
Found Yes
Hash 4f2c243b8c30d72908202fa07fc9c23d66705fc1af8ea457f3aad56e59053b3e
SimHash a4fdb9022d95

Groups

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/
Disallow /cgi-local/

Comments

  • Robot-Manager was used to generate this file.
  • Copyright (c) 2001 by Sophtware.com, Inc. All Rights Reserved.
  • http://www.websitemanagementtools.com/
  • PARTIAL access (All Spiders)