smithoptics.com
robots.txt
Robots Exclusion Standard data for smithoptics.com
Resource Scan
Scan Details
Site Domain | smithoptics.com |
Base Domain | smithoptics.com |
Scan Status | Ok |
Last Scan | 2024-10-30T16:26:15+00:00 |
Next Scan | 2024-11-29T16:26:15+00:00 |
Last Scan
Scanned | 2024-10-30T16:26:15+00:00 |
URL | https://smithoptics.com/robots.txt |
Redirect | https://www.smithoptics.com/robots.txt |
Redirect Domain | www.smithoptics.com |
Redirect Base | smithoptics.com |
Domain IPs | 108.157.254.100, 108.157.254.2, 108.157.254.54, 108.157.254.70 |
Redirect IPs | 104.18.42.3, 172.64.145.253 |
Response IP | 172.64.145.253 |
Found | Yes |
Hash | 031dfe9531d199873dbc8d5ad2754e70c153d47238fbe2bb8eaa8c1e1f52732b |
SimHash | 39055d50ef13 |
Groups
*
Rule | Path |
---|---|
Disallow | /checkout |
Disallow | /*srule%3D* |
Disallow | /search?q=* |
Disallow | /search?dwcount=* |
Disallow | /offline |
Disallow | /orderconfirmation |
Disallow | /orders |
Disallow | /wallet |
Disallow | /f/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.smithoptics.com/sitemap_index.xml |