stbotanica.com
robots.txt
Robots Exclusion Standard data for stbotanica.com
Resource Scan
Scan Details
Site Domain | stbotanica.com |
Base Domain | stbotanica.com |
Scan Status | Ok |
Last Scan | 2024-09-08T17:53:02+00:00 |
Next Scan | 2024-09-22T17:53:02+00:00 |
Last Scan
Scanned | 2024-09-08T17:53:02+00:00 |
URL | https://stbotanica.com/robots.txt |
Domain IPs | 52.84.229.124, 52.84.229.28, 52.84.229.43, 52.84.229.73 |
Response IP | 52.84.229.43 |
Found | Yes |
Hash | ad2ca667eec85533a41183b3699c1dd483ee2538a0e78afdd13e79b20679ef95 |
SimHash | 739d5afbc9b4 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cgi-bin/ |
Disallow | /cms/ |
Disallow | /landing/ |
Disallow | /c4p_log/ |
Disallow | /SearchResults.aspx?Search=* |
Disallow | /shopping-bag |
Disallow | */shopping-bag |
Disallow | /checkout |
Disallow | */checkout |
Disallow | /select-address* |
Disallow | */select-address* |
Disallow | /add-shipping-address |
Disallow | */add-shipping-address |
Disallow | /payment |
Disallow | */payment |
Disallow | /order-summary |
Disallow | */order-summary* |
Disallow | /page-not-found |
Disallow | /search/* |
Allow | /?* |
Disallow | /*?icid= |
Disallow | /*sbot%3D1 |
Disallow | *utm_* |
Disallow | *icid%3D* |
Disallow | /*.csv$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.stbotanica.com/sitemap.xml |