bsbs.co
robots.txt
Robots Exclusion Standard data for bsbs.co
Resource Scan
Scan Details
Site Domain | bsbs.co |
Base Domain | bsbs.co |
Scan Status | Ok |
Last Scan | 2024-05-14T06:56:52+00:00 |
Next Scan | 2024-06-13T06:56:52+00:00 |
Last Scan
Scanned | 2024-05-14T06:56:52+00:00 |
URL | https://www.bsbs.co/robots.txt |
Domain IPs | 108.156.133.41, 108.156.133.5, 108.156.133.57, 108.156.133.64 |
Response IP | 108.156.133.64 |
Found | Yes |
Hash | d00ea0963045a17bf5404720c9313404a69f8e6158096bf25ecb7cc4aad7a106 |
SimHash | a95c9f11cdd6 |
Groups
*
Rule | Path |
---|---|
Disallow | /closed |
Disallow | /preview/ |
Disallow | /users/ |
Disallow | /orders |
Disallow | /*?*debug=* |
Disallow | /*?*theme_preview=* |
Disallow | /*?*price_range_preview=* |
Disallow | /*?*draft=* |
Disallow | /api/ |
Disallow | /themes/ |
Disallow | /products*?*query=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.bsbs.co/sitemap.xml |
Comments