superbalist.com
robots.txt
Robots Exclusion Standard data for superbalist.com
Resource Scan
Scan Details
| Site Domain | superbalist.com |
| Base Domain | superbalist.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-23T17:12:50+00:00 |
| Next Scan | 2024-11-21T17:12:50+00:00 |
Last Successful Scan
| Scanned | 2023-10-22T16:53:27+00:00 |
| URL | https://superbalist.com/robots.txt |
| Domain IPs | 104.17.20.66, 104.17.21.66, 2606:4700::6811:1442, 2606:4700::6811:1542 |
| Response IP | 104.17.20.66 |
| Found | Yes |
| Hash | 8f0edbb1582021613fff9bab10d6f4d70be920e727432a3b8c7fd11e60dace4d |
| SimHash | 2d19df0e8e12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*data.button.url* |
| Disallow | /*designer_s* |
| Disallow | /wishlist/ |
| Disallow | /legacy/ |
| Disallow | /api/ |
| Disallow | *?q=* |
| Disallow | /account |
| Disallow | /account/* |
| Disallow | /checkout |
| Disallow | /checkout/* |
| Disallow | /chk |
| Disallow | /chk/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://superbalist.com/sitemaps/brands.xml |
| sitemap | https://superbalist.com/sitemaps/brands_combinations.xml |
| sitemap | https://superbalist.com/sitemaps/categories.xml |
| sitemap | https://superbalist.com/sitemaps/combinations.xml |
| sitemap | https://superbalist.com/sitemaps/departments.xml |
| sitemap | https://superbalist.com/sitemaps/products.xml |
| sitemap | https://superbalist.com/sitemaps/static.xml |
| sitemap | https://superbalist.com/sitemaps/topical_pages.xml |
| sitemap | https://superbalist.com/thewayofus.rss |