containerstore.com
robots.txt
Robots Exclusion Standard data for containerstore.com
Resource Scan
Scan Details
| Site Domain | containerstore.com |
| Base Domain | containerstore.com |
| Scan Status | Ok |
| Last Scan | 2024-10-07T10:33:42+00:00 |
| Next Scan | 2024-10-21T10:33:42+00:00 |
Last Scan
| Scanned | 2024-10-07T10:33:42+00:00 |
| URL | https://containerstore.com/robots.txt |
| Redirect | https://www.containerstore.com/robots.txt |
| Redirect Domain | www.containerstore.com |
| Redirect Base | containerstore.com |
| Domain IPs | 165.254.198.225, 204.141.88.95 |
| Redirect IPs | 116.51.25.117, 116.51.25.118, 116.51.25.119, 116.51.25.120 |
| Response IP | 64.71.161.158 |
| Found | Yes |
| Hash | d2e848cd7583c6eb57b7da9d0546a96433688aaa835cc8189903a0d5cdfc12d2 |
| SimHash | 6a08d2724b31 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | */_next/static/chunks/*.js |
| Allow | */_next/static/css/*.css |
| Allow | /boutique/inspirationalSpaces |
| Disallow | /admin/* |
| Disallow | /cart/* |
| Disallow | /profile/* |
| Disallow | /checkout/* |
| Disallow | /boutique/workingProducts |
| Disallow | /boutique/workingProducts/* |
| Disallow | /boutique/miscAccessorySKUs |
| Disallow | /medialibrary/pdf/rules/PurchasingTermsAndConditions-TCS.pdf |
| Disallow | /elfa/instructions/* |
| Disallow | /s/*cq$ |
| Disallow | /s?q=* |
pinterestbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | */_next/static/chunks/*.js |
| Allow | */_next/static/css/*.css |
| Allow | /boutique/inspirationalSpaces |
| Disallow | /admin/* |
| Disallow | /cart/* |
| Disallow | /profile/* |
| Disallow | /checkout/* |
| Disallow | /boutique/workingProducts |
| Disallow | /boutique/workingProducts/* |
| Disallow | /boutique/miscAccessorySKUs |
| Disallow | /medialibrary/pdf/rules/PurchasingTermsAndConditions-TCS.pdf |
| Disallow | /elfa/instructions/* |
| Disallow | /s/*cq$ |
| Disallow | /s?q=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.containerstore.com/site-map.xml |
| sitemap | https://www.containerstore.com/shopping/th-sitemap-0.xml |
| sitemap | https://www.containerstore.com/stores/sitemap.xml |
| sitemap | https://www.containerstore.com/sitemaps/content-sitemap-71-.xml |
| sitemap | https://www.containerstore.com/site-map.xml |
| sitemap | https://www.containerstore.com/shopping/th-sitemap-0.xml |