whitestuff.com
robots.txt
Robots Exclusion Standard data for whitestuff.com
Resource Scan
Scan Details
| Site Domain | whitestuff.com |
| Base Domain | whitestuff.com |
| Scan Status | Ok |
| Last Scan | 2025-08-26T12:42:11+00:00 |
| Next Scan | 2025-09-09T12:42:11+00:00 |
Last Scan
| Scanned | 2025-08-26T12:42:11+00:00 |
| URL | https://whitestuff.com/robots.txt |
| Redirect | https://checkout.whitestuff.com/content/robots.txt |
| Redirect Domain | checkout.whitestuff.com |
| Redirect Base | whitestuff.com |
| Domain IPs | 104.18.4.86, 104.18.5.86, 2606:4700::6812:456, 2606:4700::6812:556 |
| Redirect IPs | 104.18.4.86, 104.18.5.86, 2606:4700::6812:456, 2606:4700::6812:556 |
| Response IP | 104.18.5.86 |
| Found | Yes |
| Hash | c681d99fb9b8133f2c39cad3cc4a03f4eee47f29dfa97473042183d318db7389 |
| SimHash | fc25855c21bf |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /bag* |
| Disallow | /checkout-identity* |
| Disallow | /login* |
| Disallow | /create-account* |
| Disallow | /forgot-password* |
| Disallow | /my-account* |
| Disallow | /us/search* |
| Disallow | /us/bag* |
| Disallow | /us/checkout-identity* |
| Disallow | /us/login* |
| Disallow | /us/create-account* |
| Disallow | /us/forgot-password* |
| Disallow | /us/my-account* |
| Disallow | /eu/search* |
| Disallow | /eu/bag* |
| Disallow | /eu/checkout-identity* |
| Disallow | /eu/login* |
| Disallow | /eu/create-account* |
| Disallow | /eu/forgot-password* |
| Disallow | /eu/my-account* |
| Disallow | /*?*bvstate |
| Disallow | */LINEN |
| Disallow | /*/us/browse/ |
| Disallow | /*/eu/browse/ |
| Disallow | */browse/*/browse/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.whitestuff.com/sitemap.xml |