urbanplanet-streetwear.com
robots.txt
Robots Exclusion Standard data for urbanplanet-streetwear.com
Resource Scan
Scan Details
| Site Domain | urbanplanet-streetwear.com |
| Base Domain | urbanplanet-streetwear.com |
| Scan Status | Ok |
| Last Scan | 2024-06-20T13:56:56+00:00 |
| Next Scan | 2024-07-04T13:56:56+00:00 |
Last Scan
| Scanned | 2024-06-20T13:56:56+00:00 |
| URL | https://urbanplanet-streetwear.com/robots.txt |
| Domain IPs | 104.21.95.20, 172.67.169.44, 2606:4700:3032::ac43:a92c, 2606:4700:3037::6815:5f14 |
| Response IP | 172.67.169.44 |
| Found | Yes |
| Hash | 861662b6fd91155f4808d41a8aa30eab83275c1967d15d344398edac26ce42f1 |
| SimHash | 9f457046cf73 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /*/search* |
| Disallow | /wishlist |
| Disallow | /*/wishlist |
| Disallow | /cart |
| Disallow | /*/cart |
| Disallow | /checkout |
| Disallow | /*/checkout |
| Disallow | /order/* |
| Disallow | /*/order/* |
| Disallow | /login |
| Disallow | /*/login |
| Disallow | /account* |
| Disallow | /*/account* |
| Disallow | /sign-up* |
| Disallow | /*/sign-up* |
| Disallow | /reset-password* |
| Disallow | /*/reset-password* |
| Disallow | /*/filter/* |
Warnings
- `host` is not a known field.
Comments