vans.mx
robots.txt
Robots Exclusion Standard data for vans.mx
Resource Scan
Scan Details
| Site Domain | vans.mx |
| Base Domain | vans.mx |
| Scan Status | Ok |
| Last Scan | 2024-09-17T04:52:09+00:00 |
| Next Scan | 2024-10-17T04:52:09+00:00 |
Last Scan
| Scanned | 2024-09-17T04:52:09+00:00 |
| URL | https://www.vans.mx/robots.txt |
| Domain IPs | 18.155.68.115, 18.155.68.121, 18.155.68.31, 18.155.68.59, 2600:9000:23d2:2a00:19:2314:5640:93a1, 2600:9000:23d2:3600:19:2314:5640:93a1, 2600:9000:23d2:5200:19:2314:5640:93a1, 2600:9000:23d2:6400:19:2314:5640:93a1, 2600:9000:23d2:a600:19:2314:5640:93a1, 2600:9000:23d2:ba00:19:2314:5640:93a1, 2600:9000:23d2:c000:19:2314:5640:93a1, 2600:9000:23d2:fe00:19:2314:5640:93a1 |
| Response IP | 18.155.68.59 |
| Found | Yes |
| Hash | 2bdfa5452a860a0221e91d0511b3bb425fcab4fbcc1d0f64c541b74c2384d95d |
| SimHash | 6438ad676dd0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /img/* |
| Disallow | /account/* |
| Disallow | /login/* |
| Disallow | /checkout/* |
| Disallow | /busca/* |
| Disallow | /quick-view/* |
| Disallow | /espiar/* |
| Disallow | /Sistema/* |
| Disallow | /Control/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vans.mx/sitemap.xml |
Comments