grainger.mx
robots.txt
Robots Exclusion Standard data for grainger.mx
Resource Scan
Scan Details
| Site Domain | grainger.mx |
| Base Domain | grainger.mx |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-06-07T13:21:43+00:00 |
| Next Scan | 2024-09-05T13:21:43+00:00 |
Last Successful Scan
| Scanned | 2024-01-17T12:18:42+00:00 |
| URL | https://www.grainger.mx/robots.txt |
| Domain IPs | 2600:9000:20c7:3600:1d:9afb:9680:93a1, 2600:9000:20c7:3a00:1d:9afb:9680:93a1, 2600:9000:20c7:8a00:1d:9afb:9680:93a1, 2600:9000:20c7:8e00:1d:9afb:9680:93a1, 2600:9000:20c7:9a00:1d:9afb:9680:93a1, 2600:9000:20c7:c00:1d:9afb:9680:93a1, 2600:9000:20c7:c600:1d:9afb:9680:93a1, 2600:9000:20c7:f400:1d:9afb:9680:93a1, 52.84.251.120, 52.84.251.127, 52.84.251.42, 52.84.251.95 |
| Response IP | 52.222.214.87 |
| Found | Yes |
| Hash | 40a28e89b3f3368fd80f2f533b9471906e2590e139be3da5f643318300e09c34 |
| SimHash | 6dd0ed369e61 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /img/* |
| Disallow | /account/* |
| Disallow | /login/* |
| Disallow | /checkout/* |
| Disallow | /busca/* |
| Disallow | /quick-view/* |
| Disallow | /espiar/* |
*
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.jpeg |
| Allow | /*.js |
| Allow | /*.png |
| Allow | /*.webp |
| Allow | /*.jpg |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /_secure | - |
| Disallow | /account | - |
| Disallow | /admin | - |
| Disallow | /busca | - |
| Disallow | /buscapagina | - |
| Disallow | /buscavazia | - |
| Disallow | /checkout/ | - |
| Disallow | /checkout/ | /cart |
| Disallow | /checkout/cart/add | - |
| Disallow | /checkout | / |
| Disallow | /coleccion/ | - |
| Disallow | /control/ | - |
| Disallow | /espiar/ | - |
| Disallow | /files/ | - |
| Allow | /files/*.js | - |
| Allow | /files/*.css | - |
| Allow | /_v/public/graphql/v1?* | - |
| Allow | /_v/segment/graphql/v1?* | - |
| Allow | /?__pickRuntime=appsEtag%2Cblocks%2CblocksTree%2Ccomponents%2CcontentMap%2Cextensions%2Cmessages%2Cpage%2Cpages%2Cquery%2CqueryData%2Croute%2CruntimeMeta%2Csettings&__device=* | - |
| Allow | /api/sessions?items=* | - |
| Allow | /_v/segment/routing/vtex.store%402.x/department/* | - |
| Allow | /api/dataentities/LC/documents/* | - |
| Disallow | /img/ | - |
| Disallow | /lista-de-deseos | - |
| Disallow | /login | - |
| Disallow | /quick-view/ | - |
| Disallow | /Sistema/ | - |
| Disallow | /Sistema/404 | - |
| Disallow | /Sistema/buscavazia | - |
| Disallow | /wishlist | - |
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Allow | /*?idsku= |
| Allow | /*utm_ |
| Disallow | /*%26 |
| Disallow | /*% |
*
| Rule | Path |
|---|---|
| Disallow | /*.aspx |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.grainger.mx/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments