oster.com.mx
robots.txt

Robots Exclusion Standard data for oster.com.mx

Resource Scan

Scan Details

Site Domain oster.com.mx
Base Domain oster.com.mx
Scan Status Ok
Last Scan2024-09-17T05:55:48+00:00
Next Scan 2024-10-17T05:55:48+00:00

Last Scan

Scanned2024-09-17T05:55:48+00:00
URL https://www.oster.com.mx/robots.txt
Domain IPs 13.33.30.112, 13.33.30.18, 13.33.30.39, 13.33.30.63, 2600:9000:229f:2a00:9:7cd6:63c0:93a1, 2600:9000:229f:4000:9:7cd6:63c0:93a1, 2600:9000:229f:600:9:7cd6:63c0:93a1, 2600:9000:229f:7600:9:7cd6:63c0:93a1, 2600:9000:229f:aa00:9:7cd6:63c0:93a1, 2600:9000:229f:c200:9:7cd6:63c0:93a1, 2600:9000:229f:c400:9:7cd6:63c0:93a1, 2600:9000:229f:cc00:9:7cd6:63c0:93a1
Response IP 13.33.30.18
Found Yes
Hash 303b7f16df6ccf72e8c4381ea73fb3562bc791cb5d8868b3d65bddefebb81972
SimHash e038cd074dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap http://www.lojavazia.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.