oster.com.pe
robots.txt

Robots Exclusion Standard data for oster.com.pe

Resource Scan

Scan Details

Site Domain oster.com.pe
Base Domain oster.com.pe
Scan Status Ok
Last Scan2024-11-16T06:17:48+00:00
Next Scan 2024-12-16T06:17:48+00:00

Last Scan

Scanned2024-11-16T06:17:48+00:00
URL https://www.oster.com.pe/robots.txt
Domain IPs 108.156.133.31, 108.156.133.63, 108.156.133.69, 108.156.133.71, 2600:9000:2755:1000:1b:dca3:1d80:93a1, 2600:9000:2755:3e00:1b:dca3:1d80:93a1, 2600:9000:2755:7000:1b:dca3:1d80:93a1, 2600:9000:2755:8c00:1b:dca3:1d80:93a1, 2600:9000:2755:b200:1b:dca3:1d80:93a1, 2600:9000:2755:ca00:1b:dca3:1d80:93a1, 2600:9000:2755:ec00:1b:dca3:1d80:93a1, 2600:9000:2755:f600:1b:dca3:1d80:93a1
Response IP 108.156.133.63
Found Yes
Hash 303b7f16df6ccf72e8c4381ea73fb3562bc791cb5d8868b3d65bddefebb81972
SimHash e038cd074dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap http://www.lojavazia.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.