ae.cl
robots.txt

Robots Exclusion Standard data for ae.cl

Resource Scan

Scan Details

Site Domain ae.cl
Base Domain ae.cl
Scan Status Ok
Last Scan2024-10-17T06:25:44+00:00
Next Scan 2024-11-16T06:25:44+00:00

Last Scan

Scanned2024-10-17T06:25:44+00:00
URL https://ae.cl/robots.txt
Redirect https://www.ae.cl/robots.txt
Redirect Domain www.ae.cl
Redirect Base ae.cl
Domain IPs 108.156.133.117, 108.156.133.129, 108.156.133.66, 108.156.133.77
Redirect IPs 186.195.65.65
Response IP 186.195.65.65
Found Yes
Hash 72ed1e01dd20d5e5645459c82373c5360ef40acd38802552b89925cb3d8cd8c3
SimHash b008ef474dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.ae.cl/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.