cloe.com.mx
robots.txt

Robots Exclusion Standard data for cloe.com.mx

Resource Scan

Scan Details

Site Domain cloe.com.mx
Base Domain cloe.com.mx
Scan Status Ok
Last Scan2024-10-17T06:21:48+00:00
Next Scan 2024-11-16T06:21:48+00:00

Last Scan

Scanned2024-10-17T06:21:48+00:00
URL https://www.cloe.com.mx/robots.txt
Domain IPs 108.157.254.29, 108.157.254.55, 108.157.254.62, 108.157.254.89, 2600:9000:2753:3000:e:2dba:24c0:93a1, 2600:9000:2753:3800:e:2dba:24c0:93a1, 2600:9000:2753:5e00:e:2dba:24c0:93a1, 2600:9000:2753:8800:e:2dba:24c0:93a1, 2600:9000:2753:9800:e:2dba:24c0:93a1, 2600:9000:2753:ae00:e:2dba:24c0:93a1, 2600:9000:2753:b400:e:2dba:24c0:93a1, 2600:9000:2753:e200:e:2dba:24c0:93a1
Response IP 108.157.254.89
Found Yes
Hash 0be13e716a0e33ab2340166abc82565d41fd1120279c5c23417849331f089786
SimHash f430cd574dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.cloe.com.mx/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.