rutadecenotes.com.mx
robots.txt

Robots Exclusion Standard data for rutadecenotes.com.mx

Resource Scan

Scan Details

Site Domain rutadecenotes.com.mx
Base Domain rutadecenotes.com.mx
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-08-15T00:00:38+00:00
Next Scan 2025-11-13T00:00:38+00:00

Last Successful Scan

Scanned2024-10-19T06:59:10+00:00
URL https://rutadecenotes.com.mx/robots.txt
Domain IPs 107.180.27.178
Response IP 107.180.27.178
Found Yes
Hash 79280c9432462cd4007503403625aff4592a91c3da5934858b84ce7f04b163d0
SimHash 107c74f24819

Groups

*

Rule Path
Allow /
Allow /sitemap.htm
Disallow /util.php
Disallow /analyticstracking.php
Disallow /info_cenotes/proponer_cambio.php
Disallow /info_cenotes/subir_imagen.php
Disallow /img_articulos/articulos.php
Disallow /BingSiteAuth.xml

*

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

exabot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

seokicks.de

Rule Path
Disallow /

exabot

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Allow /

seomonitorbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /config/
Disallow /includes/
Disallow /libs/
Disallow /logs/
Disallow /templates/
Disallow /tmp/
Disallow /uploads/
Disallow /vendor/
Disallow /private/
Disallow /cache/

Other Records

Field Value
sitemap http://rutadecenotes.com.mx/sitemap.xml