playasmexico.com.mx
robots.txt

Robots Exclusion Standard data for playasmexico.com.mx

Resource Scan

Scan Details

Site Domain playasmexico.com.mx
Base Domain playasmexico.com.mx
Scan Status Ok
Last Scan2024-11-11T18:19:44+00:00
Next Scan 2024-11-18T18:19:44+00:00

Last Scan

Scanned2024-11-11T18:19:44+00:00
URL https://playasmexico.com.mx/robots.txt
Domain IPs 67.202.92.21
Response IP 67.202.92.21
Found Yes
Hash 85e3c54c4dae74b7ae9e1c489155e6784c5e43e3b32083c9a96376bf93071f87
SimHash 2940579256f7

Groups

googlebot
sogou
sogou spider
screaming frog seo spider
applebot
duckduckbot
mediapartners-google
adsbot-google-mobile
adsbot-google
googlebot-image
googlebot-news
googlebot-video
adsbot-google-mobile-apps

Rule Path
Allow /

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /trackback/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /*?
Disallow /*.php$
Disallow /*.inc$
Disallow */trackback/
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

Comments

  • No rastrear copias de seguridad
  • Reglas para bots conocidos

Warnings

  • `https` is not a known field.