agendamenuda.com
robots.txt

Robots Exclusion Standard data for agendamenuda.com

Resource Scan

Scan Details

Site Domain agendamenuda.com
Base Domain agendamenuda.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-08-22T04:33:55+00:00
Next Scan 2025-10-21T04:33:55+00:00

Last Successful Scan

Scanned2025-06-23T21:38:11+00:00
URL https://agendamenuda.com/robots.txt
Redirect https://www.agendamenuda.com/robots.txt
Redirect Domain www.agendamenuda.com
Redirect Base agendamenuda.com
Domain IPs 104.21.40.135, 172.67.152.3, 2606:4700:3032::6815:2887, 2606:4700:3037::ac43:9803
Redirect IPs 104.21.40.135, 172.67.152.3, 2606:4700:3032::6815:2887, 2606:4700:3037::ac43:9803
Response IP 104.21.40.135
Found Yes
Hash e469f014a8e4bf6203873868a6b66015cb8509321b4fdebae0ebb8a74abfef40
SimHash 6050d6100693

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /*?
Disallow */amp
Disallow */feed
Disallow */page
Disallow */tag
Disallow */category
Disallow */cdn-cgi
Disallow */rss
Disallow */trackback
Disallow */comments/feed
Disallow /index.php
Disallow /*.php$
Disallow /*.inc$
Disallow /_index_ssl.html_gzip/
Allow /wp-content/uploads/$
Allow /wp-content/ewww/lazy/$
Allow /wp-content/themes/$
Allow /wp-content/*/*/*/*.js
Allow /wp-content/*/*/*/*.css
Allow /wp-content/*/*/*.js
Allow /wp-content/*/*/*.css
Allow /wp-content/*/*.js
Allow /wp-content/*/*.css
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*/*/*/*.js
Allow /wp-includes/*/*/*/*.css
Allow /wp-includes/*/*/*.js
Allow /wp-includes/*/*/*.css
Allow /wp-includes/*/*.js
Allow /wp-includes/*/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.jpg.webp$
Allow /*.webp$
Allow /*.gif$
Allow /*.png$
Disallow */*.pdf$

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

libwww

Rule Path
Disallow /

slurp

Rule Path
Disallow /gracias-por-contactar/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.agendamenuda.com/sitemap_index.xml

Comments

  • Bloqueo de URLs con parámetros
  • Otros Bloqueos y permisos
  • Bloquear por tipos de ficheros
  • Evita bloqueos de CSS y JS e imágenes
  • Lista de bots bloqueados
  • Desautorizar a paginas con menor valor de seo
  • Colocamos nuestro Sitemap para informar a buscadores