syswoody.com
robots.txt

Robots Exclusion Standard data for syswoody.com

Resource Scan

Scan Details

Site Domain syswoody.com
Base Domain syswoody.com
Scan Status Ok
Last Scan2025-11-29T14:07:15+00:00
Next Scan 2025-12-06T14:07:15+00:00

Last Scan

Scanned2025-11-29T14:07:15+00:00
URL https://syswoody.com/robots.txt
Redirect https://www.syswoody.com/robots.txt
Redirect Domain www.syswoody.com
Redirect Base syswoody.com
Domain IPs 104.21.89.161, 172.67.189.243, 2606:4700:3037::6815:59a1, 2606:4700:3037::ac43:bdf3
Redirect IPs 104.21.89.161, 172.67.189.243, 2606:4700:3037::6815:59a1, 2606:4700:3037::ac43:bdf3
Response IP 104.21.89.161
Found Yes
Hash f7f5c78728a13cfb5eeba49c80e2fc0a3ca79e1804cc020fd69de51f0cd12e85
SimHash 68445c10c699

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /wp-
Disallow /wp-content/
Disallow /trackback/
Disallow /feed/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow */feed/
Disallow */trackback/
Disallow /page/
Disallow /tag/
Disallow /category/
Allow /wp-content/uploads/
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Allow /*.js$
Allow /*.css$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$

googlebot
googlebot-image

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

libwww

Rule Path
Disallow /

slurp

Rule Path
Disallow /gracias-por-contactar/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.syswoody.es/sitemap_index.xml

Comments

  • Bloquear Feed de Wordpress
  • Bloqueo Trackback URL.
  • Permitimos Carga dinámica CSS y JS.
  • Bloquear por tipos de ficheros
  • Reglas para bots conocidos
  • Lista de bots bloqueados
  • Desautorizar a páginas con menor valor de seo
  • Colocamos nuestro Sitemap para informar a buscadores