Log In Sign Up

caudalinformativo.com
robots.txt

Robots Exclusion Standard data for caudalinformativo.com

Resource Scan

Scan Details

Site Domain caudalinformativo.com
Base Domain caudalinformativo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-09T16:25:38+00:00
Next Scan 2025-07-08T16:25:38+00:00

Last Successful Scan

Scanned2023-12-17T16:23:26+00:00
URL https://caudalinformativo.com/robots.txt
Domain IPs 104.21.15.41, 172.67.161.102, 2606:4700:3036::6815:f29, 2606:4700:3037::ac43:a166
Response IP 104.21.15.41
Found Yes
Hash 98659afa988831abe40f3d868841e1dd94bc08ef91879554bbba0234389762fa
SimHash 20d048808af2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Allow /*.js$
Allow /*.css$

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.caudalinformativo.com/sitemap_index.xml
Back to top

Comments

  • Evita bloqueos de CSS y JS.
  • Lista de bots que deberías permitir.
  • Lista de bots que generan consultas abusivas aunque siguen las pautas del archivo robots.txt
Back to top