elmundo.hn
robots.txt

Robots Exclusion Standard data for elmundo.hn

Resource Scan

Scan Details

Site Domain elmundo.hn
Base Domain elmundo.hn
Scan Status Ok
Last Scan2025-01-15T17:15:30+00:00
Next Scan 2025-01-22T17:15:30+00:00

Last Scan

Scanned2025-01-15T17:15:30+00:00
URL https://elmundo.hn/robots.txt
Domain IPs 195.201.17.116
Response IP 195.201.17.116
Found Yes
Hash eca56aa81837b9a16541b30db0058ef6e32aca5357e4a33e674d53d82827e20c
SimHash 62c0da86c175

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Disallow /wp-content/plugins/

googlebot allow: /*.css$ allow: /*.js$
googlebot-image

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /

Comments

  • Slurp (Yahoo!), Noxtrum y el bot de MSN que suelen generar excesivas consultas.