elpais.hn
robots.txt

Robots Exclusion Standard data for elpais.hn

Resource Scan

Scan Details

Site Domain elpais.hn
Base Domain elpais.hn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-11T18:48:27+00:00
Next Scan 2024-10-10T18:48:27+00:00

Last Successful Scan

Scanned2024-06-13T18:47:29+00:00
URL https://elpais.hn/robots.txt
Redirect https://www.elpais.hn/robots.txt
Redirect Domain www.elpais.hn
Redirect Base elpais.hn
Domain IPs 104.21.16.132, 172.67.212.185, 2606:4700:3032::6815:1084, 2606:4700:3036::ac43:d4b9
Redirect IPs 104.21.16.132, 172.67.212.185, 2606:4700:3032::6815:1084, 2606:4700:3036::ac43:d4b9
Response IP 172.67.212.185
Found Yes
Hash 457829f5d5d063cfe53a69bb38f74cf64d0d74a6ea0432898491122a19df08ec
SimHash 68405a8262da

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin
Allow /wp-content/plugins/
Allow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /trackback/
Disallow /?s=
Allow /search
Allow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.inc$
Disallow */trackback/
Allow /page/
Allow /tag/
Allow /category/
Allow /feed/$
Allow /feed
Disallow /comments/feed
Allow /*/feed/$
Allow /*/feed/rss/$
Disallow /*/trackback/$
Allow /*/*/feed/$
Allow /*/*/feed/rss/$
Allow /*/*/trackback/$
Allow /*/*/*/feed/$
Allow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Allow /*.js$
Allow /*.css$
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msiecrawler

Rule Path
Allow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elpais.hn/news-sitemap.xml
sitemap https://www.elpais.hn/sitemap.xml
sitemap https://www.elpais.hn/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK