elmundo.cr
robots.txt

Robots Exclusion Standard data for elmundo.cr

Resource Scan

Scan Details

Site Domain elmundo.cr
Base Domain elmundo.cr
Scan Status Ok
Last Scan2024-06-25T13:38:28+00:00
Next Scan 2024-07-02T13:38:28+00:00

Last Scan

Scanned2024-06-25T13:38:28+00:00
URL https://elmundo.cr/robots.txt
Domain IPs 179.61.189.108, 2a02:4780:84:a4a8:bb27:17cd:8120:f847
Response IP 77.37.75.214
Found Yes
Hash b1c617e2c6839c99897c74744a4f0c547afe43b66fcefd505d4a4cbd46903f83
SimHash cc8c5900efd6

Groups

twitterbot

Rule Path
Disallow *
Allow /wp-content/uploads/*
Allow /archives

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /*/feed
Disallow /*/trackback
Disallow /*?
Disallow /*.js$
Disallow /*.inc$
Disallow /feed/
Disallow /feed
Disallow /tag/
Disallow /archives/
Disallow /2016/
Disallow /2015/
Disallow /2017/
Disallow /2018/
Disallow /portfolio/
Disallow /author/
Disallow /portfolio_tag/
Disallow /category/sin-categoria/
Disallow /?s=*