cde.cl
robots.txt
Robots Exclusion Standard data for cde.cl
Resource Scan
Scan Details
| Site Domain | cde.cl |
| Base Domain | cde.cl |
| Scan Status | Ok |
| Last Scan | 2024-10-22T10:55:42+00:00 |
| Next Scan | 2024-11-21T10:55:42+00:00 |
Last Scan
| Scanned | 2024-10-22T10:55:42+00:00 |
| URL | https://www.cde.cl/robots.txt |
| Domain IPs | 163.247.45.89 |
| Response IP | 163.247.45.89 |
| Found | Yes |
| Hash | c628445a6f6e81fb9ad2b09d58c984c9efb35f7b15a1c44529d9998f1baf0ceb |
| SimHash | e0b6dd68c871 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Allow | /*/*.css |
| Allow | /*/*.js |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /privacy-policy |
| Disallow | /causas |
| Disallow | /transparencia |
| Disallow | /wps |
| Disallow | /wps/portal |
| Disallow | /wps/wcm |
| Disallow | /presidentes |
bingbot
msnbot
msnbot-media
applebot
slurp
duckduckbot
qwantify
baiduspider
baiduspider/2.0
baiduspider-video
baiduspider-image
sogou spider
sogou web spider
sosospider
sosospider+
sosospider/2.0
yodao
youdao
youdaobot
youdaobot/1.0
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
giftghostbot
seznam
paperlibot
genieo
dataprovider/6.101
dataprovidersiteexplorer
dazoobot/1.0
diffbot
domainstatsbot/1.0
dotbot/1.1
dubaiindex
ecommercebot
expertsearchspider
feedbin
fetch/2.0a
ffbot/1.0
focusbot/1.1
huaweisymantecspider
huaweisymantecspider/1.0
jobdiggerspider
lemurwebcrawler
lipperheylinkexplorer
lssrocketcrawler/1.0
lyt.srv1.5
miadev/0.0.1
najdi.si/3.1
bountiibot
experibot_v1
bixocrawler
bixocrawler testcrawler
crawler4j
crowsnest/0.5
cukbot
dataprovider/6.92
dblbot/1.0
diffbot/0.1
digg deeper/v1
discobot/1.0
discobot/1.1
discobot/2.0
discoverybot/2.0
dlvr.it/1.0
drupact/0.7
ezooms/1.0
fastbot crawler beta 2.0
fastbot crawler beta 4.0
feedly social
feedly/1.0
feedlybot/1.0
feedspot
feedspotbot/1.0
clickagy intelligence bot v2
classbot
cispa vulnerability notification
cirrusexplorer/1.1
checksem/nutch-1.10
catchbot/5.0
catchbot/3.0
catchbot/2.0
catchbot/1.0
camontspider/1.0
buzzbot/1.0
buzzbot
businessseek.biz_spider
bubing
fyberspider/1.3
findlinks/1.1.6-beta5
g2reader-bot/1.0
findlinks/1.1.6-beta6
findlinks/2.0
findlinks/2.0.1
findlinks/2.0.2
findlinks/2.0.4
findlinks/2.0.5
findlinks/2.0.9
findlinks/2.1
findlinks/2.1.5
findlinks/2.1.3
findlinks/2.2
findlinks/2.5
findlinks/2.6
findlinks/1.0
findlinks/1.1.3-beta8
findlinks/1.1.3-beta9
findlinks/1.1.4-beta7
findlinks/1.1.6-beta1
findlinks/1.1.6-beta1 yacy
findlinks/1.1.6-beta2
findlinks/1.1.6-beta3
findlinks/1.1.6-beta4
bixo
bixolabs/1.0
crawlera/1.10.2
dataprovider site explorer
ahrefsbot
alexibot
mj12bot
surveybot
xenu's
xenu's link sleuth 1.1c
rogerbot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
facebookexternalhit/1.0
facebookexternalhit/1.1
facebookplatform/1.0
facebot/1.0
visionutils/0.2
datagnionbot
twitterbot
linkedinbot/1.0
pinterest/0.1
pinterest/0.2
| Rule | Path |
|---|---|
| Disallow | /calendar/action~posterboard/ |
| Disallow | /calendar/action~agenda/ |
| Disallow | /calendar/action~oneday/ |
| Disallow | /calendar/action~month/ |
| Disallow | /calendar/action~week/ |
| Disallow | /calendar/action~stream/ |
| Disallow | /calendar/action~undefined/ |
| Disallow | /calendar/action~http%3A/ |
| Disallow | /calendar/action~default/ |
| Disallow | /calendar/action~poster/ |
| Disallow | /calendar/action~*/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cde.cl/sitemap_index.xml |
| sitemap | https://www.cde.cl/post-sitemap.xml |
| sitemap | https://www.cde.cl/page-sitemap.xml |
| sitemap | https://www.cde.cl/category-sitemap.xml |
Warnings
- 4 invalid lines.
Comments