defensacentral.com
robots.txt

Robots Exclusion Standard data for defensacentral.com

Resource Scan

Scan Details

Site Domain defensacentral.com
Base Domain defensacentral.com
Scan Status Ok
Last Scan2024-10-06T17:46:26+00:00
Next Scan 2024-10-13T17:46:26+00:00

Last Scan

Scanned2024-10-06T17:46:26+00:00
URL https://defensacentral.com/robots.txt
Redirect https://www.defensacentral.com/robots.txt
Redirect Domain www.defensacentral.com
Redirect Base defensacentral.com
Domain IPs 104.26.8.119, 104.26.9.119, 172.67.68.26, 2606:4700:20::681a:877, 2606:4700:20::681a:977, 2606:4700:20::ac43:441a
Redirect IPs 104.26.8.119, 104.26.9.119, 172.67.68.26, 2606:4700:20::681a:877, 2606:4700:20::681a:977, 2606:4700:20::ac43:441a
Response IP 104.26.9.119
Found Yes
Hash fa0250ed467006a49ff29f8551bfd0ac624e55a2a675a5439ca562072f429839
SimHash 48445c840951

Groups

*

Rule Path
Disallow /ustedpregunta/categoria/sexo/
Disallow /adconion_preroll/
Disallow /videos/
Disallow /noticia/admin/
Disallow /imagen/admin/
Disallow /encuesta/admin/
Disallow /video/admin/
Disallow /directo/admin/
Disallow /admin/elementos/
Disallow /admin/publicidad/
Disallow /alert/
Disallow /user/admin/

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /es_ES/resultados/noticias/?q=
Disallow /es_ES/resultados/*
Disallow /intranet/*
Disallow /resultadoEncuesta/*
Disallow /admin/
Disallow /donbalonrosa/
Disallow /555/
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

Other Records

Field Value
sitemap https://panel.defensacentral.com/sitemap_index.xml
sitemap https://portal23backoffice.defensacentral.com/sitemaps/sitemap-index.xml
sitemap https://portal23backoffice.defensacentral.com/sitemaps/sitemap-news.xml
sitemap https://portal23backoffice.defensacentral.com/sitemaps/category-sitemap.xml