castellonaldia.elmundo.es
robots.txt

Robots Exclusion Standard data for castellonaldia.elmundo.es

Resource Scan

Scan Details

Site Domain castellonaldia.elmundo.es
Base Domain elmundo.es
Scan Status Ok
Last Scan2024-11-03T09:05:42+00:00
Next Scan 2024-12-03T09:05:42+00:00

Last Scan

Scanned2024-11-03T09:05:42+00:00
URL https://castellonaldia.elmundo.es/robots.txt
Domain IPs 129.159.199.159, 158.101.188.28
Response IP 158.101.188.28
Found Yes
Hash afe7499dad9ff7f1db799554b114a5f8f25d650e7874999bf373b8363e75921f
SimHash badf6d88cdd2

Groups

*

Rule Path
Disallow /news-portlet/metalocator/
Disallow /news-portlet/html/teaser-viewer-portlet/teaser_page.jsp
Disallow /news-portlet/html/teaser-viewer-portlet/teaser_filter.jsp
Disallow /news-portlet/filterteaser/
Disallow /news-portlet/getfilteropts/
Disallow /tracking-portlet/html/ranking-viewer/ranking_details.jsp
Disallow /user-portlet/login-with/
Disallow /user-portlet/edit-user-profile/
Disallow /user-portlet/reset-credentials/
Disallow /user-portlet/confirm-email/
Disallow /user-portlet/refreshuserentitlements/
Disallow /user-portlet/getEntitlements/
Disallow /group/
Disallow /user/
Disallow /web/
Disallow /image/

*

Rule Path
Disallow /inicio-sesion/
Disallow /registro/
Disallow /editar-perfil/
Disallow /recuperar-contrasena/
Disallow /false/false/
Disallow /error-404
Disallow /css/
Disallow /img/
Disallow /scripts/
Disallow /c/
Disallow /busqueda/-/search/
Disallow /search/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /logout/
Disallow /node/add
Disallow /search/
Disallow /search
Disallow /user/register/
Disallow /user/register
Disallow /user/password/
Disallow /user/password
Disallow /user/login/
Disallow /user/login
Disallow /laboratorio/
Disallow /laboratorio

the knowledge ai

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

jolari

Rule Path
Disallow /

Other Records

Field Value
sitemap https://castellonaldia.elmundo.es/sitemap.xml
sitemap https://castellonaldia.elmundo.es/sitemapforgoogle.xml
sitemap https://castellonaldia.elmundo.es/megasitemap.xml

Comments

  • Agentes nocivos conocidos