poderjudicial.es
robots.txt

Robots Exclusion Standard data for poderjudicial.es

Resource Scan

Scan Details

Site Domain poderjudicial.es
Base Domain poderjudicial.es
Scan Status Ok
Last Scan2024-09-20T02:55:35+00:00
Next Scan 2024-10-20T02:55:35+00:00

Last Scan

Scanned2024-09-20T02:55:35+00:00
URL https://www.poderjudicial.es/robots.txt
Domain IPs 62.37.232.21
Response IP 62.37.232.21
Found Yes
Hash 2d7a292bd01acd1990ae2237ca6a0d09bcb91608800f3d8db67b93aabab29f96
SimHash 4a0ddb634b8d

Groups

googlebot
*

Rule Path
Disallow /portal/site/prontuario
Disallow /search_old/
Disallow /Noticias_Judiciales*/
Disallow /Documentos_de_Interes/
Disallow /Actualidad_Jurisdiccional/
Disallow /Novelties/
Disallow /HCJ_Judicial_News_*/
Disallow /Documents_of_Interest/
Disallow /Nouveautes/
Disallow /Nouvelles_Judiciaires*/
Disallow /Documents_d_interet/
Disallow /Novetats/
Disallow /Noticies_Judicials_TSJ*/
Disallow /Interes_Dokumentuak/
Disallow /Berriak/
Disallow /*JANren_Auzi_Berriak/
Disallow /Novidades/
Disallow /Noticias_Xudicial*/
Disallow /Documentos_de_interese/
Disallow /stfls/SALA*DE*PRENSA/
Disallow /stfls/*/NOTAS*DE*PRENSA/
Disallow /stfls/*/*/NOTAS*DE*PRENSA/
Disallow /stfls/*/*/RESUMEN*DE*PRENSA/
Disallow /stfls/*/*/DOCUMENTOS*DE*INTERES/
Disallow /stfls/*/OTROS*DOCUMENTOS/
Disallow /stfls/*/*/OTROS*DOCUMENTOS/
Disallow /cgpj/es/Servicios/Atencion-Ciudadana/Comunicacion-de-organos-judiciales-y-otros-organismos-a-la-UAC/Comunicacion-de-organos-judiciales-y-otros-organismos-a-la-UAC
Disallow /cgpj/UAC-informes

Other Records

Field Value
crawl-delay 5

paperlibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

twitterbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

alexatoolbar

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

flipboardproxy

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2