noticias.juridicas.com
robots.txt

Robots Exclusion Standard data for noticias.juridicas.com

Resource Scan

Scan Details

Site Domain noticias.juridicas.com
Base Domain juridicas.com
Scan Status Ok
Last Scan2024-10-24T03:07:18+00:00
Next Scan 2024-11-23T03:07:18+00:00

Last Scan

Scanned2024-10-24T03:07:18+00:00
URL https://noticias.juridicas.com/robots.txt
Domain IPs 137.117.159.91
Response IP 137.117.159.91
Found Yes
Hash 735c36a225f12b0563a77c0f92ee07d71f7628bb4f041cb3ddffa96640b4e714
SimHash 09825cc009b1

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path Comment
Disallow /base_datos/Anterior -
Disallow /base_datos/anterior -
Disallow /base_datos/al -
Disallow /base_datos/busca-db-leg.php -
Disallow /links -
Disallow /sys -
Disallow /bitmaps -
Disallow /backend -
Disallow /info -
Disallow /flash -
Disallow /include -
Disallow /admin -
Disallow /sentencias -
Disallow /html -
Disallow /main/ -
Disallow /eyeblaster /eyeblaster/addineyeV2.html necesario para cierta publicidad
Allow /bitmaps/articulos/ -

Other Records

Field Value
crawl-delay 20

httrack
webcopier

Rule Path
Disallow /

twitterbot

Rule Path
Disallow *
Allow /bitmaps
Allow /bitmaps/articulos
Allow /bitmaps/articulos/

Other Records

Field Value
sitemap https://noticias.juridicas.com/sitemap_index.xml