vlex.es
robots.txt
Robots Exclusion Standard data for vlex.es
Resource Scan
Scan Details
Site Domain | vlex.es |
Base Domain | vlex.es |
Scan Status | Ok |
Last Scan | 2024-11-12T19:44:03+00:00 |
Next Scan | 2024-11-19T19:44:03+00:00 |
Last Scan
Scanned | 2024-11-12T19:44:03+00:00 |
URL | https://vlex.es/robots.txt |
Domain IPs | 108.157.254.32, 108.157.254.5, 108.157.254.69, 108.157.254.91 |
Response IP | 108.157.254.69 |
Found | Yes |
Hash | 6a0919b80ddd36ad89e8e55fe33e7ede9af182f21c2c705d974712ddabec1fa4 |
SimHash | b2de79094767 |
Groups
*
Rule | Path |
---|---|
Disallow | /tour |
Disallow | /redirect |
Disallow | /stats |
Disallow | /search |
Disallow | /account/login_ip |
Disallow | /account/check_if_logged?callback=jsonp* |
Disallow | /pdf/ |
Disallow | /*/search |
Disallow | /*/auto_complete_for_norma_citada |
Disallow | /*/auto_complete_for_voces_partes |
Disallow | /vid/1234$ |
Disallow | /vid/*ix_resultado* |
Disallow | /async |
Disallow | /*st_dominio |
Disallow | /*textolibre |
Disallow | /voces |
Disallow | /vid/*/translate?mt= |
Disallow | /checkout |
Disallow | /vid/*.json |
Disallow | /vid/*/content |
Disallow | /tags/*?format=pdf |
Disallow | /vid?*ix_resultado* |
Disallow | /source/*/*/thesaurus/starting_with |
Disallow | /corporate |
Disallow | /help_center |
Disallow | /for_publishers |
Disallow | /librarian_center |
Disallow | /offline_trials |
Disallow | /promos |
Disallow | /countries |
Disallow | /customers |
Disallow | /publisher |
Disallow | /languages |
Disallow | /freetrial_30 |
Disallow | /center-search* |
Disallow | /session_ip* |
Disallow | /session.json* |
Comments