vdu.lt
robots.txt

Robots Exclusion Standard data for vdu.lt

Resource Scan

Scan Details

Site Domain vdu.lt
Base Domain vdu.lt
Scan Status Ok
Last Scan2025-12-26T21:36:17+00:00
Next Scan 2026-01-25T21:36:17+00:00

Last Scan

Scanned2025-12-26T21:36:17+00:00
URL https://vdu.lt/robots.txt
Redirect https://www.vdu.lt/robots.txt
Redirect Domain www.vdu.lt
Redirect Base vdu.lt
Domain IPs 158.129.51.79
Redirect IPs 158.129.51.79
Response IP 158.129.51.79
Found Yes
Hash da7d42b0f319d5cba94b49dd81ee1e09040c6b9b80ceb1060ac198e589f0af3f
SimHash e0d949c0cff7

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /cris/search
Disallow /cris/admin/*
Disallow /cris/processes
Disallow /cris/submit
Disallow /cris/workspaceitems
Disallow /cris/profile
Disallow /cris/workflowitems
Disallow /cris/browse/*
Disallow /cris/statistics
Disallow /cris/contact
Disallow /cris/feedback
Disallow /cris/forgot
Disallow /cris/login
Disallow /cris/register

mediapartners-google*

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fast

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vdu.lt/sitemap.xml
sitemap https://www.vdu.lt/cris/sitemap_index.xml