priejuros.lt
robots.txt

Robots Exclusion Standard data for priejuros.lt

Resource Scan

Scan Details

Site Domain priejuros.lt
Base Domain priejuros.lt
Scan Status Ok
Last Scan2024-11-13T04:57:35+00:00
Next Scan 2024-11-20T04:57:35+00:00

Last Scan

Scanned2024-11-13T04:57:35+00:00
URL https://priejuros.lt/robots.txt
Redirect https://www.priejuros.lt/robots.txt
Redirect Domain www.priejuros.lt
Redirect Base priejuros.lt
Domain IPs 79.98.28.145
Redirect IPs 79.98.28.145
Response IP 79.98.28.145
Found Yes
Hash 162342e6b583595a6caa4ccb71c40abe1c90c22e31b2cdff81757c0ed7005ec4
SimHash 2a42c9528993

Groups

*

Rule Path
Disallow /partner/
Disallow /turai/
Disallow /inc/
Disallow /lib/
Disallow /js/
Disallow /css/
Disallow /saskaita/
Disallow /ajax/
Disallow /lt/map/
Disallow /en/map/
Disallow /ru/map/
Disallow /de/map/
Disallow /pl/map/
Disallow /lv/map/
Disallow /lt/paieska/*
Disallow /room-map.php
Disallow *?resorts*
Disallow *yravietu%3D*
Disallow *q%3D*
Disallow *sort%3D*
Allow /lt/paieska/hello%2Bsea%2Bhomes/
Allow /lt/paieska/poilsis%2Bpalangoje%2Bkunigi%C3%85%C2%A1kiuose%2Btavo%2Bvasara/

googlebot

Rule Path
Disallow /partner/
Disallow /turai/
Disallow /inc/
Disallow /saskaita/
Disallow /lt/map/
Disallow /en/map/
Disallow /ru/map/
Disallow /de/map/
Disallow /pl/map/
Disallow /lv/map/
Disallow /room-map.php
Allow /

msnbot

Rule Path
Disallow /partner/
Disallow /turai/
Disallow /inc/
Disallow /saskaita/
Disallow /lt/map/
Disallow /en/map/
Disallow /ru/map/
Disallow /de/map/
Disallow /pl/map/
Disallow /lv/map/
Disallow /room-map.php
Allow /

Other Records

Field Value
crawl-delay 30

slurp

Rule Path
Disallow /partner/
Disallow /turai/
Disallow /inc/
Disallow /saskaita/
Disallow /lt/map/
Disallow /en/map/
Disallow /ru/map/
Disallow /de/map/
Disallow /pl/map/
Disallow /lv/map/
Disallow /room-map.php
Allow /

Other Records

Field Value
crawl-delay 30

yandexbot

Rule Path
Disallow /partner/
Disallow /turai/
Disallow /inc/
Disallow /saskaita/
Disallow /lt/map/
Disallow /en/map/
Disallow /ru/map/
Disallow /de/map/
Disallow /pl/map/
Disallow /lv/map/
Disallow /room-map.php
Disallow /de/

Other Records

Field Value
crawl-delay 30

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.priejuros.lt/sitemap.xml