presvika.lt
robots.txt

Robots Exclusion Standard data for presvika.lt

Resource Scan

Scan Details

Site Domain presvika.lt
Base Domain presvika.lt
Scan Status Ok
Last Scan2026-01-20T11:40:09+00:00
Next Scan 2026-02-19T11:40:09+00:00

Last Scan

Scanned2026-01-20T11:40:09+00:00
URL https://presvika.lt/robots.txt
Redirect https://www.presvika.lt/robots.txt
Redirect Domain www.presvika.lt
Redirect Base presvika.lt
Domain IPs 212.237.232.190
Redirect IPs 212.237.232.190
Response IP 212.237.232.190
Found Yes
Hash 95c579f09d8aac74e388878b2f471af30cfae413661d6723a4f9ee7a30082027
SimHash e514da62cab5

Groups

*

Rule Path
Disallow /external/
Disallow /*/external/
Disallow /goods/marked_set
Disallow /*/goods/marked_set
Disallow /goods/marked
Disallow /*/goods/marked
Disallow /goods/marked_get
Disallow /*/goods/marked_get
Disallow /goods/marked_delete
Disallow /*/goods/marked_delete
Disallow /goods/get_price_option
Disallow /*/goods/get_price_option
Allow /

Other Records

Field Value
crawl-delay 15

Warnings

  • 2 invalid lines.