zemakaina.lt
robots.txt

Robots Exclusion Standard data for zemakaina.lt

Resource Scan

Scan Details

Site Domain zemakaina.lt
Base Domain zemakaina.lt
Scan Status Ok
Last Scan2025-09-20T23:35:47+00:00
Next Scan 2025-10-20T23:35:47+00:00

Last Scan

Scanned2025-09-20T23:35:47+00:00
URL https://zemakaina.lt/robots.txt
Redirect https://www.zemakaina.lt/robots.txt
Redirect Domain www.zemakaina.lt
Redirect Base zemakaina.lt
Domain IPs 104.21.75.234, 172.67.183.124, 2606:4700:3035::6815:4bea, 2606:4700:3035::ac43:b77c
Redirect IPs 104.21.75.234, 172.67.183.124, 2606:4700:3035::6815:4bea, 2606:4700:3035::ac43:b77c
Response IP 104.21.75.234
Found Yes
Hash 3b8ee1cab2e25953a7505a7ac468c109ec9f059a1e10c86ca0020afdd3ca27c0
SimHash e51c5a71c2b3

Groups

*

Rule Path
Disallow /external/
Disallow /*/external/
Disallow /goods/marked_set
Disallow /*/goods/marked_set
Disallow /goods/marked
Disallow /*/goods/marked
Disallow /goods/marked_get
Disallow /*/goods/marked_get
Disallow /goods/marked_delete
Disallow /*/goods/marked_delete
Disallow /goods/category_goods_main
Disallow /*/goods/category_goods_main
Disallow /goods/promotion_goods
Disallow /*/goods/promotion_goods
Disallow /goods/new_goods
Disallow /*/goods/new_goods
Disallow /goods/top_goods
Disallow /*/goods/top_goods
Allow /

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.zemakaina.lt/sitemap.xml

Warnings

  • 2 invalid lines.