burte.lt
robots.txt

Robots Exclusion Standard data for burte.lt

Resource Scan

Scan Details

Site Domain burte.lt
Base Domain burte.lt
Scan Status Ok
Last Scan2026-01-21T21:47:58+00:00
Next Scan 2026-02-20T21:47:58+00:00

Last Scan

Scanned2026-01-21T21:47:58+00:00
URL https://burte.lt/robots.txt
Redirect https://www.burte.lt/robots.txt
Redirect Domain www.burte.lt
Redirect Base burte.lt
Domain IPs 79.98.28.97
Redirect IPs 79.98.28.97
Response IP 79.98.28.97
Found Yes
Hash 9b53db1af380e3df69bfd842a5f7a8ab73f402988ffb79038dbd8a34f267c652
SimHash a55c4a31c552

Groups

*

Rule Path
Disallow /external/
Disallow /*/external/
Disallow /goods/marked_set
Disallow /*/goods/marked_set
Disallow /goods/marked
Disallow /*/goods/marked
Disallow /goods/marked_get
Disallow /*/goods/marked_get
Disallow /goods/marked_delete
Disallow /*/goods/marked_delete
Disallow /goods/category_goods_main
Disallow /*/goods/category_goods_main
Disallow /goods/promotion_goods
Disallow /*/goods/promotion_goods
Disallow /goods/new_goods
Disallow /*/goods/new_goods
Disallow /goods/top_goods
Disallow /*/goods/top_goods
Allow /

Other Records

Field Value
sitemap https://www.burte.lt/sitemap.xml

Warnings

  • 2 invalid lines.