bkgrupe.lt
robots.txt
Robots Exclusion Standard data for bkgrupe.lt
Resource Scan
Scan Details
Site Domain | bkgrupe.lt |
Base Domain | bkgrupe.lt |
Scan Status | Ok |
Last Scan | 2024-04-25T18:28:18+00:00 |
Next Scan | 2024-05-25T18:28:18+00:00 |
Last Scan
Scanned | 2024-04-25T18:28:18+00:00 |
URL | https://bkgrupe.lt/robots.txt |
Domain IPs | 104.26.14.70, 104.26.15.70, 172.67.68.41, 2606:4700:20::681a:e46, 2606:4700:20::681a:f46, 2606:4700:20::ac43:4429 |
Response IP | 104.26.14.70 |
Found | Yes |
Hash | b2d7a87c744144ccb011e6a8c69c204dcf19859d80bbc941a6366b1f06c08347 |
SimHash | 4914d8144741 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /en/cartquickpro/* |
Disallow | /lt/cartquickpro/* |
Disallow | /cartquickpro/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |