lookastic.ru
robots.txt

Robots Exclusion Standard data for lookastic.ru

Resource Scan

Scan Details

Site Domain lookastic.ru
Base Domain lookastic.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-14T12:51:36+00:00
Next Scan 2024-11-28T12:51:36+00:00

Last Successful Scan

Scanned2024-10-30T12:50:55+00:00
URL https://lookastic.ru/robots.txt
Domain IPs 52.2.87.70
Response IP 52.2.87.70
Found Yes
Hash a0d37136e8d570d265752ea0eaf0628ce18b2ff52017c6310c582a96532bef57
SimHash 753e9e51ebf1

Groups

*

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join
Disallow /boys
Disallow /girls
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%BC%D0%B0%D0%BB%D1%8C%D1%87%D0%B8%D0%BA%D0%B8
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%B4%D0%B5%D0%B2%D0%BE%D1%87%D0%BA%D0%B8
Disallow /moda-infantil-ninos
Disallow /moda-infantil-ninas
Disallow /moda-ragazzi
Disallow /moda-ragazze
Disallow /mode-enfant-garcon
Disallow /mode-enfant-fille
Disallow /kindermode-jungen
Disallow /kindermode-maedchen

bingbot

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join

Other Records

Field Value
crawl-delay 60