lookastic.de
robots.txt

Robots Exclusion Standard data for lookastic.de

Resource Scan

Scan Details

Site Domain lookastic.de
Base Domain lookastic.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T15:29:38+00:00
Next Scan 2024-12-07T15:29:38+00:00

Last Successful Scan

Scanned2024-02-12T15:23:48+00:00
URL https://lookastic.de/robots.txt
Domain IPs 52.2.87.70
Response IP 52.2.87.70
Found Yes
Hash aae29824b4d923abd574e9804dca93ffcc80222d68ecedf57a1094a33f2feabe
SimHash 773e9ed2cbf1

Groups

*

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join
Disallow /boys
Disallow /girls
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%BC%D0%B0%D0%BB%D1%8C%D1%87%D0%B8%D0%BA%D0%B8
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%B4%D0%B5%D0%B2%D0%BE%D1%87%D0%BA%D0%B8
Disallow /moda-infantil-ninos
Disallow /moda-infantil-ninas
Disallow /moda-ragazzi
Disallow /moda-ragazze
Disallow /mode-enfant-garcon
Disallow /mode-enfant-fille
Disallow /kindermode-jungen
Disallow /kindermode-maedchen

bingbot

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /