lookastic.co.uk
robots.txt

Robots Exclusion Standard data for lookastic.co.uk

Resource Scan

Scan Details

Site Domain lookastic.co.uk
Base Domain lookastic.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T15:04:22+00:00
Next Scan 2024-12-07T15:04:22+00:00

Last Successful Scan

Scanned2024-05-12T12:08:01+00:00
URL http://lookastic.co.uk/robots.txt
Redirect https://lookastic.com/robots.txt
Redirect Domain lookastic.com
Redirect Base lookastic.com
Domain IPs 52.2.87.70
Redirect IPs 52.2.87.70
Response IP 52.2.87.70
Found Yes
Hash aae29824b4d923abd574e9804dca93ffcc80222d68ecedf57a1094a33f2feabe
SimHash 773e9ed2cbf1

Groups

*

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join
Disallow /boys
Disallow /girls
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%BC%D0%B0%D0%BB%D1%8C%D1%87%D0%B8%D0%BA%D0%B8
Disallow /%D0%B4%D0%B5%D1%82%D1%81%D0%BA%D0%B0%D1%8F-%D0%BC%D0%BE%D0%B4%D0%B0-%D0%B4%D0%B5%D0%B2%D0%BE%D1%87%D0%BA%D0%B8
Disallow /moda-infantil-ninos
Disallow /moda-infantil-ninas
Disallow /moda-ragazzi
Disallow /moda-ragazze
Disallow /mode-enfant-garcon
Disallow /mode-enfant-fille
Disallow /kindermode-jungen
Disallow /kindermode-maedchen

bingbot

Rule Path
Disallow /*/shop_items/*/redirect
Disallow /join

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /