lemberg.uk
robots.txt

Robots Exclusion Standard data for lemberg.uk

Resource Scan

Scan Details

Site Domain lemberg.uk
Base Domain lemberg.uk
Scan Status Ok
Last Scan2024-06-03T23:19:10+00:00
Next Scan 2024-07-03T23:19:10+00:00

Last Scan

Scanned2024-06-03T23:19:10+00:00
URL https://lemberg.uk/robots.txt
Domain IPs 104.26.14.90, 104.26.15.90, 172.67.68.164, 2606:4700:20::681a:e5a, 2606:4700:20::681a:f5a, 2606:4700:20::ac43:44a4
Response IP 172.67.68.164
Found Yes
Hash 6b0c5ab018c751f6228835f2bea4c88f293c3955efe9b6b29a661f72fda5f12c
SimHash 103dc0d28fbb

Groups

*

Rule Path
Disallow */account/
Disallow */result/
Disallow */listAjax/
Disallow *?cat=
Disallow */login/

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lemberg.uk/sitemap.xml