Log In Sign Up

lubystok.shop
robots.txt

Robots Exclusion Standard data for lubystok.shop

Resource Scan

Scan Details

Site Domain lubystok.shop
Base Domain lubystok.shop
Scan Status Ok
Last Scan2024-11-06T12:10:46+00:00
Next Scan 2024-12-06T12:10:46+00:00

Last Scan

Scanned2024-11-06T12:10:46+00:00
URL https://lubystok.shop/robots.txt
Domain IPs 185.68.16.207, 2a00:7a60:0:10cf::1
Response IP 185.68.16.207
Found Yes
Hash 7cdc9d6c302896b9fc9f1c8815ab18da6c234d013a4424a47eb8cce65e331372
SimHash da5bfc5e6d73

Groups

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

httrack

Rule Path
Disallow /

*

Rule Path
Disallow */order
Disallow */order/*
Disallow */search/*
Disallow */search-box/*
Disallow */feedback/*
Disallow */callback/*
Disallow */product-review/*
Disallow */viewed-products/*
Disallow */cart/*
Disallow */artisan/*
Disallow */fast-order/*
Disallow */service-order/*
Disallow /erp-1c/*
Disallow */auth/*
Disallow */profile/*
Disallow /order/thanks/*
Disallow /order/payment-callback/*
Disallow /rozetka.xml
Disallow */google-merchant.xml
Back to top

Other Records

Field Value
sitemap https://lubystok.shop/sitemap.xml
sitemap https://lubystok.shop/sitemap-images.xml
Back to top