pitersmoke.ru
robots.txt

Robots Exclusion Standard data for pitersmoke.ru

Resource Scan

Scan Details

Site Domain pitersmoke.ru
Base Domain pitersmoke.ru
Scan Status Ok
Last Scan2024-05-12T15:23:13+00:00
Next Scan 2024-06-11T15:23:13+00:00

Last Scan

Scanned2024-05-12T15:23:13+00:00
URL https://pitersmoke.ru/robots.txt
Domain IPs 104.26.12.25, 104.26.13.25, 172.67.75.68, 2606:4700:20::681a:c19, 2606:4700:20::681a:d19, 2606:4700:20::ac43:4b44
Response IP 172.67.75.68
Found Yes
Hash ba0815ca4d45f40b140f4449d5eda26bcbee0c798a7722a5b2dc7c4076f486bc
SimHash 010754726fb1

Groups

geedobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /my/
Disallow /checkout/
Disallow /my/
Disallow /checkout/
Disallow /1*
Disallow /2*
Disallow /3*
Disallow /4*
Disallow /5*
Disallow /6*
Disallow /7*
Disallow /8*
Disallow /9*
Disallow /test/my/
Disallow /test/checkout/
Disallow */search/?query=
Disallow *v-polnoy-komplektatsii*
Disallow *?sort*
Disallow */?*
Disallow *?rid=*
Disallow */search/*
Disallow */mailer/*
Disallow */compare/
Disallow */tag/
Disallow *%26sort%3D
Disallow */?sort=
Disallow */cart/
Disallow */order/
Disallow */checkout/
Disallow */my/
Disallow */signup/
Disallow */login/
Disallow */forgotpassword/
Disallow */webasyst/
Disallow */reviews/
Disallow */tovary-so-skidkoy/
Disallow */kalyany-best-offer/
Disallow */chashi-best-offer/
Disallow */komplektuyushchie-best-offer/
Allow *.js*
Allow *.css*
Allow *.png*
Allow *.jpg*

Other Records

Field Value
sitemap https://pitersmoke.ru/sitemap-shop.xml

Comments

  • wa shop *
  • wa shop
  • wa shop *
  • wa shop
  • wa shop test/*
  • wa shop

Warnings

  • `host` is not a known field.