farmazakaz.ru
robots.txt

Robots Exclusion Standard data for farmazakaz.ru

Resource Scan

Scan Details

Site Domain farmazakaz.ru
Base Domain farmazakaz.ru
Scan Status Ok
Last Scan2024-11-18T00:13:23+00:00
Next Scan 2024-12-18T00:13:23+00:00

Last Scan

Scanned2024-11-18T00:13:23+00:00
URL https://farmazakaz.ru/robots.txt
Domain IPs 62.109.15.69
Response IP 62.109.15.69
Found Yes
Hash 2b0f640be02bafe910331ebeba018a06c08b8c3c3a91ce6096fdfabdc1103b2b
SimHash 4638cff3e610

Groups

*

Rule Path
Disallow /bitrix/
Disallow /personal/
Disallow /search/
Disallow */compare*
Disallow /*?
Disallow /*.js
Disallow /*.css
Disallow /*.php
Disallow /*.html
Disallow /services/
Disallow /staff/
Disallow /projects/
Disallow */apply/
Disallow */clear/
Disallow /*?PAGEN_*PAGEN_
Disallow /*?PAGEN_1=*&
Allow /*?PAGEN_1=

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://farmazakaz.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.