autodoc.ru
robots.txt

Robots Exclusion Standard data for autodoc.ru

Resource Scan

Scan Details

Site Domain autodoc.ru
Base Domain autodoc.ru
Scan Status Ok
Last Scan2025-11-17T19:55:12+00:00
Next Scan 2025-12-01T19:55:12+00:00

Last Scan

Scanned2025-11-17T19:55:12+00:00
URL https://autodoc.ru/robots.txt
Redirect https://www.autodoc.ru/robots.txt
Redirect Domain www.autodoc.ru
Redirect Base autodoc.ru
Domain IPs 37.230.209.80
Redirect IPs 37.230.209.80
Response IP 37.230.209.80
Found Yes
Hash 98ab09b2d3087cd83d9c528c7b1d080260501d735027a7592d3b36d545472531
SimHash e17e5d438e37

Groups

*

Rule Path
Disallow /my/*
Disallow /Account/*
Disallow /account/*
Disallow /cart
Disallow /price/*
Disallow /?*
Disallow *?*
Disallow *.htm
Disallow *.aspx
Disallow /company/shops/145
Disallow /company/shops/492
Disallow /company/shops/595
Disallow /catalogs/to/*
Disallow *list-nodes*
Disallow *modifications*
Allow *?page=
Allow *?categoryId=
Allow *?tab=reviews

riddler (http://riddler.io/about)

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.autodoc.ru/sitemap/ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.