ivd.ru
robots.txt

Robots Exclusion Standard data for ivd.ru

Resource Scan

Scan Details

Site Domain ivd.ru
Base Domain ivd.ru
Scan Status Ok
Last Scan2024-09-20T05:59:26+00:00
Next Scan 2024-09-27T05:59:26+00:00

Last Scan

Scanned2024-09-20T05:59:26+00:00
URL https://ivd.ru/robots.txt
Redirect https://www.ivd.ru/robots.txt
Redirect Domain www.ivd.ru
Redirect Base ivd.ru
Domain IPs 31.184.213.35
Redirect IPs 31.184.213.35
Response IP 31.184.213.35
Found Yes
Hash dbc8c4013a69a2401cafd62c124ad8d0839cb8e5a77a082cdc532c19eae99b9c
SimHash d08059e6ab0b

Groups

*

Rule Path
Disallow /bannertest
Disallow /bannertest2
Disallow */search*
Disallow *noindex%3Dtrue*
Disallow /*?char
Disallow /shop/search?
Disallow /shop/*?page=
Disallow /shop/*
Disallow *?image=*
Disallow /?*
Disallow *.xgi
Disallow /*/news
Disallow /site/*
Disallow *%26per-page%3D*
Disallow /advertising
Disallow /adv
Disallow /registration
Disallow /login
Disallow /about
Disallow /password-reset-request

Other Records

Field Value
sitemap https://www.ivd.ru/out/sitemap/sitemap.xml

Warnings

  • `clean-param` is not a known field.