Log In Sign Up

dn.ru
robots.txt

Robots Exclusion Standard data for dn.ru

Resource Scan

Scan Details

Site Domain dn.ru
Base Domain dn.ru
Scan Status Ok
Last Scan2024-09-02T04:35:27+00:00
Next Scan 2024-10-02T04:35:27+00:00

Last Scan

Scanned2024-09-02T04:35:27+00:00
URL https://dn.ru/robots.txt
Domain IPs 51.250.55.100
Response IP 51.250.55.100
Found Yes
Hash bc82aebdb483fb20f0d8b63ac8b7fe324cb60c8924111f0ce15cff545c96ade9
SimHash ec53fc506733

Groups

bingbot
msnbot
megaindex.ru
megaindex.com
megaindex
ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 100

*

Rule Path
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow /*utm_source
Disallow /*?order
Disallow /cart
Disallow /compare/ids-*

yandex

Rule Path
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow /*utm_source
Disallow /*?order
Disallow /*?*fid
Disallow /*?*field_
Disallow /*?*o
Disallow /*?*%5B%5D*
Disallow /*?*utm_sour*
Disallow /*?*%5B%5D*
Disallow /*/result$
Disallow /cart
Disallow /compare/ids-*
Back to top

Other Records

Field Value
sitemap https://dn.ru/sitemap.xml
sitemap https://dn.ru/sitemap_collections_3921_.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top