hi-tech.mail.ru
robots.txt

Robots Exclusion Standard data for hi-tech.mail.ru

Resource Scan

Scan Details

Site Domain hi-tech.mail.ru
Base Domain mail.ru
Scan Status Ok
Last Scan2024-06-15T01:58:50+00:00
Next Scan 2024-06-22T01:58:50+00:00

Last Scan

Scanned2024-06-15T01:58:50+00:00
URL http://hi-tech.mail.ru/robots.txt
Redirect https://hi-tech.mail.ru/robots.txt
Domain IPs 5.61.236.40
Response IP 5.61.236.40
Found Yes
Hash 12b772a497a5d3c0d45374ed2e6adfa485f598be9450fbbeecfbe675cf548e8b
SimHash 38184043a9b9

Groups

*

Rule Path
Disallow /pajax/swap/
Disallow /preview/
Disallow /polls/
Disallow /informers/
Disallow /search/
Disallow /*/search/
Disallow /*?without_catalog=1
Disallow /couponRedirect
Disallow *?redirect=

yandex

Rule Path
Disallow /pajax/swap/
Disallow /preview/
Disallow /polls/
Disallow /informers/
Disallow /search/
Disallow /*/search/
Disallow /*?without_catalog=1
Disallow /couponRedirect
Disallow *?redirect=

googlebot

Rule Path
Disallow /pajax/swap/
Disallow /preview/
Disallow /polls/
Disallow /informers/
Disallow /search/
Disallow /*/search/
Disallow /*?without_catalog=1
Disallow /couponRedirect
Disallow *?redirect=

mail.ru

Rule Path
Allow /informers/

Other Records

Field Value
sitemap https://hi-tech.mail.ru/sitemap.xml
sitemap https://hi-tech.mail.ru/py-sitemap.xml
sitemap https://hi-tech.mail.ru/promocodes/sitemap.xml

Warnings

  • `clean-param` is not a known field.