Log In Sign Up

lady.mail.ru
robots.txt

Robots Exclusion Standard data for lady.mail.ru

Resource Scan

Scan Details

Site Domain lady.mail.ru
Base Domain mail.ru
Scan Status Ok
Last Scan2024-09-21T07:25:28+00:00
Next Scan 2024-10-21T07:25:28+00:00

Last Scan

Scanned2024-09-21T07:25:28+00:00
URL https://lady.mail.ru/robots.txt
Domain IPs 5.61.236.101
Response IP 5.61.236.101
Found Yes
Hash 88d5cdb052c5ee052a161be9a62527cfab14c09787fb33e629c3e97ab3cc4b2d
SimHash 6c9cd844a117

Groups

*

Rule Path
Disallow /api/article/
Disallow /*preview%3D
Disallow /*/search/
Disallow /*sort%3D
Disallow /redirect/
Disallow /search/

yandex

Rule Path
Disallow /api/article/
Disallow /*preview%3D
Disallow /*/search/
Disallow /*sort%3D
Disallow /redirect/
Disallow /search/

googlebot

Rule Path
Disallow /api/article/
Disallow /*preview%3D
Disallow /*/search/
Disallow /*sort%3D
Disallow /redirect/
Disallow /search/
Back to top

Other Records

Field Value
sitemap https://lady.mail.ru/export/sitemap/sitemap.xml
sitemap https://lady.mail.ru/forum/sitemap/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top