Log In Sign Up

m.woman.ru
robots.txt

Robots Exclusion Standard data for m.woman.ru

Resource Scan

Scan Details

Site Domain m.woman.ru
Base Domain woman.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-11T04:05:05+00:00
Next Scan 2025-01-09T04:05:05+00:00

Last Successful Scan

Scanned2022-08-30T12:47:14+00:00
URL http://m.woman.ru/robots.txt
Response IP 212.193.163.212
Found Yes
Hash 5a64f404d2a673e6212204cb3a3df221961537c2fad2eb965e017a9632059ff8
SimHash 2f509143c137

Groups

anews/1.0

Rule Path
Allow /rss/?src=anews_ns

yandexnews

Rule Path
Allow /rss/?src=woman

yandex

Rule Path
Disallow /preview/
Disallow /api/
Disallow /forum/ajax/
Disallow /ajax/
Disallow /comps/
Disallow /error/
Disallow /mailer/confirm.html
Disallow /s/
Disallow *sort%3D1d
Disallow *sort%3D3d
Disallow *sort%3D7d
Disallow *sort%3D30d
Disallow /*filter%3D3h
Disallow /*filter%3D12h
Disallow /*filter%3D1d
Disallow /*filter%3D7d
Disallow /*search
Disallow /*filter%3Dall
Disallow *?quote
Disallow */comments/1/
Disallow */message/*
Disallow *?photo=
Disallow */comments/*?startLeaflet
Disallow */page42
Disallow /fatalerrortest
Disallow /testfullscreen
Disallow /site/
Disallow /main_new
Disallow /main_old
Disallow /redirect
Disallow *?*openstat
Disallow /user/*
Disallow *?sort=user
Disallow /?*previewToken=
Disallow /?*openGallery=

googlebot

Rule Path
Disallow /preview/
Disallow /api/
Disallow /ajax/
Disallow /forum/ajax/
Disallow /comps/
Disallow /error/
Disallow /mailer/confirm.html
Disallow /s/
Disallow *sort%3D1d
Disallow *sort%3D3d
Disallow *sort%3D7d
Disallow *sort%3D30d
Disallow /*filter%3D3h
Disallow /*filter%3D12h
Disallow /*filter%3D1d
Disallow /*filter%3D7d
Disallow /*search
Disallow /*filter%3Dall
Disallow *?quote
Disallow */comments/1/
Disallow */message/*
Disallow */comments/*?startLeaflet
Disallow *?photo=
Disallow */page42
Disallow /fatalerrortest
Disallow /testfullscreen
Disallow /site/
Disallow /main_new
Disallow /main_old
Disallow /redirect
Disallow *?*utm_
Disallow *?*openstat
Disallow /user/*
Disallow *?sort=user
Disallow /?*previewToken=
Disallow /?*openGallery=

mail.ru

Rule Path
Disallow /preview/
Disallow /api/
Disallow /ajax/
Disallow /forum/ajax/
Disallow /comps/
Disallow /error/
Disallow /mailer/confirm.html
Disallow /s/
Disallow *sort%3D1d
Disallow *sort%3D3d
Disallow *sort%3D7d
Disallow *sort%3D30d
Disallow /*filter%3D3h
Disallow /*filter%3D12h
Disallow /*filter%3D1d
Disallow /*filter%3D7d
Disallow /*search
Disallow /*filter%3Dall
Disallow *?quote
Disallow */comments/1/
Disallow */message/*
Disallow *?photo=
Disallow */comments/*?startLeaflet
Disallow */page42
Disallow /fatalerrortest
Disallow /testfullscreen
Disallow /site/
Disallow /main_new
Disallow /main_old
Disallow /redirect
Disallow *?*utm_
Disallow *?*openstat
Disallow /user/*
Disallow *?sort=user
Disallow /?*previewToken=
Disallow /?*openGallery=

*

Rule Path
Disallow /preview/
Disallow /api/
Disallow /ajax/
Disallow /forum/ajax/
Disallow /comps/
Disallow /error/
Disallow /mailer/confirm.html
Disallow /s/
Disallow *?sort=1d
Disallow *?sort=3d
Disallow *?sort=7d
Disallow *?sort=30d
Disallow /*filter%3Dall
Disallow *?quote
Disallow */comments/1/
Disallow */message/*
Disallow */page42
Disallow /fatalerrortest
Disallow /testfullscreen
Disallow /site/
Disallow /main_new
Disallow /main_old
Disallow /redirect
Disallow *?*utm_
Disallow *?*openstat
Disallow /user/*
Disallow *?sort=user
Disallow /?*previewToken=
Disallow /?*openGallery=
Disallow /categories/*
Back to top

Other Records

Field Value
sitemap http://www.woman.ru/sitemap_index.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top