Log In Sign Up

mkset.ru
robots.txt

Robots Exclusion Standard data for mkset.ru

Resource Scan

Scan Details

Site Domain mkset.ru
Base Domain mkset.ru
Scan Status Ok
Last Scan2024-09-21T04:27:44+00:00
Next Scan 2024-09-28T04:27:44+00:00

Last Scan

Scanned2024-09-21T04:27:44+00:00
URL https://mkset.ru/robots.txt
Domain IPs 104.21.16.4, 172.67.165.161, 2606:4700:3031::6815:1004, 2606:4700:3034::ac43:a5a1
Response IP 104.21.16.4
Found Yes
Hash 07ed051b5891a9cfbef42f81d9f451fb80135db5518d28fdb68cae96ac00ac8e
SimHash 67a118419191

Groups

yandexnews

Rule Path
Allow /rss

*

Rule Path
Disallow /search?q=*
Disallow /?*
Disallow */preview
Disallow /admin

yandex

Rule Path
Disallow /search?q=*
Disallow */*?amp=*
Disallow /?*
Disallow */preview
Disallow /admin

googlebot

Rule Path
Disallow /search?q=*
Disallow /?*
Disallow */preview
Disallow /admin
Back to top

Other Records

Field Value
sitemap https://mkset.ru/sitemap.xml
sitemap https://mkset.ru/images_sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top