Log In Sign Up

blog.naumen.ru
robots.txt

Robots Exclusion Standard data for blog.naumen.ru

Resource Scan

Scan Details

Site Domain blog.naumen.ru
Base Domain naumen.ru
Scan Status Ok
Last Scan2024-05-31T04:54:10+00:00
Next Scan 2024-06-30T04:54:10+00:00

Last Scan

Scanned2024-05-31T04:54:10+00:00
URL https://blog.naumen.ru/robots.txt
Domain IPs 151.101.131.7, 151.101.195.7, 151.101.3.7, 151.101.67.7, 2a04:4e42:200::775, 2a04:4e42:400::775, 2a04:4e42:600::775, 2a04:4e42::775
Response IP 199.232.47.7
Found Yes
Hash 1c0bef860bd617ec5c23aece96e4a9c7d2906433987cd6e909de315bd184dd35
SimHash 2031bb509393

Groups

*

Rule Path
Allow /
Disallow /*utm*%3D
Disallow /?_gl=
Disallow /*_gl%3D
Disallow /*_etext*
Disallow /comment/
Disallow /search/
Disallow /rss/
Disallow /*.gz/
Disallow /thanks/
Disallow /users/
Disallow /page/
Disallow /newsletter/

yandex

Rule Path
Disallow /?_gl=
Disallow /*_gl%3D
Disallow /*_etext*
Disallow /?*
Disallow /users/
Disallow */feed
Disallow */rss
Disallow /page/
Disallow /newsletter/
Allow */uploads
Allow /*/*.js
Allow /*/*.css

googlebot

Rule Path
Disallow /page/
Disallow /newsletter/
Disallow /cgi-bin
Disallow /?_gl=
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /thanks/
Disallow *utm*%3D
Disallow *openstat%3D
Allow */uploads
Allow /*/*.js
Allow /*/*.css

adsbot-google

Rule Path
Allow /

adsbot mobile web android

Rule Path
Allow /

adsbot mobile web

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://blog.naumen.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top