profile.ru
robots.txt

Robots Exclusion Standard data for profile.ru

Resource Scan

Scan Details

Site Domain profile.ru
Base Domain profile.ru
Scan Status Ok
Last Scan2024-11-12T11:57:24+00:00
Next Scan 2024-11-19T11:57:24+00:00

Last Scan

Scanned2024-11-12T11:57:24+00:00
URL https://profile.ru/robots.txt
Domain IPs 91.215.42.231
Response IP 91.215.42.231
Found Yes
Hash c6eafecb89e3b34400e3b848cb5d2b3d43e5e8028c18446b12abf69d3d1512f7
SimHash ef3983784de1

Groups

yandex

Rule Path
Disallow */amp/
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /sites/
Disallow /t3-assets/
Disallow /jaextmanager_data/
Disallow /ngx.txt
Disallow /tmp/
Disallow /index.php*
Disallow /index2.php*
Disallow */user/
Disallow */itemlist/
Disallow /wp-
Disallow /wp/
Disallow /search
Disallow /www/delivery/
Disallow /*embed
Disallow /events/
Disallow /*www.googletagmanager.com
Disallow /*counter.yadro.ru
Disallow /*www.google-analytics.com
Allow /images/
Allow */uploads

googlebot

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /sites/
Disallow /t3-assets/
Disallow /jaextmanager_data/
Disallow /ngx.txt
Disallow /tmp/
Disallow /index.php*
Disallow /index2.php*
Disallow */user/
Disallow */itemlist/
Disallow /wp-
Disallow /wp/
Disallow /search
Disallow /item/
Disallow /items/
Disallow /arkhiv/
Disallow /itemlist/
Disallow /rssfeed/
Disallow /www/delivery/
Disallow /*embed
Disallow /events/
Disallow /*www.googletagmanager.com
Disallow /*counter.yadro.ru
Disallow /*www.google-analytics.com
Allow /images/
Allow */uploads
Allow /wp-content/cache/autoptimize/
Allow /wp-content/themes/profile/assets/fonts/
Allow /wp-content/themes/profile/assets/img/

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /sites/
Disallow /t3-assets/
Disallow /jaextmanager_data/
Disallow /ngx.txt
Disallow /tmp/
Disallow /index.php*
Disallow /index2.php*
Disallow */user/
Disallow */itemlist/
Disallow /wp-
Disallow /wp/
Disallow /search
Disallow /www/delivery/
Disallow /*embed
Disallow /events/
Disallow /*www.googletagmanager.com
Disallow /*counter.yadro.ru
Disallow /*www.google-analytics.com
Allow /images/
Allow */uploads

yandexnews

Rule Path
Allow /rss/news/

twitterbot

Rule Path
Allow /media/

Other Records

Field Value
sitemap https://profile.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.