regionsamara.ru
robots.txt

Robots Exclusion Standard data for regionsamara.ru

Resource Scan

Scan Details

Site Domain regionsamara.ru
Base Domain regionsamara.ru
Scan Status Ok
Last Scan2024-10-03T17:59:44+00:00
Next Scan 2024-10-10T17:59:44+00:00

Last Scan

Scanned2024-10-03T17:59:44+00:00
URL https://regionsamara.ru/robots.txt
Domain IPs 80.78.243.103
Response IP 80.78.243.103
Found Yes
Hash 0505a01130abf2e6666603c2810e44a52a82b6e5cde08d84b4c3615dc3e5c10e
SimHash 4c6ccc905dd6

Groups

*

Rule Path
Disallow /*?
Disallow /*.doc
Disallow /*.docx
Disallow /*.pdf
Disallow /*.xls
Disallow /*.xlsx
Disallow /*.swf
Disallow /*/feed
Disallow /*/rss
Disallow /wp-admin/
Disallow /tag/
Disallow /uploads/bikini_rules.html
Disallow /https%3A//regionsamara.ru/news/205836-test/
Disallow /https%3A//regionsamara.ru/news/205836-test.html/
Allow /wp-content/themes/exclusive-sr/*
Allow /wp-content/plugins/*

yandex

Rule Path
Disallow /*?
Disallow /*.doc
Disallow /*.docx
Disallow /*.pdf
Disallow /*.xls
Disallow /*.xlsx
Disallow /*.swf
Disallow /*/feed
Disallow /*/rss
Disallow /wp-admin/
Disallow /tag/
Disallow /uploads/bikini_rules.html
Disallow /https%3A//regionsamara.ru/news/205836-test/
Disallow /https%3A//regionsamara.ru/news/205836-test.html/
Disallow */amp/
Allow /yandex/news/
Allow /?yandex_feed=news

googlebot

Rule Path
Disallow /*?
Disallow /*.doc
Disallow /*.docx
Disallow /*.pdf
Disallow /*.xls
Disallow /*.xlsx
Disallow /*.swf
Disallow /*/feed
Disallow /*/rss
Disallow /wp-admin/
Disallow /tag/
Disallow /uploads/bikini_rules.html
Disallow /https%3A//regionsamara.ru/news/205836-test/
Disallow /https%3A//regionsamara.ru/news/205836-test.html/
Allow /?google_feed=news
Allow /rss/rssfeed
Allow /rss/rssfeed.xml

Other Records

Field Value
sitemap https://regionsamara.ru/sitemap_index.xml

Warnings

  • `host` is not a known field.