gubernia.com
robots.txt

Robots Exclusion Standard data for gubernia.com

Resource Scan

Scan Details

Site Domain gubernia.com
Base Domain gubernia.com
Scan Status Ok
Last Scan2024-11-16T13:58:31+00:00
Next Scan 2024-11-23T13:58:31+00:00

Last Scan

Scanned2024-11-16T13:58:31+00:00
URL https://gubernia.com/robots.txt
Domain IPs 51.38.40.191, 51.89.41.11
Response IP 51.89.41.11
Found Yes
Hash 978d974070d6d2829b964620a7790f844e3fcb427d1afff88f17a810eca88854
SimHash e0260dc6e710

Groups

yandexnews

Rule Path
Allow /projects/yandex/news

Other Records

Field Value
crawl-delay 0.1

*

Rule Path
Disallow /_cron
Disallow /_news
Disallow /auto
Disallow /eat
Disallow /domovodstvo
Disallow /reference
Disallow /zhilkomkhoz
Disallow /mesto-proisshestviya/interview
Disallow /mesto-proisshestviya/rezonans
Disallow /community
Disallow /news/photo
Disallow /shkola-zdorovya
Disallow /dacha
Disallow /realty
Disallow /agreement
Disallow /api
Disallow /articles
Disallow /bitrix
Disallow /cgi-bin
Disallow /desktop_app
Disallow /events-calendar
Disallow /forum
Disallow /include
Disallow /information
Disallow /login
Disallow /nationalnews
Disallow /personal
Disallow /photo
Disallow /questions
Disallow /register
Disallow /search
Disallow /themes
Disallow /upload
Disallow /webstat
Disallow /announcements
Disallow /job
Disallow /news/city
Disallow /news/health
Disallow /news/incidents
Disallow /news/education
Disallow /news/incidents
Disallow /*?q
Disallow /*?clear_cache=Y
Disallow /*?auth_service_id
Disallow /*?count_elem
Disallow /*?sphrase_id
Disallow /*?print=y
Disallow /*?PAGEN
Disallow /afisha
Disallow /mesto-proisshestviya/proisshestviya/?*
Disallow /projects/wp-
Disallow */feed
Disallow /projects/search
Disallow /projects/xmlrpc.php
Disallow /projects/tag
Disallow /projects/category
Disallow /projects/archive
Disallow */trackback
Allow */uploads
Allow *.css
Allow *.js
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/panel/
Allow /projects/*
Allow /projects/feed/zen
Allow /projects/yandex/news

Other Records

Field Value
sitemap https://www.gubernia.com/sitemap.xml

Warnings

  • `host` is not a known field.