Log In Sign Up

ya62.ru
robots.txt

Robots Exclusion Standard data for ya62.ru

Resource Scan

Scan Details

Site Domain ya62.ru
Base Domain ya62.ru
Scan Status Ok
Last Scan2024-11-14T23:24:16+00:00
Next Scan 2024-11-21T23:24:16+00:00

Last Scan

Scanned2024-11-14T23:24:16+00:00
URL https://ya62.ru/robots.txt
Domain IPs 104.21.37.96, 172.67.206.220, 2606:4700:3032::6815:2560, 2606:4700:3036::ac43:cedc
Response IP 172.67.206.220
Found Yes
Hash b060654b9d9e9aae1a70c2c44cea5dac5ad24b334b3a83496c47128524acd4a0
SimHash 000cd8c9871d

Groups

yandexdirect

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

zen_bot/2.0

Rule Path
Allow /rss_articles.php
Allow /rss_business.php
Allow /rss_news.php

yandexnews

Rule Path
Allow /rss_articles.php
Allow /rss_business.php
Allow /rss_news.php

*

Rule Path
Disallow /bitrix
Disallow /announcements/search
Disallow /job/search
Disallow /realty/search
Disallow /personal
Disallow /*action_id%3D
Disallow /*category_id%3D
Disallow /*PAGEN_1%3D
Disallow /*sort%3D
Disallow /*count_elem%3D
Disallow /*tags%3D
Disallow /*save%3D
Disallow /*print%3D
Disallow /*sphrase_id%3D
Disallow /*PAGEN_16%3D
Disallow *?
Disallow /search/
Disallow /news/ryazan/$
Allow /bitrix/js/
Allow /bitrix/css/
Allow /bitrix/cache/js/
Allow /bitrix/cache/css/
Allow /bitrix/templates/
Back to top

Other Records

Field Value
sitemap https://ya62.ru/sitemap.xml
Back to top