selector-top.ru
robots.txt

Robots Exclusion Standard data for selector-top.ru

Resource Scan

Scan Details

Site Domain selector-top.ru
Base Domain selector-top.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-27T01:39:33+00:00
Next Scan 2026-04-27T01:39:33+00:00

Last Successful Scan

Scanned2023-09-17T22:48:00+00:00
URL https://selector-top.ru/robots.txt
Redirect http://selector-top.ru/robots.txt
Domain IPs 104.21.61.194, 172.67.213.89, 2606:4700:3031::ac43:d559, 2606:4700:3032::6815:3dc2
Response IP 172.67.213.89
Found Yes
Hash db1a8bfd6009a1b8eff1ee9a011f07f4d6f89e689707061fba7de8159197afcd
SimHash 8a09d8218b23

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /category/novosti/page/2/
Disallow /wp-json/
Disallow /selector/official.php
Disallow /feed/
Disallow /403.html

yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://selector-top.ru/sitemap.xml