compbasic.ru
robots.txt

Robots Exclusion Standard data for compbasic.ru

Resource Scan

Scan Details

Site Domain compbasic.ru
Base Domain compbasic.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-21T21:27:58+00:00
Next Scan 2026-03-22T21:27:58+00:00

Last Successful Scan

Scanned2025-11-23T03:42:58+00:00
URL https://compbasic.ru/robots.txt
Domain IPs 104.21.2.155, 172.67.129.90, 2606:4700:3031::6815:29b, 2606:4700:3031::ac43:815a
Response IP 172.67.129.90
Found Yes
Hash cbbd2670e44bdd411592196926a52e3ad6d25f929acec61355b53e65871f51ba
SimHash 7d0095ce8d90

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-activate.php
Disallow /wp-app.php
Disallow /wp-atom.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-commentsrss2.php
Disallow /wp-config-sample.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-feed.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-pass.php
Disallow /wp-rdf.php
Disallow /wp-register.php
Disallow /wp-rss.php
Disallow /wp-rss2.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php

googlebot

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-activate.php
Disallow /wp-app.php
Disallow /wp-atom.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-commentsrss2.php
Disallow /wp-config-sample.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-feed.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-pass.php
Disallow /wp-rdf.php
Disallow /wp-register.php
Disallow /wp-rss.php
Disallow /wp-rss2.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php

yandex

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-activate.php
Disallow /wp-app.php
Disallow /wp-atom.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-commentsrss2.php
Disallow /wp-config-sample.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-feed.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-pass.php
Disallow /wp-rdf.php
Disallow /wp-register.php
Disallow /wp-rss.php
Disallow /wp-rss2.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php

Other Records

Field Value
sitemap http://compbasic.ru/sitemap.xml.gz
sitemap http://compbasic.ru/sitemap.xml

Warnings

  • `host` is not a known field.