cerkov.ru
robots.txt

Robots Exclusion Standard data for cerkov.ru

Resource Scan

Scan Details

Site Domain cerkov.ru
Base Domain cerkov.ru
Scan Status Ok
Last Scan2024-09-15T08:50:16+00:00
Next Scan 2024-10-15T08:50:16+00:00

Last Scan

Scanned2024-09-15T08:50:16+00:00
URL https://cerkov.ru/robots.txt
Domain IPs 185.200.240.245
Response IP 185.200.240.245
Found Yes
Hash f3face13fb0a9c967287e2a2eaf9a98b45f010aa1876c8186811b27d0e10af45
SimHash 2b54c7cf52b7

Groups

wbsearchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 600

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 500

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/ms-files.php*
Disallow /index-install.php
Disallow /wp-activate.php
Disallow /wp-app.php
Disallow /wp-blog-header.php
Disallow /wp-comments-post.php
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /prihod-auth.php
Disallow /wp-mail.php
Disallow /wp-pass.php
Disallow /wp-settings.php
Disallow /wp-signup.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php
Disallow /bb-config.php
Disallow /counter/
Disallow /images/
Disallow /captcha-token.php
Disallow /ortox-map.php
Disallow /ortox-ajax.php
Disallow /ortox-feed.php
Disallow /oldie.html
Disallow */trackback
Disallow */comments
Disallow /category
Disallow /category/*/*
Disallow /tag
Disallow /tag/
Disallow */comments$
Disallow */comments/
Disallow /archive
Disallow */feed/
Disallow */*/feed/*/
Disallow */feed
Disallow */*/feed
Disallow /?feed=
Disallow */feed$
Disallow /?s=*
Disallow /page/*
Disallow /author/*
Disallow /*?*
Disallow */trackback/
Disallow */trackback$
Disallow /api/

Other Records

Field Value
crawl-delay 240

Comments

  • This rule means it applies to all user-agents
  • Disallow: /wp-includes/