bortnik66.ru
robots.txt

Robots Exclusion Standard data for bortnik66.ru

Resource Scan

Scan Details

Site Domain bortnik66.ru
Base Domain bortnik66.ru
Scan Status Ok
Last Scan2024-06-30T19:15:48+00:00
Next Scan 2024-07-07T19:15:48+00:00

Last Scan

Scanned2024-06-30T19:15:48+00:00
URL https://bortnik66.ru/robots.txt
Domain IPs 45.130.41.25
Response IP 45.130.41.25
Found Yes
Hash 4e1eaaa9a1484e78a6dc71c315a8165e2f30bbd81f9af2d24a55c0d8b970816a
SimHash 4f205cf2c6b8

Groups

mediapartners-google

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

applewebkit

Rule Path
Disallow /

*

Rule Path
Disallow /forum/

yandex

Rule Path
Disallow */forum/
Disallow */tag/
Disallow /tag/
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-comments
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */trackback
Disallow /cgi-bin
Disallow *?s=
Disallow *?showtopic=
Disallow *?automodule=downloads*
Allow /wp-content/uploads/
Allow /feed/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://bortnik66.ru/sitemap.xml

Warnings

  • `host` is not a known field.