berdsk-online.ru
robots.txt

Robots Exclusion Standard data for berdsk-online.ru

Resource Scan

Scan Details

Site Domain berdsk-online.ru
Base Domain berdsk-online.ru
Scan Status Ok
Last Scan2024-09-23T23:20:50+00:00
Next Scan 2024-09-30T23:20:50+00:00

Last Scan

Scanned2024-09-23T23:20:50+00:00
URL https://berdsk-online.ru/robots.txt
Domain IPs 104.21.38.106, 172.67.221.254, 2606:4700:3032::6815:266a, 2606:4700:3035::ac43:ddfe
Response IP 104.21.38.106
Found Yes
Hash d7aed43061e5994e6774e5355b905c660a4728e9515787dc352737c1c6c004e9
SimHash 7ca5ab70d9b3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow *?erid=*
Allow */wp-*/*ajax*.php
Allow */wp-sitemap
Allow */uploads
Allow */wp-*/*.js
Allow */wp-*/*.css
Allow */wp-*/*.png
Allow */wp-*/*.jpg
Allow */wp-*/*.jpeg
Allow */wp-*/*.gif
Allow */wp-*/*.svg
Allow */wp-*/*.webp
Allow */wp-*/*.swf
Allow */wp-*/*.pdf
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow *embed*
Disallow *swcfpc%3D*
Disallow /wp-json/
Disallow /readme.html

yandex

Rule Path
Allow */wp-*/*ajax*.php
Allow */wp-sitemap
Allow */uploads
Allow */wp-*/*.js
Allow */wp-*/*.css
Allow */wp-*/*.png
Allow */wp-*/*.jpg
Allow */wp-*/*.jpeg
Allow */wp-*/*.gif
Allow */wp-*/*.svg
Allow */wp-*/*.webp
Allow */wp-*/*.swf
Allow */wp-*/*.pdf
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow *embed*
Disallow /wp-json/
Disallow /readme.html

googlebot

Rule Path
Allow *?erid=*
Allow /wp-admin/admin-ajax.php
Allow */wp-*/*ajax*.php
Allow */wp-sitemap
Allow */uploads
Allow */wp-*/*.js
Allow */wp-*/*.css
Allow */wp-*/*.png
Allow */wp-*/*.jpg
Allow */wp-*/*.jpeg
Allow */wp-*/*.gif
Allow */wp-*/*.svg
Allow */wp-*/*.webp
Allow */wp-*/*.swf
Allow */wp-*/*.pdf
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow *embed*
Disallow *swcfpc%3D
Disallow /wp-json/
Disallow /readme.html

Other Records

Field Value
sitemap https://berdsk-online.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.