bio-cat.ru
robots.txt

Robots Exclusion Standard data for bio-cat.ru

Resource Scan

Scan Details

Site Domain bio-cat.ru
Base Domain bio-cat.ru
Scan Status Ok
Last Scan2025-02-12T22:58:30+00:00
Next Scan 2025-03-14T22:58:30+00:00

Last Scan

Scanned2025-02-12T22:58:30+00:00
URL https://bio-cat.ru/robots.txt
Domain IPs 104.21.41.165, 172.67.191.184, 2606:4700:3030::6815:29a5, 2606:4700:3036::ac43:bfb8
Response IP 104.21.41.165
Found Yes
Hash de6e961c395c0f523a253109bd696313b03eeaa542d64ab6d7ab266cdbb78e76
SimHash 7d35ab50d7f0

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /wp/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */embed$
Disallow */xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow */feed/
Allow */wp-*/*ajax*.php
Allow */wp-sitemap
Allow */uploads
Allow */wp-*/*.js
Allow */wp-*/*.css
Allow */wp-*/*.png
Allow */wp-*/*.jpg
Allow */wp-*/*.jpeg
Allow */wp-*/*.gif
Allow */wp-*/*.svg
Allow */wp-*/*.webp
Allow */wp-*/*.swf
Allow */wp-*/*.pdf

googlebot

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /wp/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */embed$
Disallow */xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow */feed/
Allow */wp-*/*ajax*.php
Allow */wp-sitemap
Allow */uploads
Allow */wp-*/*.js
Allow */wp-*/*.css
Allow */wp-*/*.png
Allow */wp-*/*.jpg
Allow */wp-*/*.jpeg
Allow */wp-*/*.gif
Allow */wp-*/*.svg
Allow */wp-*/*.webp
Allow */wp-*/*.swf
Allow */wp-*/*.pdf

Other Records

Field Value
sitemap https://bio-cat.ru/sitemap_index.xml