wikigrib.ru
robots.txt

Robots Exclusion Standard data for wikigrib.ru

Resource Scan

Scan Details

Site Domain wikigrib.ru
Base Domain wikigrib.ru
Scan Status Ok
Last Scan2025-11-26T13:23:47+00:00
Next Scan 2025-12-03T13:23:47+00:00

Last Scan

Scanned2025-11-26T13:23:47+00:00
URL https://wikigrib.ru/robots.txt
Domain IPs 104.21.10.109, 172.67.131.116, 2606:4700:3032::6815:a6d, 2606:4700:3037::ac43:8374
Response IP 172.67.131.116
Found Yes
Hash 1f8f61d52cbb81d55569a3a999c88a81e8655a8c1fd2e5d3ee318315bac857b2
SimHash 6b22d842e0a7

Groups

*

Rule Path
Disallow /author/
Disallow /archives/
Disallow /grib_gallery/
Disallow /page/
Disallow /vidy/page/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/*.js
Disallow /wp-content/plugins/
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Disallow /wp-json/
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed
Disallow */feed
Disallow */?
Disallow *.php?
Disallow /?s=1
Disallow /search/
Disallow /tm/
Disallow /tb/
Disallow /comment-
Disallow /blok-novoe/

google
yandex

Rule Path
Disallow /author/
Disallow /archives/
Disallow /grib_gallery/
Disallow /?p=
Disallow /page/
Disallow /vidy/page/
Disallow */?
Disallow *.php?
Disallow /wp-json/
Disallow /wp-content/plugins/
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/*.js
Disallow */*/feed
Disallow */feed
Disallow /?s=
Disallow /search/
Disallow /tm/
Disallow /tb/
Disallow /comment-
Disallow /blok-novoe/
Disallow /video-sitemap.xml

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://wikigrib.ru/sitemap.xml
sitemap https://wikigrib.ru/video-sitemap.xml
sitemap https://wikigrib.ru/sitemap.xml

Comments

  • Disallow: /ts/
  • Disallow: /ts/

Warnings

  • `host` is not a known field.