freethinker.ru
robots.txt

Robots Exclusion Standard data for freethinker.ru

Resource Scan

Scan Details

Site Domain freethinker.ru
Base Domain freethinker.ru
Scan Status Ok
Last Scan2025-11-27T10:00:53+00:00
Next Scan 2025-12-04T10:00:53+00:00

Last Scan

Scanned2025-11-27T10:00:53+00:00
URL https://freethinker.ru/robots.txt
Domain IPs 62.109.24.26
Response IP 62.109.24.26
Found Yes
Hash c5bd051caedb1d77254bcf3a2e9671b2f39c638a78e733794a576f700e7a1a2f
SimHash 4b40d4968612

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /?s=
Disallow /?page=
Disallow /?fbclid=
Disallow /*?page=

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /?s=
Disallow /?page=
Disallow /?fbclid=
Disallow /*?page=

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://freethinker.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.