bitraid.ru
robots.txt

Robots Exclusion Standard data for bitraid.ru

Resource Scan

Scan Details

Site Domain bitraid.ru
Base Domain bitraid.ru
Scan Status Ok
Last Scan2025-12-04T23:50:13+00:00
Next Scan 2026-01-03T23:50:13+00:00

Last Scan

Scanned2025-12-04T23:50:13+00:00
URL https://bitraid.ru/robots.txt
Domain IPs 5.23.50.101
Response IP 5.23.50.101
Found Yes
Hash 32b7b2c47314360f022c9e7fbe919dd048a64602359c1f13c6bff1293e5ed41e
SimHash 7308dd234c92

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /index.php*
Disallow /?page*
Disallow *?option*
Disallow /videootchet/
Disallow /review/
Disallow /author/
Disallow /doc/
Disallow *?board*
Disallow *?ca=*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://bitraid.ru/sitemap_index.xml

Comments

  • LLMs.txt files for AI systems

Warnings

  • `ai-crawlers` is not a known field.
  • `llms-txt` is not a known field.