cawa.ru
robots.txt

Robots Exclusion Standard data for cawa.ru

Resource Scan

Scan Details

Site Domain cawa.ru
Base Domain cawa.ru
Scan Status Ok
Last Scan2024-07-01T16:54:49+00:00
Next Scan 2024-07-08T16:54:49+00:00

Last Scan

Scanned2024-07-01T16:54:49+00:00
URL https://cawa.ru/robots.txt
Domain IPs 31.172.67.8
Response IP 31.172.67.8
Found Yes
Hash 3bd92480ed3c0bf8b3e2b6b2f4626975bf33fd29452fe96be3361917a5c0094c
SimHash 070190e2ae10

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Disallow /?cat=*
Disallow /?p=*
Disallow */comment-page-*
Disallow /comments
Disallow */trackback
Disallow */comments

yandex-zora-online

Rule Path
Allow *

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Disallow /?cat=*
Disallow /?p=*
Disallow */comment-page-*
Disallow /comments
Disallow */trackback
Disallow */comments

Other Records

Field Value
sitemap https://cawa.ru/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.