avtonov.info
robots.txt

Robots Exclusion Standard data for avtonov.info

Resource Scan

Scan Details

Site Domain avtonov.info
Base Domain avtonov.info
Scan Status Ok
Last Scan2025-10-19T18:46:56+00:00
Next Scan 2025-10-26T18:46:56+00:00

Last Scan

Scanned2025-10-19T18:46:56+00:00
URL https://avtonov.info/robots.txt
Domain IPs 87.236.16.104
Response IP 87.236.16.104
Found Yes
Hash d1a150e1c0fd6a29214d699ad663f3283a80f201b30801c26066dc5d87cb3227
SimHash 6f30197112b4

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /tag/
Disallow /archive/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow */mailto/
Disallow /?feed=
Disallow /?
Disallow /*?*
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */embed
Disallow */page/

Other Records

Field Value
sitemap https://avtonov.info/sitemap.xml

Warnings

  • `host` is not a known field.