i-am-a-programmer.ru
robots.txt

Robots Exclusion Standard data for i-am-a-programmer.ru

Resource Scan

Scan Details

Site Domain i-am-a-programmer.ru
Base Domain i-am-a-programmer.ru
Scan Status Ok
Last Scan2025-06-18T13:05:54+00:00
Next Scan 2025-06-25T13:05:54+00:00

Last Scan

Scanned2025-06-18T13:05:54+00:00
URL http://i-am-a-programmer.ru/robots.txt
Domain IPs 141.8.192.37
Response IP 141.8.192.37
Found Yes
Hash fac621485550a146cad38449226009e5d6d5154ed578523142a6a77a0537f597
SimHash 6561da830b96

Groups

*

Rule Path
Disallow /wp-admin
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /en
Disallow /register
Disallow /lostpassword
Disallow /resetpass
Disallow /login
Disallow /logout
Disallow /community/activity
Disallow /community/account
Disallow /community/subscriptions
Disallow /community/profile

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /en
Disallow /register
Disallow /lostpassword
Disallow /resetpass
Disallow /login
Disallow /logout
Disallow /community/activity
Disallow /community/account
Disallow /community/subscriptions
Disallow /community/profile

Other Records

Field Value
sitemap http://i-am-a-programmer.ru/sitemap.xml

Warnings

  • `host` is not a known field.