endokrinoloq.ru
robots.txt
Robots Exclusion Standard data for endokrinoloq.ru
Resource Scan
Scan Details
Site Domain | endokrinoloq.ru |
Base Domain | endokrinoloq.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-30T16:28:54+00:00 |
Next Scan | 2025-04-29T16:28:54+00:00 |
Last Successful Scan
Scanned | 2025-03-01T16:28:04+00:00 |
URL | https://endokrinoloq.ru/robots.txt |
Domain IPs | 141.8.195.124 |
Response IP | 141.8.195.124 |
Found | Yes |
Hash | 5388eeea734cb64e2ac30618c2a65c99470d7786ce46ca381fc5b20ec6c9c081 |
SimHash | 6f61ecfa8682 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /feed/ |
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /trackback |
Disallow | */comments |
Disallow | /category/*/* |
Disallow | */trackback |
Disallow | */*/trackback |
Disallow | */*/feed/*/ |
Disallow | */feed |
Disallow | /*?* |
Disallow | /?s= |
Allow | *?replytocom |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
yandex
Rule | Path |
---|---|
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /feed/ |
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /trackback |
Disallow | */comments |
Disallow | /category/*/* |
Disallow | */trackback |
Disallow | */*/trackback |
Disallow | */*/feed/*/ |
Disallow | */feed |
Disallow | /*?* |
Disallow | /?s= |
Allow | *?replytocom |
googlebot
Rule | Path |
---|---|
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /webstat/ |
Disallow | /feed/ |
Disallow | /trackback |
Disallow | */trackback |
Disallow | */feed |
Disallow | */comments |
Disallow | /*?* |
Disallow | /*? |
Disallow | /category/*/* |
Disallow | /wp-content/plugins |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /comments |
Disallow | /archives/ |
Disallow | /xmlrpc.php |
Disallow | *?replytocom |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
Other Records
Field | Value |
---|---|
sitemap | https://endokrinoloq.ru/sitemap.xml |
sitemap | https://endokrinoloq.ru/sitemap.xml.gz |
sitemap | https://endokrinoloq.ru/sitemap.xml |
Warnings
- `host` is not a known field.