chert-poberi.ru
robots.txt
Robots Exclusion Standard data for chert-poberi.ru
Resource Scan
Scan Details
Site Domain | chert-poberi.ru |
Base Domain | chert-poberi.ru |
Scan Status | Ok |
Last Scan | 2024-09-27T10:33:05+00:00 |
Next Scan | 2024-10-04T10:33:05+00:00 |
Last Scan
Scanned | 2024-09-27T10:33:05+00:00 |
URL | https://chert-poberi.ru/robots.txt |
Domain IPs | 104.21.36.28, 172.67.184.82, 2606:4700:3033::ac43:b852, 2606:4700:3035::6815:241c |
Response IP | 172.67.184.82 |
Found | Yes |
Hash | ea0b0dd90f65d325544e310ef685ea29773cd1143906218ab52c896f33bf1ea1 |
SimHash | e38e8b626723 |
Groups
*
Rule | Path |
---|---|
Disallow | *.chert-poberi.ru |
Disallow | /wp- |
Disallow | /tag/ |
Disallow | */trackback |
Disallow | */page |
Disallow | /author/* |
Disallow | /template.html |
Disallow | /readme.html |
Disallow | *?replytocom |
Disallow | */?p= |
Disallow | */feed |
Disallow | */account?* |
Disallow | *.html?* |
Disallow | *?yrwinfo=* |
Disallow | */embed* |
Allow | /wp-content/plugins/* |
Allow | */uploads |
Allow | *.js |
Allow | *.css |
Allow | *.png |
Allow | *.gif |
Allow | *.jpg |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://chert-poberi.ru/sitemap.xml |
Warnings
- `host` is not a known field.