diary.ru
robots.txt
Robots Exclusion Standard data for diary.ru
Resource Scan
Scan Details
Site Domain | diary.ru |
Base Domain | diary.ru |
Scan Status | Ok |
Last Scan | 2024-11-15T21:49:03+00:00 |
Next Scan | 2024-11-22T21:49:03+00:00 |
Last Scan
Scanned | 2024-11-15T21:49:03+00:00 |
URL | https://diary.ru/robots.txt |
Domain IPs | 104.21.55.103, 172.67.147.119, 2606:4700:3031::ac43:9377, 2606:4700:3033::6815:3767 |
Response IP | 104.21.55.103 |
Found | Yes |
Hash | 8ece0e7b0ae69ee1695247ea8e11679d960711acfd8ebcbe2d89b74696dc4245 |
SimHash | 41259c684d31 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /favorite/ |
Disallow | /?from |
Disallow | /sms/ |
Disallow | /u-mail/ |
Disallow | /options/ |
Disallow | /?sort |
Disallow | /?&sort |
Disallow | *%26ord |
Disallow | *%26l |
Disallow | *%26lsearch_opt |
Disallow | *%26act |
Disallow | *%26fullcommunity_moderatorslist |
Disallow | *%26fullcommunity_membershiplist |
Disallow | *%26fullfavoriteslist |
Disallow | *%26oam |
Disallow | /counter/ |
Disallow | /designdir/ |
Disallow | /?%2F* |
Disallow | /options/ |
Disallow | /registration/ |
Disallow | /photolib/ |
Disallow | /diary.php |
Disallow | /counter/ |
Disallow | /?favorite* |
Disallow | /?comments* |
Disallow | /tools/ |
Disallow | *%26checknewreader |
Disallow | *?order=* |
Disallow | /members/?search_opt=* |
Disallow | /?first_post&from=* |
Disallow | /?last_post&from=* |
Disallow | /?post_next&postid=* |
Disallow | *?&last_post |
Disallow | /?tag=* |
Disallow | /discussion/ |
Disallow | /?rfrom=* |
Disallow | *?all=true |
Other Records
Field | Value |
---|---|
sitemap | https://diary.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.