blog.mail.ru
robots.txt
Robots Exclusion Standard data for blog.mail.ru
Resource Scan
Scan Details
Site Domain | blog.mail.ru |
Base Domain | mail.ru |
Scan Status | Ok |
Last Scan | 2024-05-10T02:23:24+00:00 |
Next Scan | 2024-06-09T02:23:24+00:00 |
Last Scan
Scanned | 2024-05-10T02:23:24+00:00 |
URL | https://blog.mail.ru/robots.txt |
Domain IPs | 5.61.236.239 |
Response IP | 5.61.236.239 |
Found | Yes |
Hash | fb4534a1eae9e6dea73b7c33a10078049d9f143194fea4c4c05688596fb30b03 |
SimHash | ca010445a213 |
Groups
*
Rule | Path |
---|---|
Disallow | /mail_gpt/ |
Disallow | /page_54221/ |
Disallow | /page_99835/ |
Disallow | /setyourmailpromo/rules/ |
Disallow | /setyourmailpromo/ |
Disallow | /setyourmailpromo/terms/ |
Disallow | /test_test_test/ |
Disallow | /test_12332141/ |
Disallow | /beta-mail/ |
Disallow | /543790348934/ |
Disallow | /test_for_animaition/ |
Disallow | /mail_ai_copy/ |
Disallow | /link_testing/ |
Disallow | /new_mobile_calendar/ |
Other Records
Field | Value |
---|---|
sitemap | https://blog.mail.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.