otvet.mail.ru
robots.txt
Robots Exclusion Standard data for otvet.mail.ru
Resource Scan
Scan Details
| Site Domain | otvet.mail.ru |
| Base Domain | mail.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-24T09:16:10+00:00 |
| Next Scan | 2024-06-25T09:16:10+00:00 |
Last Scan
| Scanned | 2024-06-24T09:16:10+00:00 |
| URL | https://otvet.mail.ru/robots.txt |
| Domain IPs | 5.61.236.236 |
| Response IP | 5.61.236.236 |
| Found | Yes |
| Hash | ecb351c6f4320e01d3c8621c4ddeedd2a1af09dae591a6c0e46cc6a9c8ae5830 |
| SimHash | 437c1ec1ee99 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /doit |
| Disallow | /loginform |
| Disallow | /profile/ |
| Disallow | /sms |
| Disallow | /comments |
| Disallow | /moderlog |
| Disallow | /answer/ |
| Disallow | /next/ |
| Disallow | /qstmarks/ |
| Disallow | /ansmarks/ |
| Disallow | /tag/ |
| Disallow | /*/tag/ |
| Disallow | /answer* |
| Disallow | /top/ |
| Disallow | /smstop/promo |
| Disallow | /go-web/ |
| Disallow | /go-mobile/ |
| Disallow | /direct/ |
| Disallow | /settings |
| Disallow | /question/*/cid-* |
| Disallow | *?point=* |
| Disallow | /?fr=* |
| Disallow | /search/ |
| Disallow | *?begin_reply* |
| Disallow | *?begin_add* |
| Disallow | *?ref=stat |
| Allow | /ask$ |
| Disallow | /ask* |
| Disallow | /unwatch/ |
| Disallow | /?pg=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://otvet.mail.ru/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.