botsad.msu.ru
robots.txt
Robots Exclusion Standard data for botsad.msu.ru
Resource Scan
Scan Details
| Site Domain | botsad.msu.ru |
| Base Domain | msu.ru |
| Scan Status | Ok |
| Last Scan | 2025-11-16T23:36:25+00:00 |
| Next Scan | 2025-12-16T23:36:25+00:00 |
Last Scan
| Scanned | 2025-11-16T23:36:25+00:00 |
| URL | https://botsad.msu.ru/robots.txt |
| Domain IPs | 158.160.59.233 |
| Response IP | 158.160.59.233 |
| Found | Yes |
| Hash | 5b922d7db72811bb558d6e385ac56364ec2319157fe2916fb6a13ff426df5bc1 |
| SimHash | 6984be64afb0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /author/ |
| Disallow | /layout_type/ |
| Disallow | /module_width/ |
| Disallow | /scope/ |
| Disallow | /calendar/ |
| Disallow | /dict/ |
| Disallow | /doc/ |
| Disallow | /news/ |
| Disallow | /search.php |
| Disallow | /gallery/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://botsad.msu.ru/sitemap.xml |
| sitemap | https://botsad.msu.ru/sitemap.rss |
Warnings
- `clean-param` is not a known field.